00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2408 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3669 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.001 Started by timer 00:00:00.198 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.199 The recommended git tool is: git 00:00:00.199 using credential 00000000-0000-0000-0000-000000000002 00:00:00.200 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.222 Fetching changes from the remote Git repository 00:00:00.226 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.254 Using shallow fetch with depth 1 00:00:00.254 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.254 > git --version # timeout=10 00:00:00.277 > git --version # 'git version 2.39.2' 00:00:00.277 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.291 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.291 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.743 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.753 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.765 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:05.765 > git config core.sparsecheckout # timeout=10 00:00:05.774 > git read-tree -mu HEAD # timeout=10 00:00:05.791 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:05.810 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:05.810 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:05.888 [Pipeline] Start of Pipeline 00:00:05.904 [Pipeline] library 00:00:05.906 Loading library shm_lib@master 00:00:05.906 Library shm_lib@master is cached. Copying from home. 00:00:05.929 [Pipeline] node 00:00:05.939 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.941 [Pipeline] { 00:00:05.951 [Pipeline] catchError 00:00:05.953 [Pipeline] { 00:00:05.963 [Pipeline] wrap 00:00:05.970 [Pipeline] { 00:00:05.975 [Pipeline] stage 00:00:05.977 [Pipeline] { (Prologue) 00:00:06.184 [Pipeline] sh 00:00:06.484 + logger -p user.info -t JENKINS-CI 00:00:06.501 [Pipeline] echo 00:00:06.502 Node: GP11 00:00:06.509 [Pipeline] sh 00:00:06.804 [Pipeline] setCustomBuildProperty 00:00:06.816 [Pipeline] echo 00:00:06.818 Cleanup processes 00:00:06.824 [Pipeline] sh 00:00:07.109 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.109 672249 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.121 [Pipeline] sh 00:00:07.402 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.403 ++ grep -v 'sudo pgrep' 00:00:07.403 ++ awk '{print $1}' 00:00:07.403 + sudo kill -9 00:00:07.403 + true 00:00:07.416 [Pipeline] cleanWs 00:00:07.426 [WS-CLEANUP] Deleting project workspace... 00:00:07.426 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.432 [WS-CLEANUP] done 00:00:07.436 [Pipeline] setCustomBuildProperty 00:00:07.450 [Pipeline] sh 00:00:07.731 + sudo git config --global --replace-all safe.directory '*' 00:00:07.809 [Pipeline] httpRequest 00:00:09.127 [Pipeline] echo 00:00:09.129 Sorcerer 10.211.164.101 is alive 00:00:09.138 [Pipeline] retry 00:00:09.140 [Pipeline] { 00:00:09.154 [Pipeline] httpRequest 00:00:09.159 HttpMethod: GET 00:00:09.159 URL: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.160 Sending request to url: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.177 Response Code: HTTP/1.1 200 OK 00:00:09.178 Success: Status code 200 is in the accepted range: 200,404 00:00:09.178 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:10.449 [Pipeline] } 00:00:10.462 [Pipeline] // retry 00:00:10.469 [Pipeline] sh 00:00:10.751 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:10.768 [Pipeline] httpRequest 00:00:11.144 [Pipeline] echo 00:00:11.146 Sorcerer 10.211.164.101 is alive 00:00:11.153 [Pipeline] retry 00:00:11.155 [Pipeline] { 00:00:11.168 [Pipeline] httpRequest 00:00:11.173 HttpMethod: GET 00:00:11.173 URL: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:11.173 Sending request to url: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:11.184 Response Code: HTTP/1.1 200 OK 00:00:11.185 Success: Status code 200 is in the accepted range: 200,404 00:00:11.185 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:40.923 [Pipeline] } 00:00:40.940 [Pipeline] // retry 00:00:40.947 [Pipeline] sh 00:00:41.233 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:44.548 [Pipeline] sh 00:00:44.840 + git -C spdk log --oneline -n5 00:00:44.840 c13c99a5e test: Various fixes for Fedora40 00:00:44.840 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:00:44.840 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:00:44.840 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:00:44.840 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:00:44.853 [Pipeline] } 00:00:44.870 [Pipeline] // stage 00:00:44.880 [Pipeline] stage 00:00:44.882 [Pipeline] { (Prepare) 00:00:44.903 [Pipeline] writeFile 00:00:44.922 [Pipeline] sh 00:00:45.212 + logger -p user.info -t JENKINS-CI 00:00:45.226 [Pipeline] sh 00:00:45.513 + logger -p user.info -t JENKINS-CI 00:00:45.527 [Pipeline] sh 00:00:45.813 + cat autorun-spdk.conf 00:00:45.813 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:45.813 SPDK_TEST_NVMF=1 00:00:45.813 SPDK_TEST_NVME_CLI=1 00:00:45.813 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:45.813 SPDK_TEST_NVMF_NICS=e810 00:00:45.813 SPDK_RUN_UBSAN=1 00:00:45.813 NET_TYPE=phy 00:00:45.821 RUN_NIGHTLY=1 00:00:45.826 [Pipeline] readFile 00:00:45.859 [Pipeline] withEnv 00:00:45.861 [Pipeline] { 00:00:45.873 [Pipeline] sh 00:00:46.158 + set -ex 00:00:46.158 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:00:46.158 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:46.158 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:46.158 ++ SPDK_TEST_NVMF=1 00:00:46.158 ++ SPDK_TEST_NVME_CLI=1 00:00:46.158 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:46.158 ++ SPDK_TEST_NVMF_NICS=e810 00:00:46.158 ++ SPDK_RUN_UBSAN=1 00:00:46.158 ++ NET_TYPE=phy 00:00:46.158 ++ RUN_NIGHTLY=1 00:00:46.158 + case $SPDK_TEST_NVMF_NICS in 00:00:46.158 + DRIVERS=ice 00:00:46.158 + [[ tcp == \r\d\m\a ]] 00:00:46.158 + [[ -n ice ]] 00:00:46.158 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:00:46.158 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:00:46.158 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:00:46.158 rmmod: ERROR: Module irdma is not currently loaded 00:00:46.158 rmmod: ERROR: Module i40iw is not currently loaded 00:00:46.158 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:00:46.158 + true 00:00:46.158 + for D in $DRIVERS 00:00:46.158 + sudo modprobe ice 00:00:46.158 + exit 0 00:00:46.167 [Pipeline] } 00:00:46.181 [Pipeline] // withEnv 00:00:46.188 [Pipeline] } 00:00:46.203 [Pipeline] // stage 00:00:46.212 [Pipeline] catchError 00:00:46.213 [Pipeline] { 00:00:46.226 [Pipeline] timeout 00:00:46.226 Timeout set to expire in 1 hr 0 min 00:00:46.228 [Pipeline] { 00:00:46.241 [Pipeline] stage 00:00:46.244 [Pipeline] { (Tests) 00:00:46.258 [Pipeline] sh 00:00:46.547 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:46.547 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:46.547 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:46.547 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:00:46.547 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:46.547 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:46.547 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:00:46.547 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:46.547 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:46.547 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:46.547 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:00:46.547 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:46.547 + source /etc/os-release 00:00:46.547 ++ NAME='Fedora Linux' 00:00:46.547 ++ VERSION='39 (Cloud Edition)' 00:00:46.547 ++ ID=fedora 00:00:46.547 ++ VERSION_ID=39 00:00:46.547 ++ VERSION_CODENAME= 00:00:46.547 ++ PLATFORM_ID=platform:f39 00:00:46.547 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:00:46.547 ++ ANSI_COLOR='0;38;2;60;110;180' 00:00:46.547 ++ LOGO=fedora-logo-icon 00:00:46.547 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:00:46.547 ++ HOME_URL=https://fedoraproject.org/ 00:00:46.547 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:00:46.547 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:00:46.547 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:00:46.547 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:00:46.547 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:00:46.547 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:00:46.547 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:00:46.547 ++ SUPPORT_END=2024-11-12 00:00:46.547 ++ VARIANT='Cloud Edition' 00:00:46.547 ++ VARIANT_ID=cloud 00:00:46.547 + uname -a 00:00:46.547 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:00:46.547 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:00:47.490 Hugepages 00:00:47.490 node hugesize free / total 00:00:47.490 node0 1048576kB 0 / 0 00:00:47.490 node0 2048kB 0 / 0 00:00:47.490 node1 1048576kB 0 / 0 00:00:47.490 node1 2048kB 0 / 0 00:00:47.490 00:00:47.490 Type BDF Vendor Device NUMA Driver Device Block devices 00:00:47.490 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:00:47.490 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:00:47.490 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:00:47.490 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:00:47.490 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:00:47.490 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:00:47.490 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:00:47.490 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:00:47.490 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:00:47.490 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:00:47.490 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:00:47.490 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:00:47.490 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:00:47.490 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:00:47.490 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:00:47.490 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:00:47.490 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:00:47.490 + rm -f /tmp/spdk-ld-path 00:00:47.490 + source autorun-spdk.conf 00:00:47.490 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:47.490 ++ SPDK_TEST_NVMF=1 00:00:47.490 ++ SPDK_TEST_NVME_CLI=1 00:00:47.490 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:47.490 ++ SPDK_TEST_NVMF_NICS=e810 00:00:47.490 ++ SPDK_RUN_UBSAN=1 00:00:47.490 ++ NET_TYPE=phy 00:00:47.490 ++ RUN_NIGHTLY=1 00:00:47.490 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:00:47.490 + [[ -n '' ]] 00:00:47.490 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:47.490 + for M in /var/spdk/build-*-manifest.txt 00:00:47.490 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:00:47.490 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:47.490 + for M in /var/spdk/build-*-manifest.txt 00:00:47.490 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:00:47.490 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:47.490 + for M in /var/spdk/build-*-manifest.txt 00:00:47.490 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:00:47.490 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:47.490 ++ uname 00:00:47.490 + [[ Linux == \L\i\n\u\x ]] 00:00:47.490 + sudo dmesg -T 00:00:47.750 + sudo dmesg --clear 00:00:47.750 + dmesg_pid=673534 00:00:47.750 + [[ Fedora Linux == FreeBSD ]] 00:00:47.750 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:47.750 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:47.750 + sudo dmesg -Tw 00:00:47.750 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:00:47.750 + [[ -x /usr/src/fio-static/fio ]] 00:00:47.750 + export FIO_BIN=/usr/src/fio-static/fio 00:00:47.750 + FIO_BIN=/usr/src/fio-static/fio 00:00:47.750 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:00:47.750 + [[ ! -v VFIO_QEMU_BIN ]] 00:00:47.750 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:00:47.750 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:47.750 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:47.750 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:00:47.750 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:47.750 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:47.750 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:47.750 Test configuration: 00:00:47.750 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:47.750 SPDK_TEST_NVMF=1 00:00:47.750 SPDK_TEST_NVME_CLI=1 00:00:47.750 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:47.750 SPDK_TEST_NVMF_NICS=e810 00:00:47.750 SPDK_RUN_UBSAN=1 00:00:47.750 NET_TYPE=phy 00:00:47.750 RUN_NIGHTLY=1 15:24:39 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:00:47.750 15:24:39 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:00:47.750 15:24:39 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:00:47.750 15:24:39 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:00:47.750 15:24:39 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:00:47.750 15:24:39 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:47.750 15:24:39 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:47.750 15:24:39 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:47.750 15:24:39 -- paths/export.sh@5 -- $ export PATH 00:00:47.750 15:24:39 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:47.750 15:24:39 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:00:47.750 15:24:39 -- common/autobuild_common.sh@440 -- $ date +%s 00:00:47.750 15:24:39 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732631079.XXXXXX 00:00:47.750 15:24:39 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732631079.u1sP8N 00:00:47.750 15:24:39 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:00:47.750 15:24:39 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:00:47.750 15:24:39 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:00:47.750 15:24:39 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:00:47.750 15:24:39 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:00:47.750 15:24:39 -- common/autobuild_common.sh@456 -- $ get_config_params 00:00:47.750 15:24:39 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:00:47.750 15:24:39 -- common/autotest_common.sh@10 -- $ set +x 00:00:47.750 15:24:39 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:00:47.750 15:24:39 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:00:47.750 15:24:39 -- spdk/autobuild.sh@12 -- $ umask 022 00:00:47.750 15:24:39 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:47.750 15:24:39 -- spdk/autobuild.sh@16 -- $ date -u 00:00:47.750 Tue Nov 26 02:24:39 PM UTC 2024 00:00:47.750 15:24:39 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:00:47.750 LTS-67-gc13c99a5e 00:00:47.750 15:24:39 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:00:47.750 15:24:39 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:00:47.750 15:24:39 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:00:47.750 15:24:39 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:00:47.750 15:24:39 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:00:47.750 15:24:39 -- common/autotest_common.sh@10 -- $ set +x 00:00:47.750 ************************************ 00:00:47.750 START TEST ubsan 00:00:47.750 ************************************ 00:00:47.750 15:24:39 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:00:47.750 using ubsan 00:00:47.750 00:00:47.750 real 0m0.000s 00:00:47.750 user 0m0.000s 00:00:47.750 sys 0m0.000s 00:00:47.750 15:24:39 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:00:47.750 15:24:39 -- common/autotest_common.sh@10 -- $ set +x 00:00:47.750 ************************************ 00:00:47.750 END TEST ubsan 00:00:47.750 ************************************ 00:00:47.750 15:24:39 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:00:47.750 15:24:39 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:00:47.750 15:24:39 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:00:47.750 15:24:39 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:00:47.750 15:24:39 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:00:47.750 15:24:39 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:00:47.750 15:24:39 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:00:47.750 15:24:39 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:00:47.750 15:24:39 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:00:47.750 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:00:47.750 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:00:48.009 Using 'verbs' RDMA provider 00:00:58.597 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:08.587 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:08.587 Creating mk/config.mk...done. 00:01:08.587 Creating mk/cc.flags.mk...done. 00:01:08.587 Type 'make' to build. 00:01:08.587 15:24:59 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:08.587 15:24:59 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:08.587 15:24:59 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:08.587 15:24:59 -- common/autotest_common.sh@10 -- $ set +x 00:01:08.587 ************************************ 00:01:08.587 START TEST make 00:01:08.587 ************************************ 00:01:08.587 15:24:59 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:08.587 make[1]: Nothing to be done for 'all'. 00:01:16.731 The Meson build system 00:01:16.731 Version: 1.5.0 00:01:16.731 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:16.731 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:16.731 Build type: native build 00:01:16.731 Program cat found: YES (/usr/bin/cat) 00:01:16.731 Project name: DPDK 00:01:16.731 Project version: 23.11.0 00:01:16.731 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:16.731 C linker for the host machine: cc ld.bfd 2.40-14 00:01:16.731 Host machine cpu family: x86_64 00:01:16.731 Host machine cpu: x86_64 00:01:16.731 Message: ## Building in Developer Mode ## 00:01:16.731 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:16.731 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:16.731 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:16.731 Program python3 found: YES (/usr/bin/python3) 00:01:16.731 Program cat found: YES (/usr/bin/cat) 00:01:16.731 Compiler for C supports arguments -march=native: YES 00:01:16.731 Checking for size of "void *" : 8 00:01:16.731 Checking for size of "void *" : 8 (cached) 00:01:16.731 Library m found: YES 00:01:16.731 Library numa found: YES 00:01:16.731 Has header "numaif.h" : YES 00:01:16.731 Library fdt found: NO 00:01:16.731 Library execinfo found: NO 00:01:16.731 Has header "execinfo.h" : YES 00:01:16.731 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:16.732 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:16.732 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:16.732 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:16.732 Run-time dependency openssl found: YES 3.1.1 00:01:16.732 Run-time dependency libpcap found: YES 1.10.4 00:01:16.732 Has header "pcap.h" with dependency libpcap: YES 00:01:16.732 Compiler for C supports arguments -Wcast-qual: YES 00:01:16.732 Compiler for C supports arguments -Wdeprecated: YES 00:01:16.732 Compiler for C supports arguments -Wformat: YES 00:01:16.732 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:16.732 Compiler for C supports arguments -Wformat-security: NO 00:01:16.732 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:16.732 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:16.732 Compiler for C supports arguments -Wnested-externs: YES 00:01:16.732 Compiler for C supports arguments -Wold-style-definition: YES 00:01:16.732 Compiler for C supports arguments -Wpointer-arith: YES 00:01:16.732 Compiler for C supports arguments -Wsign-compare: YES 00:01:16.732 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:16.732 Compiler for C supports arguments -Wundef: YES 00:01:16.732 Compiler for C supports arguments -Wwrite-strings: YES 00:01:16.732 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:16.732 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:16.732 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:16.732 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:16.732 Program objdump found: YES (/usr/bin/objdump) 00:01:16.732 Compiler for C supports arguments -mavx512f: YES 00:01:16.732 Checking if "AVX512 checking" compiles: YES 00:01:16.732 Fetching value of define "__SSE4_2__" : 1 00:01:16.732 Fetching value of define "__AES__" : 1 00:01:16.732 Fetching value of define "__AVX__" : 1 00:01:16.732 Fetching value of define "__AVX2__" : (undefined) 00:01:16.732 Fetching value of define "__AVX512BW__" : (undefined) 00:01:16.732 Fetching value of define "__AVX512CD__" : (undefined) 00:01:16.732 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:16.732 Fetching value of define "__AVX512F__" : (undefined) 00:01:16.732 Fetching value of define "__AVX512VL__" : (undefined) 00:01:16.732 Fetching value of define "__PCLMUL__" : 1 00:01:16.732 Fetching value of define "__RDRND__" : 1 00:01:16.732 Fetching value of define "__RDSEED__" : (undefined) 00:01:16.732 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:16.732 Fetching value of define "__znver1__" : (undefined) 00:01:16.732 Fetching value of define "__znver2__" : (undefined) 00:01:16.732 Fetching value of define "__znver3__" : (undefined) 00:01:16.732 Fetching value of define "__znver4__" : (undefined) 00:01:16.732 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:16.732 Message: lib/log: Defining dependency "log" 00:01:16.732 Message: lib/kvargs: Defining dependency "kvargs" 00:01:16.732 Message: lib/telemetry: Defining dependency "telemetry" 00:01:16.732 Checking for function "getentropy" : NO 00:01:16.732 Message: lib/eal: Defining dependency "eal" 00:01:16.732 Message: lib/ring: Defining dependency "ring" 00:01:16.732 Message: lib/rcu: Defining dependency "rcu" 00:01:16.732 Message: lib/mempool: Defining dependency "mempool" 00:01:16.732 Message: lib/mbuf: Defining dependency "mbuf" 00:01:16.732 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:16.732 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:16.732 Compiler for C supports arguments -mpclmul: YES 00:01:16.732 Compiler for C supports arguments -maes: YES 00:01:16.732 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:16.732 Compiler for C supports arguments -mavx512bw: YES 00:01:16.732 Compiler for C supports arguments -mavx512dq: YES 00:01:16.732 Compiler for C supports arguments -mavx512vl: YES 00:01:16.732 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:16.732 Compiler for C supports arguments -mavx2: YES 00:01:16.732 Compiler for C supports arguments -mavx: YES 00:01:16.732 Message: lib/net: Defining dependency "net" 00:01:16.732 Message: lib/meter: Defining dependency "meter" 00:01:16.732 Message: lib/ethdev: Defining dependency "ethdev" 00:01:16.732 Message: lib/pci: Defining dependency "pci" 00:01:16.732 Message: lib/cmdline: Defining dependency "cmdline" 00:01:16.732 Message: lib/hash: Defining dependency "hash" 00:01:16.732 Message: lib/timer: Defining dependency "timer" 00:01:16.732 Message: lib/compressdev: Defining dependency "compressdev" 00:01:16.732 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:16.732 Message: lib/dmadev: Defining dependency "dmadev" 00:01:16.732 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:16.732 Message: lib/power: Defining dependency "power" 00:01:16.732 Message: lib/reorder: Defining dependency "reorder" 00:01:16.732 Message: lib/security: Defining dependency "security" 00:01:16.732 Has header "linux/userfaultfd.h" : YES 00:01:16.732 Has header "linux/vduse.h" : YES 00:01:16.732 Message: lib/vhost: Defining dependency "vhost" 00:01:16.732 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:16.732 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:16.732 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:16.732 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:16.732 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:16.732 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:16.732 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:16.732 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:16.732 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:16.732 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:16.732 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:16.732 Configuring doxy-api-html.conf using configuration 00:01:16.732 Configuring doxy-api-man.conf using configuration 00:01:16.732 Program mandb found: YES (/usr/bin/mandb) 00:01:16.732 Program sphinx-build found: NO 00:01:16.732 Configuring rte_build_config.h using configuration 00:01:16.732 Message: 00:01:16.732 ================= 00:01:16.732 Applications Enabled 00:01:16.732 ================= 00:01:16.732 00:01:16.732 apps: 00:01:16.732 00:01:16.732 00:01:16.732 Message: 00:01:16.732 ================= 00:01:16.732 Libraries Enabled 00:01:16.732 ================= 00:01:16.732 00:01:16.732 libs: 00:01:16.732 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:16.732 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:16.732 cryptodev, dmadev, power, reorder, security, vhost, 00:01:16.732 00:01:16.732 Message: 00:01:16.732 =============== 00:01:16.732 Drivers Enabled 00:01:16.732 =============== 00:01:16.732 00:01:16.732 common: 00:01:16.732 00:01:16.732 bus: 00:01:16.732 pci, vdev, 00:01:16.732 mempool: 00:01:16.732 ring, 00:01:16.732 dma: 00:01:16.732 00:01:16.732 net: 00:01:16.732 00:01:16.732 crypto: 00:01:16.732 00:01:16.732 compress: 00:01:16.732 00:01:16.732 vdpa: 00:01:16.732 00:01:16.732 00:01:16.732 Message: 00:01:16.732 ================= 00:01:16.732 Content Skipped 00:01:16.732 ================= 00:01:16.732 00:01:16.732 apps: 00:01:16.732 dumpcap: explicitly disabled via build config 00:01:16.732 graph: explicitly disabled via build config 00:01:16.732 pdump: explicitly disabled via build config 00:01:16.732 proc-info: explicitly disabled via build config 00:01:16.732 test-acl: explicitly disabled via build config 00:01:16.732 test-bbdev: explicitly disabled via build config 00:01:16.732 test-cmdline: explicitly disabled via build config 00:01:16.732 test-compress-perf: explicitly disabled via build config 00:01:16.732 test-crypto-perf: explicitly disabled via build config 00:01:16.732 test-dma-perf: explicitly disabled via build config 00:01:16.732 test-eventdev: explicitly disabled via build config 00:01:16.732 test-fib: explicitly disabled via build config 00:01:16.732 test-flow-perf: explicitly disabled via build config 00:01:16.732 test-gpudev: explicitly disabled via build config 00:01:16.732 test-mldev: explicitly disabled via build config 00:01:16.732 test-pipeline: explicitly disabled via build config 00:01:16.732 test-pmd: explicitly disabled via build config 00:01:16.732 test-regex: explicitly disabled via build config 00:01:16.732 test-sad: explicitly disabled via build config 00:01:16.732 test-security-perf: explicitly disabled via build config 00:01:16.732 00:01:16.732 libs: 00:01:16.732 metrics: explicitly disabled via build config 00:01:16.732 acl: explicitly disabled via build config 00:01:16.732 bbdev: explicitly disabled via build config 00:01:16.732 bitratestats: explicitly disabled via build config 00:01:16.732 bpf: explicitly disabled via build config 00:01:16.732 cfgfile: explicitly disabled via build config 00:01:16.732 distributor: explicitly disabled via build config 00:01:16.732 efd: explicitly disabled via build config 00:01:16.732 eventdev: explicitly disabled via build config 00:01:16.732 dispatcher: explicitly disabled via build config 00:01:16.732 gpudev: explicitly disabled via build config 00:01:16.732 gro: explicitly disabled via build config 00:01:16.732 gso: explicitly disabled via build config 00:01:16.732 ip_frag: explicitly disabled via build config 00:01:16.732 jobstats: explicitly disabled via build config 00:01:16.732 latencystats: explicitly disabled via build config 00:01:16.732 lpm: explicitly disabled via build config 00:01:16.732 member: explicitly disabled via build config 00:01:16.732 pcapng: explicitly disabled via build config 00:01:16.732 rawdev: explicitly disabled via build config 00:01:16.732 regexdev: explicitly disabled via build config 00:01:16.732 mldev: explicitly disabled via build config 00:01:16.732 rib: explicitly disabled via build config 00:01:16.732 sched: explicitly disabled via build config 00:01:16.732 stack: explicitly disabled via build config 00:01:16.732 ipsec: explicitly disabled via build config 00:01:16.732 pdcp: explicitly disabled via build config 00:01:16.732 fib: explicitly disabled via build config 00:01:16.732 port: explicitly disabled via build config 00:01:16.732 pdump: explicitly disabled via build config 00:01:16.732 table: explicitly disabled via build config 00:01:16.732 pipeline: explicitly disabled via build config 00:01:16.732 graph: explicitly disabled via build config 00:01:16.732 node: explicitly disabled via build config 00:01:16.732 00:01:16.732 drivers: 00:01:16.732 common/cpt: not in enabled drivers build config 00:01:16.732 common/dpaax: not in enabled drivers build config 00:01:16.732 common/iavf: not in enabled drivers build config 00:01:16.732 common/idpf: not in enabled drivers build config 00:01:16.732 common/mvep: not in enabled drivers build config 00:01:16.732 common/octeontx: not in enabled drivers build config 00:01:16.732 bus/auxiliary: not in enabled drivers build config 00:01:16.732 bus/cdx: not in enabled drivers build config 00:01:16.732 bus/dpaa: not in enabled drivers build config 00:01:16.732 bus/fslmc: not in enabled drivers build config 00:01:16.733 bus/ifpga: not in enabled drivers build config 00:01:16.733 bus/platform: not in enabled drivers build config 00:01:16.733 bus/vmbus: not in enabled drivers build config 00:01:16.733 common/cnxk: not in enabled drivers build config 00:01:16.733 common/mlx5: not in enabled drivers build config 00:01:16.733 common/nfp: not in enabled drivers build config 00:01:16.733 common/qat: not in enabled drivers build config 00:01:16.733 common/sfc_efx: not in enabled drivers build config 00:01:16.733 mempool/bucket: not in enabled drivers build config 00:01:16.733 mempool/cnxk: not in enabled drivers build config 00:01:16.733 mempool/dpaa: not in enabled drivers build config 00:01:16.733 mempool/dpaa2: not in enabled drivers build config 00:01:16.733 mempool/octeontx: not in enabled drivers build config 00:01:16.733 mempool/stack: not in enabled drivers build config 00:01:16.733 dma/cnxk: not in enabled drivers build config 00:01:16.733 dma/dpaa: not in enabled drivers build config 00:01:16.733 dma/dpaa2: not in enabled drivers build config 00:01:16.733 dma/hisilicon: not in enabled drivers build config 00:01:16.733 dma/idxd: not in enabled drivers build config 00:01:16.733 dma/ioat: not in enabled drivers build config 00:01:16.733 dma/skeleton: not in enabled drivers build config 00:01:16.733 net/af_packet: not in enabled drivers build config 00:01:16.733 net/af_xdp: not in enabled drivers build config 00:01:16.733 net/ark: not in enabled drivers build config 00:01:16.733 net/atlantic: not in enabled drivers build config 00:01:16.733 net/avp: not in enabled drivers build config 00:01:16.733 net/axgbe: not in enabled drivers build config 00:01:16.733 net/bnx2x: not in enabled drivers build config 00:01:16.733 net/bnxt: not in enabled drivers build config 00:01:16.733 net/bonding: not in enabled drivers build config 00:01:16.733 net/cnxk: not in enabled drivers build config 00:01:16.733 net/cpfl: not in enabled drivers build config 00:01:16.733 net/cxgbe: not in enabled drivers build config 00:01:16.733 net/dpaa: not in enabled drivers build config 00:01:16.733 net/dpaa2: not in enabled drivers build config 00:01:16.733 net/e1000: not in enabled drivers build config 00:01:16.733 net/ena: not in enabled drivers build config 00:01:16.733 net/enetc: not in enabled drivers build config 00:01:16.733 net/enetfec: not in enabled drivers build config 00:01:16.733 net/enic: not in enabled drivers build config 00:01:16.733 net/failsafe: not in enabled drivers build config 00:01:16.733 net/fm10k: not in enabled drivers build config 00:01:16.733 net/gve: not in enabled drivers build config 00:01:16.733 net/hinic: not in enabled drivers build config 00:01:16.733 net/hns3: not in enabled drivers build config 00:01:16.733 net/i40e: not in enabled drivers build config 00:01:16.733 net/iavf: not in enabled drivers build config 00:01:16.733 net/ice: not in enabled drivers build config 00:01:16.733 net/idpf: not in enabled drivers build config 00:01:16.733 net/igc: not in enabled drivers build config 00:01:16.733 net/ionic: not in enabled drivers build config 00:01:16.733 net/ipn3ke: not in enabled drivers build config 00:01:16.733 net/ixgbe: not in enabled drivers build config 00:01:16.733 net/mana: not in enabled drivers build config 00:01:16.733 net/memif: not in enabled drivers build config 00:01:16.733 net/mlx4: not in enabled drivers build config 00:01:16.733 net/mlx5: not in enabled drivers build config 00:01:16.733 net/mvneta: not in enabled drivers build config 00:01:16.733 net/mvpp2: not in enabled drivers build config 00:01:16.733 net/netvsc: not in enabled drivers build config 00:01:16.733 net/nfb: not in enabled drivers build config 00:01:16.733 net/nfp: not in enabled drivers build config 00:01:16.733 net/ngbe: not in enabled drivers build config 00:01:16.733 net/null: not in enabled drivers build config 00:01:16.733 net/octeontx: not in enabled drivers build config 00:01:16.733 net/octeon_ep: not in enabled drivers build config 00:01:16.733 net/pcap: not in enabled drivers build config 00:01:16.733 net/pfe: not in enabled drivers build config 00:01:16.733 net/qede: not in enabled drivers build config 00:01:16.733 net/ring: not in enabled drivers build config 00:01:16.733 net/sfc: not in enabled drivers build config 00:01:16.733 net/softnic: not in enabled drivers build config 00:01:16.733 net/tap: not in enabled drivers build config 00:01:16.733 net/thunderx: not in enabled drivers build config 00:01:16.733 net/txgbe: not in enabled drivers build config 00:01:16.733 net/vdev_netvsc: not in enabled drivers build config 00:01:16.733 net/vhost: not in enabled drivers build config 00:01:16.733 net/virtio: not in enabled drivers build config 00:01:16.733 net/vmxnet3: not in enabled drivers build config 00:01:16.733 raw/*: missing internal dependency, "rawdev" 00:01:16.733 crypto/armv8: not in enabled drivers build config 00:01:16.733 crypto/bcmfs: not in enabled drivers build config 00:01:16.733 crypto/caam_jr: not in enabled drivers build config 00:01:16.733 crypto/ccp: not in enabled drivers build config 00:01:16.733 crypto/cnxk: not in enabled drivers build config 00:01:16.733 crypto/dpaa_sec: not in enabled drivers build config 00:01:16.733 crypto/dpaa2_sec: not in enabled drivers build config 00:01:16.733 crypto/ipsec_mb: not in enabled drivers build config 00:01:16.733 crypto/mlx5: not in enabled drivers build config 00:01:16.733 crypto/mvsam: not in enabled drivers build config 00:01:16.733 crypto/nitrox: not in enabled drivers build config 00:01:16.733 crypto/null: not in enabled drivers build config 00:01:16.733 crypto/octeontx: not in enabled drivers build config 00:01:16.733 crypto/openssl: not in enabled drivers build config 00:01:16.733 crypto/scheduler: not in enabled drivers build config 00:01:16.733 crypto/uadk: not in enabled drivers build config 00:01:16.733 crypto/virtio: not in enabled drivers build config 00:01:16.733 compress/isal: not in enabled drivers build config 00:01:16.733 compress/mlx5: not in enabled drivers build config 00:01:16.733 compress/octeontx: not in enabled drivers build config 00:01:16.733 compress/zlib: not in enabled drivers build config 00:01:16.733 regex/*: missing internal dependency, "regexdev" 00:01:16.733 ml/*: missing internal dependency, "mldev" 00:01:16.733 vdpa/ifc: not in enabled drivers build config 00:01:16.733 vdpa/mlx5: not in enabled drivers build config 00:01:16.733 vdpa/nfp: not in enabled drivers build config 00:01:16.733 vdpa/sfc: not in enabled drivers build config 00:01:16.733 event/*: missing internal dependency, "eventdev" 00:01:16.733 baseband/*: missing internal dependency, "bbdev" 00:01:16.733 gpu/*: missing internal dependency, "gpudev" 00:01:16.733 00:01:16.733 00:01:16.990 Build targets in project: 85 00:01:16.990 00:01:16.990 DPDK 23.11.0 00:01:16.990 00:01:16.990 User defined options 00:01:16.991 buildtype : debug 00:01:16.991 default_library : shared 00:01:16.991 libdir : lib 00:01:16.991 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:16.991 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:16.991 c_link_args : 00:01:16.991 cpu_instruction_set: native 00:01:16.991 disable_apps : test-fib,test-sad,test,test-regex,test-security-perf,test-bbdev,dumpcap,test-crypto-perf,test-flow-perf,test-gpudev,test-cmdline,test-dma-perf,test-eventdev,test-pipeline,test-acl,proc-info,test-compress-perf,graph,test-pmd,test-mldev,pdump 00:01:16.991 disable_libs : bbdev,latencystats,member,gpudev,mldev,pipeline,lpm,efd,regexdev,sched,node,dispatcher,table,bpf,port,gro,fib,cfgfile,ip_frag,gso,rawdev,ipsec,pdcp,rib,acl,metrics,graph,pcapng,jobstats,eventdev,stack,bitratestats,distributor,pdump 00:01:16.991 enable_docs : false 00:01:16.991 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:16.991 enable_kmods : false 00:01:16.991 tests : false 00:01:16.991 00:01:16.991 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:17.565 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:17.565 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:17.565 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:17.565 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:17.565 [4/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:17.565 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:17.565 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:17.565 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:17.565 [8/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:17.565 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:17.565 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:17.565 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:17.565 [12/265] Linking static target lib/librte_kvargs.a 00:01:17.565 [13/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:17.565 [14/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:17.565 [15/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:17.565 [16/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:17.565 [17/265] Linking static target lib/librte_log.a 00:01:17.565 [18/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:17.833 [19/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:17.833 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:17.833 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:18.418 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.418 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:18.418 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:18.418 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:18.418 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:18.418 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:18.418 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:18.418 [29/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:18.418 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:18.418 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:18.418 [32/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:18.418 [33/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:18.418 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:18.418 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:18.418 [36/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:18.418 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:18.418 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:18.418 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:18.418 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:18.418 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:18.418 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:18.418 [43/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:18.418 [44/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:18.418 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:18.418 [46/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:18.677 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:18.677 [48/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:18.677 [49/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:18.677 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:18.677 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:18.677 [52/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:18.677 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:18.677 [54/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:18.677 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:18.677 [56/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:18.677 [57/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:18.677 [58/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:18.677 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:18.677 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:18.677 [61/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:18.677 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:18.677 [63/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:18.677 [64/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:18.677 [65/265] Linking static target lib/librte_telemetry.a 00:01:18.677 [66/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:18.677 [67/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.945 [68/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:18.945 [69/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:18.945 [70/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:18.945 [71/265] Linking target lib/librte_log.so.24.0 00:01:18.945 [72/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:18.945 [73/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:18.945 [74/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:18.945 [75/265] Linking static target lib/librte_pci.a 00:01:18.945 [76/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:18.945 [77/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:18.945 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:18.945 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:18.945 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:18.945 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:19.203 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:19.203 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:19.203 [84/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:19.204 [85/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:19.204 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:19.204 [87/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:19.204 [88/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:19.204 [89/265] Linking target lib/librte_kvargs.so.24.0 00:01:19.464 [90/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:19.464 [91/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:19.464 [92/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.464 [93/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:19.464 [94/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:19.464 [95/265] Linking static target lib/librte_ring.a 00:01:19.464 [96/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:19.464 [97/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:19.464 [98/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:19.464 [99/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:19.464 [100/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:19.464 [101/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:19.464 [102/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:19.464 [103/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:19.464 [104/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:19.464 [105/265] Linking static target lib/librte_eal.a 00:01:19.464 [106/265] Linking static target lib/librte_meter.a 00:01:19.464 [107/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:19.724 [108/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:19.724 [109/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:19.724 [110/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:19.724 [111/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:19.724 [112/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:19.724 [113/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:19.724 [114/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:19.724 [115/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:19.724 [116/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:19.724 [117/265] Linking static target lib/librte_rcu.a 00:01:19.724 [118/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:19.724 [119/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:19.724 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:19.724 [121/265] Linking static target lib/librte_mempool.a 00:01:19.724 [122/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:19.724 [123/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:19.724 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:19.724 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:19.985 [126/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.985 [127/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:19.985 [128/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:19.985 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:19.985 [130/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:19.985 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:19.985 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:19.985 [133/265] Linking target lib/librte_telemetry.so.24.0 00:01:19.985 [134/265] Linking static target lib/librte_cmdline.a 00:01:19.985 [135/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:19.985 [136/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:19.985 [137/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.985 [138/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.985 [139/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:20.246 [140/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:20.246 [141/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:20.246 [142/265] Linking static target lib/librte_timer.a 00:01:20.246 [143/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:20.246 [144/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:20.246 [145/265] Linking static target lib/librte_net.a 00:01:20.246 [146/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:20.246 [147/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:20.246 [148/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:20.246 [149/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:20.246 [150/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.246 [151/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:20.505 [152/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:20.505 [153/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:20.505 [154/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:20.505 [155/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:20.505 [156/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.505 [157/265] Linking static target lib/librte_dmadev.a 00:01:20.505 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:20.765 [159/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:20.765 [160/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:20.765 [161/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.765 [162/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:20.765 [163/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.765 [164/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:20.765 [165/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:20.765 [166/265] Linking static target lib/librte_hash.a 00:01:20.765 [167/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:20.765 [168/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:20.765 [169/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:20.765 [170/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:20.765 [171/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:20.765 [172/265] Linking static target lib/librte_compressdev.a 00:01:20.765 [173/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:20.765 [174/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:20.765 [175/265] Linking static target lib/librte_power.a 00:01:21.024 [176/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:21.024 [177/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:21.024 [178/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.024 [179/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.024 [180/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:21.024 [181/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:21.024 [182/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:21.024 [183/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:21.024 [184/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:21.024 [185/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:21.024 [186/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:21.025 [187/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:21.025 [188/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:21.025 [189/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:21.283 [190/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:21.283 [191/265] Linking static target lib/librte_reorder.a 00:01:21.283 [192/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.283 [193/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.283 [194/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:21.283 [195/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:21.283 [196/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:21.283 [197/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:21.283 [198/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:21.283 [199/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:21.283 [200/265] Linking static target lib/librte_mbuf.a 00:01:21.283 [201/265] Linking static target drivers/librte_bus_vdev.a 00:01:21.283 [202/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.283 [203/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:21.283 [204/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:21.541 [205/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:21.542 [206/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:21.542 [207/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:21.542 [208/265] Linking static target drivers/librte_bus_pci.a 00:01:21.542 [209/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:21.542 [210/265] Linking static target lib/librte_security.a 00:01:21.542 [211/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:21.542 [212/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:21.542 [213/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:21.542 [214/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.542 [215/265] Linking static target drivers/librte_mempool_ring.a 00:01:21.542 [216/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.800 [217/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:21.800 [218/265] Linking static target lib/librte_cryptodev.a 00:01:21.800 [219/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.800 [220/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:21.800 [221/265] Linking static target lib/librte_ethdev.a 00:01:21.800 [222/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.800 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.738 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.117 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:26.018 [226/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.018 [227/265] Linking target lib/librte_eal.so.24.0 00:01:26.018 [228/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.018 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:26.018 [230/265] Linking target lib/librte_ring.so.24.0 00:01:26.018 [231/265] Linking target lib/librte_pci.so.24.0 00:01:26.018 [232/265] Linking target lib/librte_dmadev.so.24.0 00:01:26.018 [233/265] Linking target lib/librte_timer.so.24.0 00:01:26.018 [234/265] Linking target lib/librte_meter.so.24.0 00:01:26.018 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:26.018 [236/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:26.018 [237/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:26.018 [238/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:26.018 [239/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:26.018 [240/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:26.018 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:26.278 [242/265] Linking target lib/librte_mempool.so.24.0 00:01:26.278 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:26.278 [244/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:26.278 [245/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:26.278 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:26.278 [247/265] Linking target lib/librte_mbuf.so.24.0 00:01:26.536 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:26.536 [249/265] Linking target lib/librte_reorder.so.24.0 00:01:26.536 [250/265] Linking target lib/librte_compressdev.so.24.0 00:01:26.536 [251/265] Linking target lib/librte_net.so.24.0 00:01:26.536 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:01:26.536 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:26.536 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:26.536 [255/265] Linking target lib/librte_hash.so.24.0 00:01:26.536 [256/265] Linking target lib/librte_security.so.24.0 00:01:26.536 [257/265] Linking target lib/librte_cmdline.so.24.0 00:01:26.536 [258/265] Linking target lib/librte_ethdev.so.24.0 00:01:26.796 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:26.796 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:26.796 [261/265] Linking target lib/librte_power.so.24.0 00:01:30.085 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:30.085 [263/265] Linking static target lib/librte_vhost.a 00:01:30.653 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.653 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:30.653 INFO: autodetecting backend as ninja 00:01:30.653 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:01:31.590 CC lib/log/log.o 00:01:31.590 CC lib/log/log_flags.o 00:01:31.590 CC lib/log/log_deprecated.o 00:01:31.590 CC lib/ut/ut.o 00:01:31.590 CC lib/ut_mock/mock.o 00:01:31.849 LIB libspdk_ut_mock.a 00:01:31.849 LIB libspdk_log.a 00:01:31.849 SO libspdk_ut_mock.so.5.0 00:01:31.849 LIB libspdk_ut.a 00:01:31.849 SO libspdk_log.so.6.1 00:01:31.849 SO libspdk_ut.so.1.0 00:01:31.849 SYMLINK libspdk_ut_mock.so 00:01:31.849 SYMLINK libspdk_ut.so 00:01:31.849 SYMLINK libspdk_log.so 00:01:31.849 CC lib/dma/dma.o 00:01:31.849 CC lib/util/base64.o 00:01:31.849 CC lib/util/bit_array.o 00:01:31.849 CXX lib/trace_parser/trace.o 00:01:31.849 CC lib/util/cpuset.o 00:01:31.849 CC lib/util/crc16.o 00:01:31.849 CC lib/util/crc32.o 00:01:31.849 CC lib/util/crc32c.o 00:01:31.849 CC lib/ioat/ioat.o 00:01:31.849 CC lib/util/crc32_ieee.o 00:01:31.849 CC lib/util/crc64.o 00:01:31.849 CC lib/util/dif.o 00:01:31.849 CC lib/util/fd.o 00:01:31.849 CC lib/util/file.o 00:01:31.849 CC lib/util/hexlify.o 00:01:31.849 CC lib/util/iov.o 00:01:31.849 CC lib/util/math.o 00:01:31.849 CC lib/util/pipe.o 00:01:31.849 CC lib/util/strerror_tls.o 00:01:31.849 CC lib/util/string.o 00:01:31.849 CC lib/util/uuid.o 00:01:31.849 CC lib/util/fd_group.o 00:01:31.849 CC lib/util/xor.o 00:01:31.849 CC lib/util/zipf.o 00:01:32.107 CC lib/vfio_user/host/vfio_user_pci.o 00:01:32.107 CC lib/vfio_user/host/vfio_user.o 00:01:32.107 LIB libspdk_dma.a 00:01:32.107 SO libspdk_dma.so.3.0 00:01:32.107 SYMLINK libspdk_dma.so 00:01:32.366 LIB libspdk_vfio_user.a 00:01:32.366 LIB libspdk_ioat.a 00:01:32.366 SO libspdk_vfio_user.so.4.0 00:01:32.366 SO libspdk_ioat.so.6.0 00:01:32.366 SYMLINK libspdk_vfio_user.so 00:01:32.366 SYMLINK libspdk_ioat.so 00:01:32.366 LIB libspdk_util.a 00:01:32.624 SO libspdk_util.so.8.0 00:01:32.624 SYMLINK libspdk_util.so 00:01:32.624 CC lib/json/json_parse.o 00:01:32.624 CC lib/idxd/idxd.o 00:01:32.624 CC lib/json/json_util.o 00:01:32.624 CC lib/idxd/idxd_user.o 00:01:32.624 CC lib/conf/conf.o 00:01:32.624 CC lib/json/json_write.o 00:01:32.624 CC lib/rdma/common.o 00:01:32.624 CC lib/idxd/idxd_kernel.o 00:01:32.624 CC lib/rdma/rdma_verbs.o 00:01:32.624 CC lib/env_dpdk/env.o 00:01:32.624 CC lib/env_dpdk/memory.o 00:01:32.624 CC lib/vmd/vmd.o 00:01:32.624 CC lib/vmd/led.o 00:01:32.624 CC lib/env_dpdk/pci.o 00:01:32.882 CC lib/env_dpdk/init.o 00:01:32.882 CC lib/env_dpdk/threads.o 00:01:32.882 CC lib/env_dpdk/pci_ioat.o 00:01:32.882 CC lib/env_dpdk/pci_virtio.o 00:01:32.882 CC lib/env_dpdk/pci_vmd.o 00:01:32.882 CC lib/env_dpdk/pci_idxd.o 00:01:32.882 CC lib/env_dpdk/pci_event.o 00:01:32.882 CC lib/env_dpdk/sigbus_handler.o 00:01:32.882 CC lib/env_dpdk/pci_dpdk.o 00:01:32.882 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:32.882 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:32.882 LIB libspdk_trace_parser.a 00:01:32.882 SO libspdk_trace_parser.so.4.0 00:01:32.882 LIB libspdk_conf.a 00:01:33.140 SYMLINK libspdk_trace_parser.so 00:01:33.140 SO libspdk_conf.so.5.0 00:01:33.140 LIB libspdk_rdma.a 00:01:33.140 SYMLINK libspdk_conf.so 00:01:33.140 LIB libspdk_json.a 00:01:33.140 SO libspdk_rdma.so.5.0 00:01:33.140 SO libspdk_json.so.5.1 00:01:33.140 SYMLINK libspdk_rdma.so 00:01:33.140 SYMLINK libspdk_json.so 00:01:33.140 CC lib/jsonrpc/jsonrpc_server.o 00:01:33.140 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:33.140 CC lib/jsonrpc/jsonrpc_client.o 00:01:33.140 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:33.399 LIB libspdk_idxd.a 00:01:33.399 SO libspdk_idxd.so.11.0 00:01:33.399 SYMLINK libspdk_idxd.so 00:01:33.399 LIB libspdk_vmd.a 00:01:33.399 SO libspdk_vmd.so.5.0 00:01:33.399 SYMLINK libspdk_vmd.so 00:01:33.658 LIB libspdk_jsonrpc.a 00:01:33.658 SO libspdk_jsonrpc.so.5.1 00:01:33.658 SYMLINK libspdk_jsonrpc.so 00:01:33.658 CC lib/rpc/rpc.o 00:01:33.916 LIB libspdk_rpc.a 00:01:33.916 SO libspdk_rpc.so.5.0 00:01:33.916 SYMLINK libspdk_rpc.so 00:01:34.175 CC lib/trace/trace.o 00:01:34.175 CC lib/trace/trace_flags.o 00:01:34.175 CC lib/notify/notify.o 00:01:34.175 CC lib/trace/trace_rpc.o 00:01:34.175 CC lib/notify/notify_rpc.o 00:01:34.175 CC lib/sock/sock.o 00:01:34.175 CC lib/sock/sock_rpc.o 00:01:34.175 LIB libspdk_notify.a 00:01:34.175 SO libspdk_notify.so.5.0 00:01:34.175 LIB libspdk_trace.a 00:01:34.433 SYMLINK libspdk_notify.so 00:01:34.433 SO libspdk_trace.so.9.0 00:01:34.433 SYMLINK libspdk_trace.so 00:01:34.433 LIB libspdk_sock.a 00:01:34.433 CC lib/thread/thread.o 00:01:34.433 CC lib/thread/iobuf.o 00:01:34.433 SO libspdk_sock.so.8.0 00:01:34.433 SYMLINK libspdk_sock.so 00:01:34.692 CC lib/nvme/nvme_ctrlr_cmd.o 00:01:34.692 CC lib/nvme/nvme_ctrlr.o 00:01:34.692 CC lib/nvme/nvme_fabric.o 00:01:34.692 CC lib/nvme/nvme_ns_cmd.o 00:01:34.692 CC lib/nvme/nvme_ns.o 00:01:34.692 CC lib/nvme/nvme_pcie_common.o 00:01:34.692 CC lib/nvme/nvme_pcie.o 00:01:34.692 CC lib/nvme/nvme_qpair.o 00:01:34.692 CC lib/nvme/nvme.o 00:01:34.692 CC lib/nvme/nvme_quirks.o 00:01:34.692 CC lib/nvme/nvme_transport.o 00:01:34.692 CC lib/nvme/nvme_discovery.o 00:01:34.692 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:01:34.692 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:01:34.692 CC lib/nvme/nvme_tcp.o 00:01:34.692 CC lib/nvme/nvme_opal.o 00:01:34.692 CC lib/nvme/nvme_io_msg.o 00:01:34.692 CC lib/nvme/nvme_poll_group.o 00:01:34.692 CC lib/nvme/nvme_zns.o 00:01:34.692 CC lib/nvme/nvme_cuse.o 00:01:34.692 CC lib/nvme/nvme_vfio_user.o 00:01:34.692 CC lib/nvme/nvme_rdma.o 00:01:34.951 LIB libspdk_env_dpdk.a 00:01:34.951 SO libspdk_env_dpdk.so.13.0 00:01:34.951 SYMLINK libspdk_env_dpdk.so 00:01:36.326 LIB libspdk_thread.a 00:01:36.326 SO libspdk_thread.so.9.0 00:01:36.326 SYMLINK libspdk_thread.so 00:01:36.327 CC lib/init/json_config.o 00:01:36.327 CC lib/accel/accel.o 00:01:36.327 CC lib/blob/blobstore.o 00:01:36.327 CC lib/virtio/virtio.o 00:01:36.327 CC lib/init/subsystem.o 00:01:36.327 CC lib/accel/accel_rpc.o 00:01:36.327 CC lib/blob/request.o 00:01:36.327 CC lib/virtio/virtio_vhost_user.o 00:01:36.327 CC lib/accel/accel_sw.o 00:01:36.327 CC lib/init/subsystem_rpc.o 00:01:36.327 CC lib/blob/zeroes.o 00:01:36.327 CC lib/virtio/virtio_vfio_user.o 00:01:36.327 CC lib/init/rpc.o 00:01:36.327 CC lib/blob/blob_bs_dev.o 00:01:36.327 CC lib/virtio/virtio_pci.o 00:01:36.585 LIB libspdk_init.a 00:01:36.585 SO libspdk_init.so.4.0 00:01:36.843 SYMLINK libspdk_init.so 00:01:36.843 LIB libspdk_virtio.a 00:01:36.843 SO libspdk_virtio.so.6.0 00:01:36.843 SYMLINK libspdk_virtio.so 00:01:36.843 CC lib/event/app.o 00:01:36.843 CC lib/event/reactor.o 00:01:36.843 CC lib/event/log_rpc.o 00:01:36.843 CC lib/event/app_rpc.o 00:01:36.843 CC lib/event/scheduler_static.o 00:01:37.102 LIB libspdk_nvme.a 00:01:37.102 SO libspdk_nvme.so.12.0 00:01:37.360 LIB libspdk_event.a 00:01:37.360 SO libspdk_event.so.12.0 00:01:37.360 SYMLINK libspdk_nvme.so 00:01:37.360 SYMLINK libspdk_event.so 00:01:37.360 LIB libspdk_accel.a 00:01:37.360 SO libspdk_accel.so.14.0 00:01:37.619 SYMLINK libspdk_accel.so 00:01:37.619 CC lib/bdev/bdev.o 00:01:37.619 CC lib/bdev/bdev_rpc.o 00:01:37.619 CC lib/bdev/bdev_zone.o 00:01:37.619 CC lib/bdev/scsi_nvme.o 00:01:37.619 CC lib/bdev/part.o 00:01:39.526 LIB libspdk_blob.a 00:01:39.526 SO libspdk_blob.so.10.1 00:01:39.526 SYMLINK libspdk_blob.so 00:01:39.526 CC lib/blobfs/blobfs.o 00:01:39.526 CC lib/blobfs/tree.o 00:01:39.526 CC lib/lvol/lvol.o 00:01:40.466 LIB libspdk_blobfs.a 00:01:40.466 LIB libspdk_bdev.a 00:01:40.466 SO libspdk_blobfs.so.9.0 00:01:40.466 LIB libspdk_lvol.a 00:01:40.466 SO libspdk_bdev.so.14.0 00:01:40.466 SO libspdk_lvol.so.9.1 00:01:40.466 SYMLINK libspdk_blobfs.so 00:01:40.466 SYMLINK libspdk_lvol.so 00:01:40.466 SYMLINK libspdk_bdev.so 00:01:40.466 CC lib/nvmf/ctrlr.o 00:01:40.466 CC lib/ublk/ublk.o 00:01:40.466 CC lib/nvmf/ctrlr_discovery.o 00:01:40.467 CC lib/ublk/ublk_rpc.o 00:01:40.467 CC lib/scsi/dev.o 00:01:40.467 CC lib/nbd/nbd.o 00:01:40.467 CC lib/nvmf/ctrlr_bdev.o 00:01:40.467 CC lib/nbd/nbd_rpc.o 00:01:40.467 CC lib/scsi/lun.o 00:01:40.467 CC lib/nvmf/subsystem.o 00:01:40.467 CC lib/scsi/port.o 00:01:40.467 CC lib/nvmf/nvmf.o 00:01:40.467 CC lib/ftl/ftl_core.o 00:01:40.467 CC lib/scsi/scsi.o 00:01:40.467 CC lib/nvmf/nvmf_rpc.o 00:01:40.467 CC lib/ftl/ftl_init.o 00:01:40.467 CC lib/nvmf/transport.o 00:01:40.467 CC lib/scsi/scsi_bdev.o 00:01:40.467 CC lib/nvmf/tcp.o 00:01:40.467 CC lib/scsi/scsi_pr.o 00:01:40.467 CC lib/ftl/ftl_layout.o 00:01:40.467 CC lib/nvmf/rdma.o 00:01:40.467 CC lib/ftl/ftl_debug.o 00:01:40.467 CC lib/scsi/scsi_rpc.o 00:01:40.467 CC lib/ftl/ftl_sb.o 00:01:40.467 CC lib/scsi/task.o 00:01:40.467 CC lib/ftl/ftl_io.o 00:01:40.467 CC lib/ftl/ftl_l2p.o 00:01:40.467 CC lib/ftl/ftl_l2p_flat.o 00:01:40.467 CC lib/ftl/ftl_nv_cache.o 00:01:40.467 CC lib/ftl/ftl_band_ops.o 00:01:40.467 CC lib/ftl/ftl_band.o 00:01:40.467 CC lib/ftl/ftl_writer.o 00:01:40.467 CC lib/ftl/ftl_rq.o 00:01:40.467 CC lib/ftl/ftl_reloc.o 00:01:40.467 CC lib/ftl/ftl_l2p_cache.o 00:01:40.467 CC lib/ftl/ftl_p2l.o 00:01:40.467 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:01:40.467 CC lib/ftl/mngt/ftl_mngt.o 00:01:40.467 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:01:40.467 CC lib/ftl/mngt/ftl_mngt_startup.o 00:01:40.467 CC lib/ftl/mngt/ftl_mngt_md.o 00:01:40.467 CC lib/ftl/mngt/ftl_mngt_misc.o 00:01:40.467 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:01:40.467 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:01:40.467 CC lib/ftl/mngt/ftl_mngt_band.o 00:01:40.467 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:01:40.467 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:01:40.728 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:01:40.728 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:01:40.728 CC lib/ftl/utils/ftl_conf.o 00:01:40.728 CC lib/ftl/utils/ftl_md.o 00:01:40.992 CC lib/ftl/utils/ftl_mempool.o 00:01:40.992 CC lib/ftl/utils/ftl_bitmap.o 00:01:40.992 CC lib/ftl/utils/ftl_property.o 00:01:40.992 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:01:40.992 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:01:40.992 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:01:40.992 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:01:40.992 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:01:40.992 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:01:40.992 CC lib/ftl/upgrade/ftl_sb_v3.o 00:01:40.992 CC lib/ftl/upgrade/ftl_sb_v5.o 00:01:40.992 CC lib/ftl/nvc/ftl_nvc_dev.o 00:01:40.992 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:01:40.992 CC lib/ftl/base/ftl_base_dev.o 00:01:40.992 CC lib/ftl/base/ftl_base_bdev.o 00:01:40.992 CC lib/ftl/ftl_trace.o 00:01:41.250 LIB libspdk_nbd.a 00:01:41.250 SO libspdk_nbd.so.6.0 00:01:41.250 SYMLINK libspdk_nbd.so 00:01:41.250 LIB libspdk_scsi.a 00:01:41.250 SO libspdk_scsi.so.8.0 00:01:41.509 SYMLINK libspdk_scsi.so 00:01:41.509 LIB libspdk_ublk.a 00:01:41.509 SO libspdk_ublk.so.2.0 00:01:41.509 SYMLINK libspdk_ublk.so 00:01:41.509 CC lib/vhost/vhost.o 00:01:41.509 CC lib/iscsi/conn.o 00:01:41.509 CC lib/iscsi/init_grp.o 00:01:41.509 CC lib/vhost/vhost_rpc.o 00:01:41.509 CC lib/iscsi/iscsi.o 00:01:41.509 CC lib/vhost/vhost_scsi.o 00:01:41.509 CC lib/iscsi/md5.o 00:01:41.509 CC lib/vhost/vhost_blk.o 00:01:41.509 CC lib/iscsi/param.o 00:01:41.509 CC lib/vhost/rte_vhost_user.o 00:01:41.509 CC lib/iscsi/portal_grp.o 00:01:41.509 CC lib/iscsi/tgt_node.o 00:01:41.509 CC lib/iscsi/iscsi_subsystem.o 00:01:41.509 CC lib/iscsi/iscsi_rpc.o 00:01:41.509 CC lib/iscsi/task.o 00:01:41.768 LIB libspdk_ftl.a 00:01:42.027 SO libspdk_ftl.so.8.0 00:01:42.286 SYMLINK libspdk_ftl.so 00:01:42.853 LIB libspdk_vhost.a 00:01:42.853 SO libspdk_vhost.so.7.1 00:01:42.853 SYMLINK libspdk_vhost.so 00:01:42.853 LIB libspdk_iscsi.a 00:01:43.111 LIB libspdk_nvmf.a 00:01:43.111 SO libspdk_iscsi.so.7.0 00:01:43.111 SO libspdk_nvmf.so.17.0 00:01:43.111 SYMLINK libspdk_iscsi.so 00:01:43.111 SYMLINK libspdk_nvmf.so 00:01:43.369 CC module/env_dpdk/env_dpdk_rpc.o 00:01:43.369 CC module/blob/bdev/blob_bdev.o 00:01:43.369 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:01:43.369 CC module/scheduler/gscheduler/gscheduler.o 00:01:43.369 CC module/sock/posix/posix.o 00:01:43.369 CC module/accel/iaa/accel_iaa.o 00:01:43.369 CC module/accel/error/accel_error.o 00:01:43.369 CC module/accel/iaa/accel_iaa_rpc.o 00:01:43.369 CC module/accel/error/accel_error_rpc.o 00:01:43.369 CC module/accel/ioat/accel_ioat.o 00:01:43.369 CC module/scheduler/dynamic/scheduler_dynamic.o 00:01:43.369 CC module/accel/dsa/accel_dsa.o 00:01:43.369 CC module/accel/ioat/accel_ioat_rpc.o 00:01:43.369 CC module/accel/dsa/accel_dsa_rpc.o 00:01:43.369 LIB libspdk_env_dpdk_rpc.a 00:01:43.627 SO libspdk_env_dpdk_rpc.so.5.0 00:01:43.627 SYMLINK libspdk_env_dpdk_rpc.so 00:01:43.627 LIB libspdk_scheduler_gscheduler.a 00:01:43.627 LIB libspdk_scheduler_dpdk_governor.a 00:01:43.627 SO libspdk_scheduler_gscheduler.so.3.0 00:01:43.627 SO libspdk_scheduler_dpdk_governor.so.3.0 00:01:43.627 LIB libspdk_accel_error.a 00:01:43.627 LIB libspdk_accel_ioat.a 00:01:43.627 LIB libspdk_scheduler_dynamic.a 00:01:43.627 LIB libspdk_accel_iaa.a 00:01:43.627 SO libspdk_accel_error.so.1.0 00:01:43.627 SYMLINK libspdk_scheduler_gscheduler.so 00:01:43.627 SO libspdk_accel_ioat.so.5.0 00:01:43.627 SYMLINK libspdk_scheduler_dpdk_governor.so 00:01:43.627 SO libspdk_scheduler_dynamic.so.3.0 00:01:43.627 SO libspdk_accel_iaa.so.2.0 00:01:43.627 LIB libspdk_accel_dsa.a 00:01:43.627 SYMLINK libspdk_accel_error.so 00:01:43.627 SYMLINK libspdk_accel_ioat.so 00:01:43.627 SYMLINK libspdk_scheduler_dynamic.so 00:01:43.627 LIB libspdk_blob_bdev.a 00:01:43.627 SO libspdk_accel_dsa.so.4.0 00:01:43.627 SYMLINK libspdk_accel_iaa.so 00:01:43.627 SO libspdk_blob_bdev.so.10.1 00:01:43.627 SYMLINK libspdk_accel_dsa.so 00:01:43.885 SYMLINK libspdk_blob_bdev.so 00:01:43.885 CC module/bdev/delay/vbdev_delay.o 00:01:43.885 CC module/bdev/nvme/bdev_nvme.o 00:01:43.885 CC module/bdev/delay/vbdev_delay_rpc.o 00:01:43.886 CC module/bdev/passthru/vbdev_passthru.o 00:01:43.886 CC module/bdev/nvme/bdev_nvme_rpc.o 00:01:43.886 CC module/bdev/zone_block/vbdev_zone_block.o 00:01:43.886 CC module/bdev/nvme/nvme_rpc.o 00:01:43.886 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:01:43.886 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:01:43.886 CC module/bdev/malloc/bdev_malloc.o 00:01:43.886 CC module/bdev/aio/bdev_aio.o 00:01:43.886 CC module/bdev/nvme/bdev_mdns_client.o 00:01:43.886 CC module/bdev/malloc/bdev_malloc_rpc.o 00:01:43.886 CC module/bdev/split/vbdev_split.o 00:01:43.886 CC module/bdev/nvme/vbdev_opal.o 00:01:43.886 CC module/bdev/virtio/bdev_virtio_scsi.o 00:01:43.886 CC module/bdev/nvme/vbdev_opal_rpc.o 00:01:43.886 CC module/bdev/aio/bdev_aio_rpc.o 00:01:43.886 CC module/bdev/virtio/bdev_virtio_blk.o 00:01:43.886 CC module/bdev/error/vbdev_error.o 00:01:43.886 CC module/bdev/error/vbdev_error_rpc.o 00:01:43.886 CC module/bdev/iscsi/bdev_iscsi.o 00:01:43.886 CC module/bdev/raid/bdev_raid.o 00:01:43.886 CC module/bdev/split/vbdev_split_rpc.o 00:01:43.886 CC module/bdev/ftl/bdev_ftl.o 00:01:43.886 CC module/bdev/null/bdev_null.o 00:01:43.886 CC module/bdev/virtio/bdev_virtio_rpc.o 00:01:43.886 CC module/bdev/gpt/gpt.o 00:01:43.886 CC module/bdev/null/bdev_null_rpc.o 00:01:43.886 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:01:43.886 CC module/bdev/raid/bdev_raid_rpc.o 00:01:43.886 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:01:43.886 CC module/bdev/gpt/vbdev_gpt.o 00:01:43.886 CC module/bdev/ftl/bdev_ftl_rpc.o 00:01:43.886 CC module/bdev/lvol/vbdev_lvol.o 00:01:43.886 CC module/bdev/raid/bdev_raid_sb.o 00:01:43.886 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:01:43.886 CC module/bdev/raid/raid0.o 00:01:43.886 CC module/bdev/raid/raid1.o 00:01:43.886 CC module/blobfs/bdev/blobfs_bdev.o 00:01:43.886 CC module/bdev/raid/concat.o 00:01:43.886 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:01:44.144 LIB libspdk_blobfs_bdev.a 00:01:44.402 LIB libspdk_sock_posix.a 00:01:44.402 SO libspdk_blobfs_bdev.so.5.0 00:01:44.403 SO libspdk_sock_posix.so.5.0 00:01:44.403 LIB libspdk_bdev_split.a 00:01:44.403 SO libspdk_bdev_split.so.5.0 00:01:44.403 SYMLINK libspdk_blobfs_bdev.so 00:01:44.403 LIB libspdk_bdev_iscsi.a 00:01:44.403 LIB libspdk_bdev_gpt.a 00:01:44.403 SYMLINK libspdk_sock_posix.so 00:01:44.403 SO libspdk_bdev_iscsi.so.5.0 00:01:44.403 SO libspdk_bdev_gpt.so.5.0 00:01:44.403 SYMLINK libspdk_bdev_split.so 00:01:44.403 LIB libspdk_bdev_ftl.a 00:01:44.403 LIB libspdk_bdev_null.a 00:01:44.403 LIB libspdk_bdev_error.a 00:01:44.403 SO libspdk_bdev_ftl.so.5.0 00:01:44.403 SO libspdk_bdev_null.so.5.0 00:01:44.403 SYMLINK libspdk_bdev_iscsi.so 00:01:44.403 SYMLINK libspdk_bdev_gpt.so 00:01:44.403 SO libspdk_bdev_error.so.5.0 00:01:44.403 LIB libspdk_bdev_passthru.a 00:01:44.403 SO libspdk_bdev_passthru.so.5.0 00:01:44.403 LIB libspdk_bdev_aio.a 00:01:44.403 SYMLINK libspdk_bdev_ftl.so 00:01:44.403 LIB libspdk_bdev_delay.a 00:01:44.403 SYMLINK libspdk_bdev_null.so 00:01:44.403 LIB libspdk_bdev_zone_block.a 00:01:44.403 SYMLINK libspdk_bdev_error.so 00:01:44.403 SO libspdk_bdev_aio.so.5.0 00:01:44.403 SO libspdk_bdev_delay.so.5.0 00:01:44.403 SO libspdk_bdev_zone_block.so.5.0 00:01:44.403 SYMLINK libspdk_bdev_passthru.so 00:01:44.403 LIB libspdk_bdev_malloc.a 00:01:44.660 SO libspdk_bdev_malloc.so.5.0 00:01:44.660 SYMLINK libspdk_bdev_aio.so 00:01:44.660 SYMLINK libspdk_bdev_delay.so 00:01:44.660 SYMLINK libspdk_bdev_zone_block.so 00:01:44.660 LIB libspdk_bdev_lvol.a 00:01:44.660 SYMLINK libspdk_bdev_malloc.so 00:01:44.660 SO libspdk_bdev_lvol.so.5.0 00:01:44.660 SYMLINK libspdk_bdev_lvol.so 00:01:44.660 LIB libspdk_bdev_virtio.a 00:01:44.660 SO libspdk_bdev_virtio.so.5.0 00:01:44.660 SYMLINK libspdk_bdev_virtio.so 00:01:44.921 LIB libspdk_bdev_raid.a 00:01:45.187 SO libspdk_bdev_raid.so.5.0 00:01:45.187 SYMLINK libspdk_bdev_raid.so 00:01:46.155 LIB libspdk_bdev_nvme.a 00:01:46.413 SO libspdk_bdev_nvme.so.6.0 00:01:46.413 SYMLINK libspdk_bdev_nvme.so 00:01:46.672 CC module/event/subsystems/scheduler/scheduler.o 00:01:46.672 CC module/event/subsystems/iobuf/iobuf.o 00:01:46.672 CC module/event/subsystems/sock/sock.o 00:01:46.672 CC module/event/subsystems/vmd/vmd.o 00:01:46.672 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:01:46.672 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:01:46.672 CC module/event/subsystems/vmd/vmd_rpc.o 00:01:46.672 LIB libspdk_event_sock.a 00:01:46.672 LIB libspdk_event_vhost_blk.a 00:01:46.672 LIB libspdk_event_scheduler.a 00:01:46.672 LIB libspdk_event_vmd.a 00:01:46.672 SO libspdk_event_sock.so.4.0 00:01:46.672 LIB libspdk_event_iobuf.a 00:01:46.672 SO libspdk_event_vhost_blk.so.2.0 00:01:46.672 SO libspdk_event_scheduler.so.3.0 00:01:46.672 SO libspdk_event_vmd.so.5.0 00:01:46.672 SO libspdk_event_iobuf.so.2.0 00:01:46.930 SYMLINK libspdk_event_sock.so 00:01:46.930 SYMLINK libspdk_event_vhost_blk.so 00:01:46.930 SYMLINK libspdk_event_scheduler.so 00:01:46.930 SYMLINK libspdk_event_vmd.so 00:01:46.930 SYMLINK libspdk_event_iobuf.so 00:01:46.930 CC module/event/subsystems/accel/accel.o 00:01:47.189 LIB libspdk_event_accel.a 00:01:47.189 SO libspdk_event_accel.so.5.0 00:01:47.189 SYMLINK libspdk_event_accel.so 00:01:47.189 CC module/event/subsystems/bdev/bdev.o 00:01:47.447 LIB libspdk_event_bdev.a 00:01:47.447 SO libspdk_event_bdev.so.5.0 00:01:47.447 SYMLINK libspdk_event_bdev.so 00:01:47.706 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:01:47.706 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:01:47.706 CC module/event/subsystems/ublk/ublk.o 00:01:47.706 CC module/event/subsystems/scsi/scsi.o 00:01:47.706 CC module/event/subsystems/nbd/nbd.o 00:01:47.706 LIB libspdk_event_ublk.a 00:01:47.706 LIB libspdk_event_nbd.a 00:01:47.706 LIB libspdk_event_scsi.a 00:01:47.706 SO libspdk_event_ublk.so.2.0 00:01:47.706 SO libspdk_event_nbd.so.5.0 00:01:47.706 SO libspdk_event_scsi.so.5.0 00:01:47.964 SYMLINK libspdk_event_nbd.so 00:01:47.964 SYMLINK libspdk_event_ublk.so 00:01:47.964 SYMLINK libspdk_event_scsi.so 00:01:47.964 LIB libspdk_event_nvmf.a 00:01:47.964 SO libspdk_event_nvmf.so.5.0 00:01:47.964 SYMLINK libspdk_event_nvmf.so 00:01:47.964 CC module/event/subsystems/iscsi/iscsi.o 00:01:47.964 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:01:48.223 LIB libspdk_event_vhost_scsi.a 00:01:48.223 SO libspdk_event_vhost_scsi.so.2.0 00:01:48.223 LIB libspdk_event_iscsi.a 00:01:48.223 SO libspdk_event_iscsi.so.5.0 00:01:48.223 SYMLINK libspdk_event_vhost_scsi.so 00:01:48.223 SYMLINK libspdk_event_iscsi.so 00:01:48.223 SO libspdk.so.5.0 00:01:48.223 SYMLINK libspdk.so 00:01:48.485 CXX app/trace/trace.o 00:01:48.485 CC app/spdk_nvme_identify/identify.o 00:01:48.485 CC app/spdk_top/spdk_top.o 00:01:48.485 CC app/spdk_nvme_perf/perf.o 00:01:48.485 CC app/trace_record/trace_record.o 00:01:48.485 CC app/spdk_nvme_discover/discovery_aer.o 00:01:48.485 CC app/spdk_lspci/spdk_lspci.o 00:01:48.485 CC test/rpc_client/rpc_client_test.o 00:01:48.485 TEST_HEADER include/spdk/accel.h 00:01:48.485 TEST_HEADER include/spdk/accel_module.h 00:01:48.485 TEST_HEADER include/spdk/assert.h 00:01:48.485 TEST_HEADER include/spdk/barrier.h 00:01:48.485 TEST_HEADER include/spdk/base64.h 00:01:48.485 TEST_HEADER include/spdk/bdev.h 00:01:48.485 TEST_HEADER include/spdk/bdev_module.h 00:01:48.485 TEST_HEADER include/spdk/bdev_zone.h 00:01:48.485 TEST_HEADER include/spdk/bit_array.h 00:01:48.485 TEST_HEADER include/spdk/bit_pool.h 00:01:48.485 TEST_HEADER include/spdk/blob_bdev.h 00:01:48.485 TEST_HEADER include/spdk/blobfs_bdev.h 00:01:48.485 TEST_HEADER include/spdk/blobfs.h 00:01:48.485 TEST_HEADER include/spdk/blob.h 00:01:48.485 TEST_HEADER include/spdk/conf.h 00:01:48.486 TEST_HEADER include/spdk/config.h 00:01:48.486 TEST_HEADER include/spdk/cpuset.h 00:01:48.486 CC app/spdk_dd/spdk_dd.o 00:01:48.486 TEST_HEADER include/spdk/crc16.h 00:01:48.486 CC app/iscsi_tgt/iscsi_tgt.o 00:01:48.486 TEST_HEADER include/spdk/crc32.h 00:01:48.486 CC app/nvmf_tgt/nvmf_main.o 00:01:48.486 TEST_HEADER include/spdk/crc64.h 00:01:48.486 CC examples/interrupt_tgt/interrupt_tgt.o 00:01:48.486 TEST_HEADER include/spdk/dif.h 00:01:48.486 TEST_HEADER include/spdk/dma.h 00:01:48.486 TEST_HEADER include/spdk/endian.h 00:01:48.486 TEST_HEADER include/spdk/env_dpdk.h 00:01:48.486 TEST_HEADER include/spdk/env.h 00:01:48.486 CC app/vhost/vhost.o 00:01:48.486 TEST_HEADER include/spdk/event.h 00:01:48.486 CC examples/sock/hello_world/hello_sock.o 00:01:48.486 TEST_HEADER include/spdk/fd_group.h 00:01:48.486 CC examples/nvme/reconnect/reconnect.o 00:01:48.486 CC examples/accel/perf/accel_perf.o 00:01:48.486 CC test/app/histogram_perf/histogram_perf.o 00:01:48.486 CC examples/nvme/arbitration/arbitration.o 00:01:48.486 TEST_HEADER include/spdk/fd.h 00:01:48.486 CC examples/nvme/hello_world/hello_world.o 00:01:48.486 CC test/event/event_perf/event_perf.o 00:01:48.486 CC examples/util/zipf/zipf.o 00:01:48.486 CC examples/vmd/led/led.o 00:01:48.486 CC test/nvme/reset/reset.o 00:01:48.486 CC test/nvme/aer/aer.o 00:01:48.486 CC examples/nvme/hotplug/hotplug.o 00:01:48.486 CC app/fio/nvme/fio_plugin.o 00:01:48.486 CC examples/ioat/perf/perf.o 00:01:48.486 CC examples/nvme/nvme_manage/nvme_manage.o 00:01:48.486 CC examples/idxd/perf/perf.o 00:01:48.486 TEST_HEADER include/spdk/file.h 00:01:48.486 CC examples/vmd/lsvmd/lsvmd.o 00:01:48.486 CC examples/ioat/verify/verify.o 00:01:48.486 TEST_HEADER include/spdk/ftl.h 00:01:48.486 TEST_HEADER include/spdk/gpt_spec.h 00:01:48.486 CC test/thread/poller_perf/poller_perf.o 00:01:48.486 TEST_HEADER include/spdk/hexlify.h 00:01:48.486 TEST_HEADER include/spdk/histogram_data.h 00:01:48.486 CC app/spdk_tgt/spdk_tgt.o 00:01:48.486 TEST_HEADER include/spdk/idxd.h 00:01:48.486 TEST_HEADER include/spdk/idxd_spec.h 00:01:48.486 TEST_HEADER include/spdk/init.h 00:01:48.486 TEST_HEADER include/spdk/ioat.h 00:01:48.486 TEST_HEADER include/spdk/ioat_spec.h 00:01:48.486 TEST_HEADER include/spdk/iscsi_spec.h 00:01:48.486 TEST_HEADER include/spdk/json.h 00:01:48.749 TEST_HEADER include/spdk/jsonrpc.h 00:01:48.749 TEST_HEADER include/spdk/likely.h 00:01:48.749 CC test/blobfs/mkfs/mkfs.o 00:01:48.749 TEST_HEADER include/spdk/log.h 00:01:48.749 CC examples/bdev/hello_world/hello_bdev.o 00:01:48.749 CC test/dma/test_dma/test_dma.o 00:01:48.749 CC test/accel/dif/dif.o 00:01:48.749 TEST_HEADER include/spdk/lvol.h 00:01:48.749 CC test/bdev/bdevio/bdevio.o 00:01:48.749 TEST_HEADER include/spdk/memory.h 00:01:48.749 CC examples/blob/cli/blobcli.o 00:01:48.749 TEST_HEADER include/spdk/mmio.h 00:01:48.749 CC examples/thread/thread/thread_ex.o 00:01:48.749 TEST_HEADER include/spdk/nbd.h 00:01:48.749 CC examples/bdev/bdevperf/bdevperf.o 00:01:48.749 TEST_HEADER include/spdk/notify.h 00:01:48.749 CC examples/blob/hello_world/hello_blob.o 00:01:48.749 TEST_HEADER include/spdk/nvme.h 00:01:48.749 TEST_HEADER include/spdk/nvme_intel.h 00:01:48.749 CC examples/nvmf/nvmf/nvmf.o 00:01:48.749 TEST_HEADER include/spdk/nvme_ocssd.h 00:01:48.749 CC test/app/bdev_svc/bdev_svc.o 00:01:48.749 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:01:48.749 TEST_HEADER include/spdk/nvme_spec.h 00:01:48.749 CC test/env/mem_callbacks/mem_callbacks.o 00:01:48.749 TEST_HEADER include/spdk/nvme_zns.h 00:01:48.749 TEST_HEADER include/spdk/nvmf_cmd.h 00:01:48.749 CC test/lvol/esnap/esnap.o 00:01:48.749 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:01:48.749 TEST_HEADER include/spdk/nvmf.h 00:01:48.749 TEST_HEADER include/spdk/nvmf_spec.h 00:01:48.749 TEST_HEADER include/spdk/nvmf_transport.h 00:01:48.749 TEST_HEADER include/spdk/opal.h 00:01:48.749 TEST_HEADER include/spdk/opal_spec.h 00:01:48.749 TEST_HEADER include/spdk/pci_ids.h 00:01:48.749 TEST_HEADER include/spdk/pipe.h 00:01:48.749 TEST_HEADER include/spdk/queue.h 00:01:48.749 TEST_HEADER include/spdk/reduce.h 00:01:48.749 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:01:48.749 TEST_HEADER include/spdk/rpc.h 00:01:48.749 TEST_HEADER include/spdk/scheduler.h 00:01:48.749 TEST_HEADER include/spdk/scsi.h 00:01:48.749 TEST_HEADER include/spdk/scsi_spec.h 00:01:48.749 TEST_HEADER include/spdk/sock.h 00:01:48.749 TEST_HEADER include/spdk/stdinc.h 00:01:48.749 TEST_HEADER include/spdk/string.h 00:01:48.749 TEST_HEADER include/spdk/thread.h 00:01:48.749 TEST_HEADER include/spdk/trace.h 00:01:48.749 TEST_HEADER include/spdk/trace_parser.h 00:01:48.749 TEST_HEADER include/spdk/tree.h 00:01:48.749 TEST_HEADER include/spdk/ublk.h 00:01:48.749 TEST_HEADER include/spdk/util.h 00:01:48.749 TEST_HEADER include/spdk/uuid.h 00:01:48.749 LINK spdk_lspci 00:01:48.749 TEST_HEADER include/spdk/version.h 00:01:48.749 TEST_HEADER include/spdk/vfio_user_pci.h 00:01:48.749 TEST_HEADER include/spdk/vfio_user_spec.h 00:01:48.749 TEST_HEADER include/spdk/vhost.h 00:01:48.749 TEST_HEADER include/spdk/vmd.h 00:01:48.749 TEST_HEADER include/spdk/xor.h 00:01:48.749 TEST_HEADER include/spdk/zipf.h 00:01:48.749 CXX test/cpp_headers/accel.o 00:01:48.749 LINK rpc_client_test 00:01:48.749 LINK lsvmd 00:01:48.749 LINK histogram_perf 00:01:48.749 LINK zipf 00:01:49.012 LINK event_perf 00:01:49.012 LINK led 00:01:49.012 LINK poller_perf 00:01:49.012 LINK interrupt_tgt 00:01:49.012 LINK spdk_nvme_discover 00:01:49.012 LINK nvmf_tgt 00:01:49.012 LINK vhost 00:01:49.012 LINK spdk_trace_record 00:01:49.012 LINK iscsi_tgt 00:01:49.012 LINK verify 00:01:49.012 LINK mkfs 00:01:49.012 LINK hello_world 00:01:49.012 LINK spdk_tgt 00:01:49.012 LINK ioat_perf 00:01:49.012 LINK hello_sock 00:01:49.012 LINK bdev_svc 00:01:49.012 LINK hotplug 00:01:49.012 LINK hello_bdev 00:01:49.012 LINK hello_blob 00:01:49.012 LINK reset 00:01:49.012 LINK thread 00:01:49.012 LINK aer 00:01:49.276 CXX test/cpp_headers/accel_module.o 00:01:49.277 LINK arbitration 00:01:49.277 LINK spdk_dd 00:01:49.277 LINK idxd_perf 00:01:49.277 LINK nvmf 00:01:49.277 CC test/app/jsoncat/jsoncat.o 00:01:49.277 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:01:49.277 LINK reconnect 00:01:49.277 CC test/nvme/sgl/sgl.o 00:01:49.277 CC test/event/reactor/reactor.o 00:01:49.277 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:01:49.277 LINK spdk_trace 00:01:49.277 CC test/nvme/e2edp/nvme_dp.o 00:01:49.277 CC test/nvme/overhead/overhead.o 00:01:49.277 CC examples/nvme/cmb_copy/cmb_copy.o 00:01:49.277 LINK dif 00:01:49.277 LINK bdevio 00:01:49.277 CXX test/cpp_headers/assert.o 00:01:49.277 CXX test/cpp_headers/barrier.o 00:01:49.277 LINK test_dma 00:01:49.277 CC test/app/stub/stub.o 00:01:49.277 CC test/event/reactor_perf/reactor_perf.o 00:01:49.277 LINK accel_perf 00:01:49.535 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:01:49.535 CC app/fio/bdev/fio_plugin.o 00:01:49.535 CC test/env/vtophys/vtophys.o 00:01:49.535 CXX test/cpp_headers/base64.o 00:01:49.535 CC test/event/app_repeat/app_repeat.o 00:01:49.535 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:01:49.535 CXX test/cpp_headers/bdev.o 00:01:49.535 CC test/env/memory/memory_ut.o 00:01:49.535 CC test/nvme/err_injection/err_injection.o 00:01:49.535 CXX test/cpp_headers/bdev_module.o 00:01:49.535 LINK jsoncat 00:01:49.535 CXX test/cpp_headers/bdev_zone.o 00:01:49.535 LINK nvme_fuzz 00:01:49.535 CC examples/nvme/abort/abort.o 00:01:49.535 CC test/event/scheduler/scheduler.o 00:01:49.535 CC test/env/pci/pci_ut.o 00:01:49.535 LINK reactor 00:01:49.535 LINK nvme_manage 00:01:49.535 CXX test/cpp_headers/bit_array.o 00:01:49.535 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:01:49.535 LINK spdk_nvme 00:01:49.535 CC test/nvme/startup/startup.o 00:01:49.535 CXX test/cpp_headers/bit_pool.o 00:01:49.535 CC test/nvme/reserve/reserve.o 00:01:49.535 LINK blobcli 00:01:49.535 LINK reactor_perf 00:01:49.535 CC test/nvme/simple_copy/simple_copy.o 00:01:49.800 CC test/nvme/boot_partition/boot_partition.o 00:01:49.800 CC test/nvme/connect_stress/connect_stress.o 00:01:49.800 LINK cmb_copy 00:01:49.800 CXX test/cpp_headers/blob_bdev.o 00:01:49.800 LINK stub 00:01:49.800 CXX test/cpp_headers/blobfs_bdev.o 00:01:49.800 CXX test/cpp_headers/blobfs.o 00:01:49.800 CC test/nvme/compliance/nvme_compliance.o 00:01:49.800 LINK vtophys 00:01:49.800 LINK app_repeat 00:01:49.800 CC test/nvme/fused_ordering/fused_ordering.o 00:01:49.800 CC test/nvme/doorbell_aers/doorbell_aers.o 00:01:49.800 CXX test/cpp_headers/blob.o 00:01:49.800 LINK nvme_dp 00:01:49.800 CC test/nvme/fdp/fdp.o 00:01:49.800 CXX test/cpp_headers/conf.o 00:01:49.800 LINK env_dpdk_post_init 00:01:49.800 LINK sgl 00:01:49.800 CC test/nvme/cuse/cuse.o 00:01:49.800 CXX test/cpp_headers/config.o 00:01:49.800 CXX test/cpp_headers/cpuset.o 00:01:49.800 LINK mem_callbacks 00:01:49.800 LINK err_injection 00:01:49.800 LINK overhead 00:01:49.800 CXX test/cpp_headers/crc16.o 00:01:49.800 CXX test/cpp_headers/crc32.o 00:01:49.800 CXX test/cpp_headers/crc64.o 00:01:49.800 LINK pmr_persistence 00:01:49.800 CXX test/cpp_headers/dif.o 00:01:49.800 CXX test/cpp_headers/dma.o 00:01:50.062 CXX test/cpp_headers/endian.o 00:01:50.062 CXX test/cpp_headers/env_dpdk.o 00:01:50.062 LINK startup 00:01:50.062 LINK spdk_nvme_perf 00:01:50.062 LINK scheduler 00:01:50.062 CXX test/cpp_headers/env.o 00:01:50.062 CXX test/cpp_headers/event.o 00:01:50.062 CXX test/cpp_headers/fd_group.o 00:01:50.062 LINK spdk_nvme_identify 00:01:50.062 LINK reserve 00:01:50.062 CXX test/cpp_headers/fd.o 00:01:50.062 LINK boot_partition 00:01:50.062 CXX test/cpp_headers/file.o 00:01:50.062 LINK connect_stress 00:01:50.062 CXX test/cpp_headers/ftl.o 00:01:50.062 CXX test/cpp_headers/gpt_spec.o 00:01:50.062 CXX test/cpp_headers/hexlify.o 00:01:50.062 CXX test/cpp_headers/histogram_data.o 00:01:50.062 LINK bdevperf 00:01:50.062 CXX test/cpp_headers/idxd.o 00:01:50.062 LINK simple_copy 00:01:50.062 CXX test/cpp_headers/idxd_spec.o 00:01:50.062 CXX test/cpp_headers/init.o 00:01:50.062 LINK spdk_top 00:01:50.062 CXX test/cpp_headers/ioat.o 00:01:50.062 CXX test/cpp_headers/ioat_spec.o 00:01:50.062 CXX test/cpp_headers/iscsi_spec.o 00:01:50.062 LINK doorbell_aers 00:01:50.062 LINK fused_ordering 00:01:50.062 CXX test/cpp_headers/json.o 00:01:50.062 CXX test/cpp_headers/jsonrpc.o 00:01:50.333 CXX test/cpp_headers/likely.o 00:01:50.333 LINK vhost_fuzz 00:01:50.333 CXX test/cpp_headers/log.o 00:01:50.333 LINK abort 00:01:50.333 CXX test/cpp_headers/lvol.o 00:01:50.333 CXX test/cpp_headers/memory.o 00:01:50.333 CXX test/cpp_headers/mmio.o 00:01:50.333 CXX test/cpp_headers/nbd.o 00:01:50.333 CXX test/cpp_headers/notify.o 00:01:50.333 LINK pci_ut 00:01:50.333 CXX test/cpp_headers/nvme.o 00:01:50.333 CXX test/cpp_headers/nvme_intel.o 00:01:50.333 CXX test/cpp_headers/nvme_ocssd.o 00:01:50.333 CXX test/cpp_headers/nvme_ocssd_spec.o 00:01:50.333 CXX test/cpp_headers/nvme_spec.o 00:01:50.333 CXX test/cpp_headers/nvme_zns.o 00:01:50.333 CXX test/cpp_headers/nvmf_cmd.o 00:01:50.333 CXX test/cpp_headers/nvmf_fc_spec.o 00:01:50.333 CXX test/cpp_headers/nvmf.o 00:01:50.333 CXX test/cpp_headers/nvmf_spec.o 00:01:50.333 CXX test/cpp_headers/nvmf_transport.o 00:01:50.333 CXX test/cpp_headers/opal.o 00:01:50.333 CXX test/cpp_headers/opal_spec.o 00:01:50.333 LINK nvme_compliance 00:01:50.333 LINK spdk_bdev 00:01:50.333 CXX test/cpp_headers/pci_ids.o 00:01:50.333 CXX test/cpp_headers/pipe.o 00:01:50.333 CXX test/cpp_headers/queue.o 00:01:50.333 LINK fdp 00:01:50.333 CXX test/cpp_headers/reduce.o 00:01:50.592 CXX test/cpp_headers/rpc.o 00:01:50.592 CXX test/cpp_headers/scheduler.o 00:01:50.592 CXX test/cpp_headers/scsi.o 00:01:50.592 CXX test/cpp_headers/scsi_spec.o 00:01:50.592 CXX test/cpp_headers/sock.o 00:01:50.592 CXX test/cpp_headers/stdinc.o 00:01:50.592 CXX test/cpp_headers/string.o 00:01:50.592 CXX test/cpp_headers/thread.o 00:01:50.592 CXX test/cpp_headers/trace.o 00:01:50.592 CXX test/cpp_headers/trace_parser.o 00:01:50.592 CXX test/cpp_headers/tree.o 00:01:50.592 CXX test/cpp_headers/ublk.o 00:01:50.592 CXX test/cpp_headers/util.o 00:01:50.592 CXX test/cpp_headers/uuid.o 00:01:50.592 CXX test/cpp_headers/version.o 00:01:50.592 CXX test/cpp_headers/vfio_user_pci.o 00:01:50.592 CXX test/cpp_headers/vfio_user_spec.o 00:01:50.592 CXX test/cpp_headers/vhost.o 00:01:50.592 CXX test/cpp_headers/vmd.o 00:01:50.592 CXX test/cpp_headers/xor.o 00:01:50.592 CXX test/cpp_headers/zipf.o 00:01:51.160 LINK memory_ut 00:01:51.160 LINK cuse 00:01:51.728 LINK iscsi_fuzz 00:01:54.264 LINK esnap 00:01:54.264 00:01:54.264 real 0m46.455s 00:01:54.264 user 9m38.912s 00:01:54.264 sys 2m9.283s 00:01:54.264 15:25:45 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:54.264 15:25:45 -- common/autotest_common.sh@10 -- $ set +x 00:01:54.264 ************************************ 00:01:54.264 END TEST make 00:01:54.264 ************************************ 00:01:54.264 15:25:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:01:54.264 15:25:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:01:54.264 15:25:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:01:54.523 15:25:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:01:54.523 15:25:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:01:54.523 15:25:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:01:54.523 15:25:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:01:54.523 15:25:45 -- scripts/common.sh@335 -- # IFS=.-: 00:01:54.523 15:25:45 -- scripts/common.sh@335 -- # read -ra ver1 00:01:54.523 15:25:45 -- scripts/common.sh@336 -- # IFS=.-: 00:01:54.523 15:25:45 -- scripts/common.sh@336 -- # read -ra ver2 00:01:54.523 15:25:45 -- scripts/common.sh@337 -- # local 'op=<' 00:01:54.523 15:25:45 -- scripts/common.sh@339 -- # ver1_l=2 00:01:54.523 15:25:45 -- scripts/common.sh@340 -- # ver2_l=1 00:01:54.523 15:25:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:01:54.523 15:25:45 -- scripts/common.sh@343 -- # case "$op" in 00:01:54.523 15:25:45 -- scripts/common.sh@344 -- # : 1 00:01:54.523 15:25:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:01:54.523 15:25:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:54.523 15:25:45 -- scripts/common.sh@364 -- # decimal 1 00:01:54.523 15:25:45 -- scripts/common.sh@352 -- # local d=1 00:01:54.523 15:25:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:01:54.523 15:25:45 -- scripts/common.sh@354 -- # echo 1 00:01:54.523 15:25:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:01:54.523 15:25:45 -- scripts/common.sh@365 -- # decimal 2 00:01:54.523 15:25:45 -- scripts/common.sh@352 -- # local d=2 00:01:54.523 15:25:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:01:54.523 15:25:45 -- scripts/common.sh@354 -- # echo 2 00:01:54.523 15:25:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:01:54.523 15:25:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:01:54.523 15:25:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:01:54.523 15:25:45 -- scripts/common.sh@367 -- # return 0 00:01:54.523 15:25:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:01:54.523 15:25:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:01:54.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:54.523 --rc genhtml_branch_coverage=1 00:01:54.523 --rc genhtml_function_coverage=1 00:01:54.523 --rc genhtml_legend=1 00:01:54.523 --rc geninfo_all_blocks=1 00:01:54.523 --rc geninfo_unexecuted_blocks=1 00:01:54.523 00:01:54.523 ' 00:01:54.523 15:25:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:01:54.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:54.523 --rc genhtml_branch_coverage=1 00:01:54.523 --rc genhtml_function_coverage=1 00:01:54.523 --rc genhtml_legend=1 00:01:54.523 --rc geninfo_all_blocks=1 00:01:54.523 --rc geninfo_unexecuted_blocks=1 00:01:54.523 00:01:54.523 ' 00:01:54.523 15:25:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:01:54.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:54.523 --rc genhtml_branch_coverage=1 00:01:54.523 --rc genhtml_function_coverage=1 00:01:54.523 --rc genhtml_legend=1 00:01:54.523 --rc geninfo_all_blocks=1 00:01:54.524 --rc geninfo_unexecuted_blocks=1 00:01:54.524 00:01:54.524 ' 00:01:54.524 15:25:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:01:54.524 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:54.524 --rc genhtml_branch_coverage=1 00:01:54.524 --rc genhtml_function_coverage=1 00:01:54.524 --rc genhtml_legend=1 00:01:54.524 --rc geninfo_all_blocks=1 00:01:54.524 --rc geninfo_unexecuted_blocks=1 00:01:54.524 00:01:54.524 ' 00:01:54.524 15:25:45 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:01:54.524 15:25:45 -- nvmf/common.sh@7 -- # uname -s 00:01:54.524 15:25:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:01:54.524 15:25:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:01:54.524 15:25:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:01:54.524 15:25:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:01:54.524 15:25:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:01:54.524 15:25:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:01:54.524 15:25:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:01:54.524 15:25:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:01:54.524 15:25:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:01:54.524 15:25:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:01:54.524 15:25:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:01:54.524 15:25:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:01:54.524 15:25:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:01:54.524 15:25:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:01:54.524 15:25:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:01:54.524 15:25:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:54.524 15:25:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:01:54.524 15:25:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:54.524 15:25:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:54.524 15:25:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:54.524 15:25:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:54.524 15:25:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:54.524 15:25:45 -- paths/export.sh@5 -- # export PATH 00:01:54.524 15:25:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:54.524 15:25:45 -- nvmf/common.sh@46 -- # : 0 00:01:54.524 15:25:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:01:54.524 15:25:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:01:54.524 15:25:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:01:54.524 15:25:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:01:54.524 15:25:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:01:54.524 15:25:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:01:54.524 15:25:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:01:54.524 15:25:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:01:54.524 15:25:45 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:01:54.524 15:25:45 -- spdk/autotest.sh@32 -- # uname -s 00:01:54.524 15:25:45 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:01:54.524 15:25:45 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:01:54.524 15:25:45 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:01:54.524 15:25:45 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:01:54.524 15:25:45 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:01:54.524 15:25:45 -- spdk/autotest.sh@44 -- # modprobe nbd 00:01:54.524 15:25:45 -- spdk/autotest.sh@46 -- # type -P udevadm 00:01:54.524 15:25:45 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:01:54.524 15:25:45 -- spdk/autotest.sh@48 -- # udevadm_pid=715815 00:01:54.524 15:25:45 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:01:54.524 15:25:45 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:54.524 15:25:45 -- spdk/autotest.sh@54 -- # echo 715817 00:01:54.524 15:25:45 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:54.524 15:25:45 -- spdk/autotest.sh@56 -- # echo 715818 00:01:54.524 15:25:45 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:01:54.524 15:25:45 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:54.524 15:25:45 -- spdk/autotest.sh@60 -- # echo 715819 00:01:54.524 15:25:45 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:01:54.524 15:25:45 -- spdk/autotest.sh@62 -- # echo 715820 00:01:54.524 15:25:45 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:01:54.524 15:25:45 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:01:54.524 15:25:45 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:01:54.524 15:25:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:01:54.524 15:25:45 -- common/autotest_common.sh@10 -- # set +x 00:01:54.524 15:25:45 -- spdk/autotest.sh@70 -- # create_test_list 00:01:54.524 15:25:45 -- common/autotest_common.sh@746 -- # xtrace_disable 00:01:54.524 15:25:45 -- common/autotest_common.sh@10 -- # set +x 00:01:54.524 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:01:54.524 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:01:54.524 15:25:45 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:01:54.524 15:25:45 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:54.524 15:25:45 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:54.524 15:25:45 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:54.524 15:25:45 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:54.524 15:25:45 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:01:54.524 15:25:45 -- common/autotest_common.sh@1450 -- # uname 00:01:54.524 15:25:45 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:01:54.524 15:25:45 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:01:54.524 15:25:45 -- common/autotest_common.sh@1470 -- # uname 00:01:54.524 15:25:45 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:01:54.524 15:25:45 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:01:54.524 15:25:45 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:01:54.524 lcov: LCOV version 1.15 00:01:54.524 15:25:45 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:12.620 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:12.620 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:12.620 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:12.620 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:12.620 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:12.620 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:27.506 15:26:18 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:02:27.506 15:26:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:27.506 15:26:18 -- common/autotest_common.sh@10 -- # set +x 00:02:27.506 15:26:18 -- spdk/autotest.sh@89 -- # rm -f 00:02:27.506 15:26:18 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:28.879 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:02:28.879 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:02:28.879 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:02:28.879 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:02:28.879 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:02:28.879 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:02:28.879 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:02:28.879 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:02:28.879 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:02:28.879 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:02:28.879 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:02:28.879 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:02:28.879 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:02:28.879 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:02:28.879 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:02:28.879 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:02:28.879 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:02:28.879 15:26:20 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:02:28.879 15:26:20 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:28.879 15:26:20 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:28.879 15:26:20 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:28.879 15:26:20 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:28.879 15:26:20 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:28.879 15:26:20 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:28.879 15:26:20 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:28.879 15:26:20 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:28.879 15:26:20 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:02:28.879 15:26:20 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:02:28.879 15:26:20 -- spdk/autotest.sh@108 -- # grep -v p 00:02:28.879 15:26:20 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:02:28.879 15:26:20 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:02:28.879 15:26:20 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:02:28.879 15:26:20 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:02:28.879 15:26:20 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:28.879 No valid GPT data, bailing 00:02:28.879 15:26:20 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:29.137 15:26:20 -- scripts/common.sh@393 -- # pt= 00:02:29.137 15:26:20 -- scripts/common.sh@394 -- # return 1 00:02:29.137 15:26:20 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:29.137 1+0 records in 00:02:29.137 1+0 records out 00:02:29.137 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00221353 s, 474 MB/s 00:02:29.137 15:26:20 -- spdk/autotest.sh@116 -- # sync 00:02:29.137 15:26:20 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:29.137 15:26:20 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:29.137 15:26:20 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:31.037 15:26:22 -- spdk/autotest.sh@122 -- # uname -s 00:02:31.037 15:26:22 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:02:31.037 15:26:22 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:31.037 15:26:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:31.037 15:26:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:31.037 15:26:22 -- common/autotest_common.sh@10 -- # set +x 00:02:31.037 ************************************ 00:02:31.037 START TEST setup.sh 00:02:31.037 ************************************ 00:02:31.037 15:26:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:31.037 * Looking for test storage... 00:02:31.037 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:31.037 15:26:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:31.037 15:26:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:31.037 15:26:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:31.037 15:26:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:31.037 15:26:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:31.037 15:26:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:31.037 15:26:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:31.037 15:26:22 -- scripts/common.sh@335 -- # IFS=.-: 00:02:31.037 15:26:22 -- scripts/common.sh@335 -- # read -ra ver1 00:02:31.037 15:26:22 -- scripts/common.sh@336 -- # IFS=.-: 00:02:31.037 15:26:22 -- scripts/common.sh@336 -- # read -ra ver2 00:02:31.037 15:26:22 -- scripts/common.sh@337 -- # local 'op=<' 00:02:31.037 15:26:22 -- scripts/common.sh@339 -- # ver1_l=2 00:02:31.037 15:26:22 -- scripts/common.sh@340 -- # ver2_l=1 00:02:31.037 15:26:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:31.037 15:26:22 -- scripts/common.sh@343 -- # case "$op" in 00:02:31.037 15:26:22 -- scripts/common.sh@344 -- # : 1 00:02:31.037 15:26:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:31.037 15:26:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:31.037 15:26:22 -- scripts/common.sh@364 -- # decimal 1 00:02:31.037 15:26:22 -- scripts/common.sh@352 -- # local d=1 00:02:31.037 15:26:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:31.037 15:26:22 -- scripts/common.sh@354 -- # echo 1 00:02:31.037 15:26:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:31.037 15:26:22 -- scripts/common.sh@365 -- # decimal 2 00:02:31.037 15:26:22 -- scripts/common.sh@352 -- # local d=2 00:02:31.037 15:26:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:31.037 15:26:22 -- scripts/common.sh@354 -- # echo 2 00:02:31.037 15:26:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:31.037 15:26:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:31.037 15:26:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:31.037 15:26:22 -- scripts/common.sh@367 -- # return 0 00:02:31.037 15:26:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:31.037 15:26:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:31.037 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.037 --rc genhtml_branch_coverage=1 00:02:31.037 --rc genhtml_function_coverage=1 00:02:31.037 --rc genhtml_legend=1 00:02:31.037 --rc geninfo_all_blocks=1 00:02:31.037 --rc geninfo_unexecuted_blocks=1 00:02:31.037 00:02:31.037 ' 00:02:31.037 15:26:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:31.037 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.037 --rc genhtml_branch_coverage=1 00:02:31.038 --rc genhtml_function_coverage=1 00:02:31.038 --rc genhtml_legend=1 00:02:31.038 --rc geninfo_all_blocks=1 00:02:31.038 --rc geninfo_unexecuted_blocks=1 00:02:31.038 00:02:31.038 ' 00:02:31.038 15:26:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:31.038 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.038 --rc genhtml_branch_coverage=1 00:02:31.038 --rc genhtml_function_coverage=1 00:02:31.038 --rc genhtml_legend=1 00:02:31.038 --rc geninfo_all_blocks=1 00:02:31.038 --rc geninfo_unexecuted_blocks=1 00:02:31.038 00:02:31.038 ' 00:02:31.038 15:26:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:31.038 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.038 --rc genhtml_branch_coverage=1 00:02:31.038 --rc genhtml_function_coverage=1 00:02:31.038 --rc genhtml_legend=1 00:02:31.038 --rc geninfo_all_blocks=1 00:02:31.038 --rc geninfo_unexecuted_blocks=1 00:02:31.038 00:02:31.038 ' 00:02:31.038 15:26:22 -- setup/test-setup.sh@10 -- # uname -s 00:02:31.038 15:26:22 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:31.038 15:26:22 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:31.038 15:26:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:31.038 15:26:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:31.038 15:26:22 -- common/autotest_common.sh@10 -- # set +x 00:02:31.038 ************************************ 00:02:31.038 START TEST acl 00:02:31.038 ************************************ 00:02:31.038 15:26:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:31.038 * Looking for test storage... 00:02:31.038 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:31.038 15:26:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:31.038 15:26:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:31.038 15:26:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:31.296 15:26:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:31.296 15:26:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:31.296 15:26:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:31.296 15:26:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:31.296 15:26:22 -- scripts/common.sh@335 -- # IFS=.-: 00:02:31.296 15:26:22 -- scripts/common.sh@335 -- # read -ra ver1 00:02:31.296 15:26:22 -- scripts/common.sh@336 -- # IFS=.-: 00:02:31.296 15:26:22 -- scripts/common.sh@336 -- # read -ra ver2 00:02:31.296 15:26:22 -- scripts/common.sh@337 -- # local 'op=<' 00:02:31.296 15:26:22 -- scripts/common.sh@339 -- # ver1_l=2 00:02:31.296 15:26:22 -- scripts/common.sh@340 -- # ver2_l=1 00:02:31.296 15:26:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:31.296 15:26:22 -- scripts/common.sh@343 -- # case "$op" in 00:02:31.296 15:26:22 -- scripts/common.sh@344 -- # : 1 00:02:31.296 15:26:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:31.297 15:26:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:31.297 15:26:22 -- scripts/common.sh@364 -- # decimal 1 00:02:31.297 15:26:22 -- scripts/common.sh@352 -- # local d=1 00:02:31.297 15:26:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:31.297 15:26:22 -- scripts/common.sh@354 -- # echo 1 00:02:31.297 15:26:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:31.297 15:26:22 -- scripts/common.sh@365 -- # decimal 2 00:02:31.297 15:26:22 -- scripts/common.sh@352 -- # local d=2 00:02:31.297 15:26:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:31.297 15:26:22 -- scripts/common.sh@354 -- # echo 2 00:02:31.297 15:26:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:31.297 15:26:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:31.297 15:26:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:31.297 15:26:22 -- scripts/common.sh@367 -- # return 0 00:02:31.297 15:26:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:31.297 15:26:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:31.297 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.297 --rc genhtml_branch_coverage=1 00:02:31.297 --rc genhtml_function_coverage=1 00:02:31.297 --rc genhtml_legend=1 00:02:31.297 --rc geninfo_all_blocks=1 00:02:31.297 --rc geninfo_unexecuted_blocks=1 00:02:31.297 00:02:31.297 ' 00:02:31.297 15:26:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:31.297 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.297 --rc genhtml_branch_coverage=1 00:02:31.297 --rc genhtml_function_coverage=1 00:02:31.297 --rc genhtml_legend=1 00:02:31.297 --rc geninfo_all_blocks=1 00:02:31.297 --rc geninfo_unexecuted_blocks=1 00:02:31.297 00:02:31.297 ' 00:02:31.297 15:26:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:31.297 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.297 --rc genhtml_branch_coverage=1 00:02:31.297 --rc genhtml_function_coverage=1 00:02:31.297 --rc genhtml_legend=1 00:02:31.297 --rc geninfo_all_blocks=1 00:02:31.297 --rc geninfo_unexecuted_blocks=1 00:02:31.297 00:02:31.297 ' 00:02:31.297 15:26:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:31.297 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:31.297 --rc genhtml_branch_coverage=1 00:02:31.297 --rc genhtml_function_coverage=1 00:02:31.297 --rc genhtml_legend=1 00:02:31.297 --rc geninfo_all_blocks=1 00:02:31.297 --rc geninfo_unexecuted_blocks=1 00:02:31.297 00:02:31.297 ' 00:02:31.297 15:26:22 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:31.297 15:26:22 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:31.297 15:26:22 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:31.297 15:26:22 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:31.297 15:26:22 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:31.297 15:26:22 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:31.297 15:26:22 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:31.297 15:26:22 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:31.297 15:26:22 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:31.297 15:26:22 -- setup/acl.sh@12 -- # devs=() 00:02:31.297 15:26:22 -- setup/acl.sh@12 -- # declare -a devs 00:02:31.297 15:26:22 -- setup/acl.sh@13 -- # drivers=() 00:02:31.297 15:26:22 -- setup/acl.sh@13 -- # declare -A drivers 00:02:31.297 15:26:22 -- setup/acl.sh@51 -- # setup reset 00:02:31.297 15:26:22 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:31.297 15:26:22 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:32.673 15:26:23 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:32.673 15:26:23 -- setup/acl.sh@16 -- # local dev driver 00:02:32.673 15:26:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.673 15:26:23 -- setup/acl.sh@15 -- # setup output status 00:02:32.673 15:26:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:32.673 15:26:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:02:33.610 Hugepages 00:02:33.610 node hugesize free / total 00:02:33.610 15:26:25 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:33.610 15:26:25 -- setup/acl.sh@19 -- # continue 00:02:33.610 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.610 15:26:25 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:33.610 15:26:25 -- setup/acl.sh@19 -- # continue 00:02:33.610 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.610 15:26:25 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:33.610 15:26:25 -- setup/acl.sh@19 -- # continue 00:02:33.610 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.610 00:02:33.610 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:33.610 15:26:25 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:33.610 15:26:25 -- setup/acl.sh@19 -- # continue 00:02:33.610 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.611 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.611 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.611 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.611 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.611 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.611 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.611 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.611 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.611 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.611 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.611 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.611 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.611 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.611 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.611 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.611 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.611 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.611 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.611 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.611 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.611 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.870 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:02:33.870 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.870 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.870 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.870 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:02:33.870 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.870 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.870 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.870 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:02:33.870 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.870 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.870 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.870 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:02:33.870 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.870 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.870 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.870 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:02:33.870 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.870 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.870 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.870 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:02:33.870 15:26:25 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.870 15:26:25 -- setup/acl.sh@20 -- # continue 00:02:33.870 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.870 15:26:25 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:02:33.870 15:26:25 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:33.870 15:26:25 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:02:33.870 15:26:25 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:33.870 15:26:25 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:33.870 15:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.870 15:26:25 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:33.870 15:26:25 -- setup/acl.sh@54 -- # run_test denied denied 00:02:33.870 15:26:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:33.870 15:26:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:33.870 15:26:25 -- common/autotest_common.sh@10 -- # set +x 00:02:33.870 ************************************ 00:02:33.870 START TEST denied 00:02:33.870 ************************************ 00:02:33.870 15:26:25 -- common/autotest_common.sh@1114 -- # denied 00:02:33.870 15:26:25 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:02:33.870 15:26:25 -- setup/acl.sh@38 -- # setup output config 00:02:33.870 15:26:25 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:02:33.870 15:26:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:33.870 15:26:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:35.246 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:02:35.247 15:26:26 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:02:35.247 15:26:26 -- setup/acl.sh@28 -- # local dev driver 00:02:35.247 15:26:26 -- setup/acl.sh@30 -- # for dev in "$@" 00:02:35.247 15:26:26 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:02:35.247 15:26:26 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:02:35.247 15:26:26 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:02:35.247 15:26:26 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:02:35.247 15:26:26 -- setup/acl.sh@41 -- # setup reset 00:02:35.247 15:26:26 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:35.247 15:26:26 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:37.779 00:02:37.779 real 0m3.790s 00:02:37.779 user 0m1.173s 00:02:37.779 sys 0m1.738s 00:02:37.779 15:26:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:37.779 15:26:28 -- common/autotest_common.sh@10 -- # set +x 00:02:37.779 ************************************ 00:02:37.779 END TEST denied 00:02:37.779 ************************************ 00:02:37.779 15:26:28 -- setup/acl.sh@55 -- # run_test allowed allowed 00:02:37.779 15:26:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:37.779 15:26:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:37.779 15:26:28 -- common/autotest_common.sh@10 -- # set +x 00:02:37.779 ************************************ 00:02:37.779 START TEST allowed 00:02:37.779 ************************************ 00:02:37.779 15:26:28 -- common/autotest_common.sh@1114 -- # allowed 00:02:37.779 15:26:28 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:02:37.779 15:26:28 -- setup/acl.sh@45 -- # setup output config 00:02:37.779 15:26:28 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:02:37.779 15:26:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:37.779 15:26:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:40.316 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:02:40.316 15:26:31 -- setup/acl.sh@47 -- # verify 00:02:40.316 15:26:31 -- setup/acl.sh@28 -- # local dev driver 00:02:40.316 15:26:31 -- setup/acl.sh@48 -- # setup reset 00:02:40.316 15:26:31 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:40.316 15:26:31 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:41.757 00:02:41.757 real 0m4.021s 00:02:41.757 user 0m1.103s 00:02:41.757 sys 0m1.762s 00:02:41.757 15:26:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:41.757 15:26:32 -- common/autotest_common.sh@10 -- # set +x 00:02:41.757 ************************************ 00:02:41.757 END TEST allowed 00:02:41.757 ************************************ 00:02:41.757 00:02:41.757 real 0m10.587s 00:02:41.757 user 0m3.408s 00:02:41.757 sys 0m5.236s 00:02:41.757 15:26:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:41.757 15:26:32 -- common/autotest_common.sh@10 -- # set +x 00:02:41.757 ************************************ 00:02:41.757 END TEST acl 00:02:41.757 ************************************ 00:02:41.757 15:26:33 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:02:41.757 15:26:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:41.757 15:26:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:41.757 15:26:33 -- common/autotest_common.sh@10 -- # set +x 00:02:41.757 ************************************ 00:02:41.757 START TEST hugepages 00:02:41.757 ************************************ 00:02:41.757 15:26:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:02:41.757 * Looking for test storage... 00:02:41.757 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:41.757 15:26:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:41.757 15:26:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:41.757 15:26:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:41.757 15:26:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:41.757 15:26:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:41.757 15:26:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:41.757 15:26:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:41.757 15:26:33 -- scripts/common.sh@335 -- # IFS=.-: 00:02:41.757 15:26:33 -- scripts/common.sh@335 -- # read -ra ver1 00:02:41.757 15:26:33 -- scripts/common.sh@336 -- # IFS=.-: 00:02:41.757 15:26:33 -- scripts/common.sh@336 -- # read -ra ver2 00:02:41.757 15:26:33 -- scripts/common.sh@337 -- # local 'op=<' 00:02:41.757 15:26:33 -- scripts/common.sh@339 -- # ver1_l=2 00:02:41.757 15:26:33 -- scripts/common.sh@340 -- # ver2_l=1 00:02:41.758 15:26:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:41.758 15:26:33 -- scripts/common.sh@343 -- # case "$op" in 00:02:41.758 15:26:33 -- scripts/common.sh@344 -- # : 1 00:02:41.758 15:26:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:41.758 15:26:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:41.758 15:26:33 -- scripts/common.sh@364 -- # decimal 1 00:02:41.758 15:26:33 -- scripts/common.sh@352 -- # local d=1 00:02:41.758 15:26:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:41.758 15:26:33 -- scripts/common.sh@354 -- # echo 1 00:02:41.758 15:26:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:41.758 15:26:33 -- scripts/common.sh@365 -- # decimal 2 00:02:41.758 15:26:33 -- scripts/common.sh@352 -- # local d=2 00:02:41.758 15:26:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:41.758 15:26:33 -- scripts/common.sh@354 -- # echo 2 00:02:41.758 15:26:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:41.758 15:26:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:41.758 15:26:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:41.758 15:26:33 -- scripts/common.sh@367 -- # return 0 00:02:41.758 15:26:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:41.758 15:26:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:41.758 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:41.758 --rc genhtml_branch_coverage=1 00:02:41.758 --rc genhtml_function_coverage=1 00:02:41.758 --rc genhtml_legend=1 00:02:41.758 --rc geninfo_all_blocks=1 00:02:41.758 --rc geninfo_unexecuted_blocks=1 00:02:41.758 00:02:41.758 ' 00:02:41.758 15:26:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:41.758 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:41.758 --rc genhtml_branch_coverage=1 00:02:41.758 --rc genhtml_function_coverage=1 00:02:41.758 --rc genhtml_legend=1 00:02:41.758 --rc geninfo_all_blocks=1 00:02:41.758 --rc geninfo_unexecuted_blocks=1 00:02:41.758 00:02:41.758 ' 00:02:41.758 15:26:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:41.758 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:41.758 --rc genhtml_branch_coverage=1 00:02:41.758 --rc genhtml_function_coverage=1 00:02:41.758 --rc genhtml_legend=1 00:02:41.758 --rc geninfo_all_blocks=1 00:02:41.758 --rc geninfo_unexecuted_blocks=1 00:02:41.758 00:02:41.758 ' 00:02:41.758 15:26:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:41.758 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:41.758 --rc genhtml_branch_coverage=1 00:02:41.758 --rc genhtml_function_coverage=1 00:02:41.758 --rc genhtml_legend=1 00:02:41.758 --rc geninfo_all_blocks=1 00:02:41.758 --rc geninfo_unexecuted_blocks=1 00:02:41.758 00:02:41.758 ' 00:02:41.758 15:26:33 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:02:41.758 15:26:33 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:02:41.758 15:26:33 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:02:41.758 15:26:33 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:02:41.758 15:26:33 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:02:41.758 15:26:33 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:02:41.758 15:26:33 -- setup/common.sh@17 -- # local get=Hugepagesize 00:02:41.758 15:26:33 -- setup/common.sh@18 -- # local node= 00:02:41.758 15:26:33 -- setup/common.sh@19 -- # local var val 00:02:41.758 15:26:33 -- setup/common.sh@20 -- # local mem_f mem 00:02:41.758 15:26:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:41.758 15:26:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:41.758 15:26:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:41.758 15:26:33 -- setup/common.sh@28 -- # mapfile -t mem 00:02:41.758 15:26:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43077996 kB' 'MemAvailable: 46854608 kB' 'Buffers: 2708 kB' 'Cached: 10677756 kB' 'SwapCached: 0 kB' 'Active: 7414848 kB' 'Inactive: 3766568 kB' 'Active(anon): 7012704 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503964 kB' 'Mapped: 205028 kB' 'Shmem: 6511752 kB' 'KReclaimable: 203448 kB' 'Slab: 774172 kB' 'SReclaimable: 203448 kB' 'SUnreclaim: 570724 kB' 'KernelStack: 12912 kB' 'PageTables: 8460 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559280 kB' 'Committed_AS: 8086636 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198748 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.758 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.758 15:26:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:41.759 15:26:33 -- setup/common.sh@32 -- # continue 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:41.759 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # continue 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # IFS=': ' 00:02:42.019 15:26:33 -- setup/common.sh@31 -- # read -r var val _ 00:02:42.019 15:26:33 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:42.019 15:26:33 -- setup/common.sh@33 -- # echo 2048 00:02:42.019 15:26:33 -- setup/common.sh@33 -- # return 0 00:02:42.019 15:26:33 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:02:42.019 15:26:33 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:02:42.019 15:26:33 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:02:42.019 15:26:33 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:02:42.019 15:26:33 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:02:42.019 15:26:33 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:02:42.019 15:26:33 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:02:42.019 15:26:33 -- setup/hugepages.sh@207 -- # get_nodes 00:02:42.019 15:26:33 -- setup/hugepages.sh@27 -- # local node 00:02:42.019 15:26:33 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:42.019 15:26:33 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:02:42.019 15:26:33 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:42.019 15:26:33 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:42.019 15:26:33 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:42.019 15:26:33 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:42.019 15:26:33 -- setup/hugepages.sh@208 -- # clear_hp 00:02:42.019 15:26:33 -- setup/hugepages.sh@37 -- # local node hp 00:02:42.019 15:26:33 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:42.019 15:26:33 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:42.019 15:26:33 -- setup/hugepages.sh@41 -- # echo 0 00:02:42.019 15:26:33 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:42.019 15:26:33 -- setup/hugepages.sh@41 -- # echo 0 00:02:42.019 15:26:33 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:42.019 15:26:33 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:42.019 15:26:33 -- setup/hugepages.sh@41 -- # echo 0 00:02:42.019 15:26:33 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:42.019 15:26:33 -- setup/hugepages.sh@41 -- # echo 0 00:02:42.019 15:26:33 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:42.019 15:26:33 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:42.019 15:26:33 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:02:42.019 15:26:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:42.019 15:26:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:42.019 15:26:33 -- common/autotest_common.sh@10 -- # set +x 00:02:42.019 ************************************ 00:02:42.019 START TEST default_setup 00:02:42.019 ************************************ 00:02:42.019 15:26:33 -- common/autotest_common.sh@1114 -- # default_setup 00:02:42.019 15:26:33 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:02:42.019 15:26:33 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:42.019 15:26:33 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:42.019 15:26:33 -- setup/hugepages.sh@51 -- # shift 00:02:42.019 15:26:33 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:42.019 15:26:33 -- setup/hugepages.sh@52 -- # local node_ids 00:02:42.019 15:26:33 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:42.019 15:26:33 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:42.019 15:26:33 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:42.019 15:26:33 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:42.019 15:26:33 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:42.019 15:26:33 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:42.019 15:26:33 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:42.019 15:26:33 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:42.019 15:26:33 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:42.019 15:26:33 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:42.019 15:26:33 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:42.019 15:26:33 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:42.019 15:26:33 -- setup/hugepages.sh@73 -- # return 0 00:02:42.019 15:26:33 -- setup/hugepages.sh@137 -- # setup output 00:02:42.019 15:26:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:42.019 15:26:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:42.956 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:02:42.956 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:02:42.956 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:02:42.956 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:02:42.957 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:02:42.957 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:02:43.216 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:02:43.216 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:02:43.216 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:02:43.216 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:02:43.216 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:02:43.216 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:02:43.216 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:02:43.216 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:02:43.216 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:02:43.216 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:02:44.159 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:02:44.159 15:26:35 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:02:44.159 15:26:35 -- setup/hugepages.sh@89 -- # local node 00:02:44.159 15:26:35 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:44.159 15:26:35 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:44.159 15:26:35 -- setup/hugepages.sh@92 -- # local surp 00:02:44.159 15:26:35 -- setup/hugepages.sh@93 -- # local resv 00:02:44.159 15:26:35 -- setup/hugepages.sh@94 -- # local anon 00:02:44.159 15:26:35 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:44.159 15:26:35 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:44.159 15:26:35 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:44.159 15:26:35 -- setup/common.sh@18 -- # local node= 00:02:44.159 15:26:35 -- setup/common.sh@19 -- # local var val 00:02:44.159 15:26:35 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.159 15:26:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.159 15:26:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:44.159 15:26:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:44.159 15:26:35 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.159 15:26:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45207168 kB' 'MemAvailable: 48983748 kB' 'Buffers: 2708 kB' 'Cached: 10677868 kB' 'SwapCached: 0 kB' 'Active: 7417080 kB' 'Inactive: 3766568 kB' 'Active(anon): 7014936 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 506360 kB' 'Mapped: 204652 kB' 'Shmem: 6511864 kB' 'KReclaimable: 203384 kB' 'Slab: 773844 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570460 kB' 'KernelStack: 12784 kB' 'PageTables: 8256 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8092884 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198908 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.159 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.159 15:26:35 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.160 15:26:35 -- setup/common.sh@33 -- # echo 0 00:02:44.160 15:26:35 -- setup/common.sh@33 -- # return 0 00:02:44.160 15:26:35 -- setup/hugepages.sh@97 -- # anon=0 00:02:44.160 15:26:35 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:44.160 15:26:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:44.160 15:26:35 -- setup/common.sh@18 -- # local node= 00:02:44.160 15:26:35 -- setup/common.sh@19 -- # local var val 00:02:44.160 15:26:35 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.160 15:26:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.160 15:26:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:44.160 15:26:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:44.160 15:26:35 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.160 15:26:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45215088 kB' 'MemAvailable: 48991668 kB' 'Buffers: 2708 kB' 'Cached: 10677872 kB' 'SwapCached: 0 kB' 'Active: 7417092 kB' 'Inactive: 3766568 kB' 'Active(anon): 7014948 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 506452 kB' 'Mapped: 204652 kB' 'Shmem: 6511868 kB' 'KReclaimable: 203384 kB' 'Slab: 773836 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570452 kB' 'KernelStack: 12816 kB' 'PageTables: 8168 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8092896 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198876 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.160 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.160 15:26:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.161 15:26:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.161 15:26:35 -- setup/common.sh@33 -- # echo 0 00:02:44.161 15:26:35 -- setup/common.sh@33 -- # return 0 00:02:44.161 15:26:35 -- setup/hugepages.sh@99 -- # surp=0 00:02:44.161 15:26:35 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:44.161 15:26:35 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:44.161 15:26:35 -- setup/common.sh@18 -- # local node= 00:02:44.161 15:26:35 -- setup/common.sh@19 -- # local var val 00:02:44.161 15:26:35 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.161 15:26:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.161 15:26:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:44.161 15:26:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:44.161 15:26:35 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.161 15:26:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.161 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45215100 kB' 'MemAvailable: 48991680 kB' 'Buffers: 2708 kB' 'Cached: 10677884 kB' 'SwapCached: 0 kB' 'Active: 7416008 kB' 'Inactive: 3766568 kB' 'Active(anon): 7013864 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505244 kB' 'Mapped: 204552 kB' 'Shmem: 6511880 kB' 'KReclaimable: 203384 kB' 'Slab: 773848 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570464 kB' 'KernelStack: 12864 kB' 'PageTables: 8264 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8092912 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198876 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.162 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.162 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.163 15:26:35 -- setup/common.sh@33 -- # echo 0 00:02:44.163 15:26:35 -- setup/common.sh@33 -- # return 0 00:02:44.163 15:26:35 -- setup/hugepages.sh@100 -- # resv=0 00:02:44.163 15:26:35 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:44.163 nr_hugepages=1024 00:02:44.163 15:26:35 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:44.163 resv_hugepages=0 00:02:44.163 15:26:35 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:44.163 surplus_hugepages=0 00:02:44.163 15:26:35 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:44.163 anon_hugepages=0 00:02:44.163 15:26:35 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:44.163 15:26:35 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:44.163 15:26:35 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:44.163 15:26:35 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:44.163 15:26:35 -- setup/common.sh@18 -- # local node= 00:02:44.163 15:26:35 -- setup/common.sh@19 -- # local var val 00:02:44.163 15:26:35 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.163 15:26:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.163 15:26:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:44.163 15:26:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:44.163 15:26:35 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.163 15:26:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45214344 kB' 'MemAvailable: 48990924 kB' 'Buffers: 2708 kB' 'Cached: 10677896 kB' 'SwapCached: 0 kB' 'Active: 7416380 kB' 'Inactive: 3766568 kB' 'Active(anon): 7014236 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505592 kB' 'Mapped: 204552 kB' 'Shmem: 6511892 kB' 'KReclaimable: 203384 kB' 'Slab: 773848 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570464 kB' 'KernelStack: 12880 kB' 'PageTables: 8312 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8092928 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198876 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.163 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.163 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.164 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.164 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.165 15:26:35 -- setup/common.sh@33 -- # echo 1024 00:02:44.165 15:26:35 -- setup/common.sh@33 -- # return 0 00:02:44.165 15:26:35 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:44.165 15:26:35 -- setup/hugepages.sh@112 -- # get_nodes 00:02:44.165 15:26:35 -- setup/hugepages.sh@27 -- # local node 00:02:44.165 15:26:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:44.165 15:26:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:44.165 15:26:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:44.165 15:26:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:44.165 15:26:35 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:44.165 15:26:35 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:44.165 15:26:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:44.165 15:26:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:44.165 15:26:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:44.165 15:26:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:44.165 15:26:35 -- setup/common.sh@18 -- # local node=0 00:02:44.165 15:26:35 -- setup/common.sh@19 -- # local var val 00:02:44.165 15:26:35 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.165 15:26:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.165 15:26:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:44.165 15:26:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:44.165 15:26:35 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.165 15:26:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 26965156 kB' 'MemUsed: 5909768 kB' 'SwapCached: 0 kB' 'Active: 2327000 kB' 'Inactive: 228000 kB' 'Active(anon): 2153404 kB' 'Inactive(anon): 0 kB' 'Active(file): 173596 kB' 'Inactive(file): 228000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2439364 kB' 'Mapped: 73136 kB' 'AnonPages: 118820 kB' 'Shmem: 2037768 kB' 'KernelStack: 7240 kB' 'PageTables: 3936 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 91120 kB' 'Slab: 405960 kB' 'SReclaimable: 91120 kB' 'SUnreclaim: 314840 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.165 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.165 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.166 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.166 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.424 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.424 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.424 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.424 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.424 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.424 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.424 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.424 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.424 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.424 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.424 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.424 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # continue 00:02:44.424 15:26:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.424 15:26:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.424 15:26:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.424 15:26:35 -- setup/common.sh@33 -- # echo 0 00:02:44.424 15:26:35 -- setup/common.sh@33 -- # return 0 00:02:44.424 15:26:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:44.424 15:26:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:44.424 15:26:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:44.424 15:26:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:44.424 15:26:35 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:44.424 node0=1024 expecting 1024 00:02:44.424 15:26:35 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:44.424 00:02:44.424 real 0m2.387s 00:02:44.424 user 0m0.639s 00:02:44.424 sys 0m0.862s 00:02:44.424 15:26:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:44.424 15:26:35 -- common/autotest_common.sh@10 -- # set +x 00:02:44.424 ************************************ 00:02:44.424 END TEST default_setup 00:02:44.424 ************************************ 00:02:44.424 15:26:35 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:02:44.424 15:26:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:44.424 15:26:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:44.424 15:26:35 -- common/autotest_common.sh@10 -- # set +x 00:02:44.424 ************************************ 00:02:44.424 START TEST per_node_1G_alloc 00:02:44.424 ************************************ 00:02:44.424 15:26:35 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:02:44.424 15:26:35 -- setup/hugepages.sh@143 -- # local IFS=, 00:02:44.424 15:26:35 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:02:44.424 15:26:35 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:44.424 15:26:35 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:02:44.424 15:26:35 -- setup/hugepages.sh@51 -- # shift 00:02:44.424 15:26:35 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:02:44.424 15:26:35 -- setup/hugepages.sh@52 -- # local node_ids 00:02:44.424 15:26:35 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:44.424 15:26:35 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:44.424 15:26:35 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:02:44.424 15:26:35 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:02:44.424 15:26:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:44.424 15:26:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:44.424 15:26:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:44.424 15:26:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:44.424 15:26:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:44.424 15:26:35 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:02:44.424 15:26:35 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:44.424 15:26:35 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:44.424 15:26:35 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:44.425 15:26:35 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:44.425 15:26:35 -- setup/hugepages.sh@73 -- # return 0 00:02:44.425 15:26:35 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:02:44.425 15:26:35 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:02:44.425 15:26:35 -- setup/hugepages.sh@146 -- # setup output 00:02:44.425 15:26:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:44.425 15:26:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:45.802 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:45.802 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:45.802 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:45.802 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:45.802 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:45.802 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:45.802 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:45.802 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:45.802 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:45.802 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:45.802 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:45.802 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:45.802 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:45.802 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:45.802 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:45.802 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:45.802 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:45.802 15:26:37 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:02:45.802 15:26:37 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:02:45.802 15:26:37 -- setup/hugepages.sh@89 -- # local node 00:02:45.802 15:26:37 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:45.802 15:26:37 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:45.802 15:26:37 -- setup/hugepages.sh@92 -- # local surp 00:02:45.802 15:26:37 -- setup/hugepages.sh@93 -- # local resv 00:02:45.802 15:26:37 -- setup/hugepages.sh@94 -- # local anon 00:02:45.802 15:26:37 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:45.802 15:26:37 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:45.802 15:26:37 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:45.802 15:26:37 -- setup/common.sh@18 -- # local node= 00:02:45.802 15:26:37 -- setup/common.sh@19 -- # local var val 00:02:45.802 15:26:37 -- setup/common.sh@20 -- # local mem_f mem 00:02:45.802 15:26:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:45.802 15:26:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:45.802 15:26:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:45.802 15:26:37 -- setup/common.sh@28 -- # mapfile -t mem 00:02:45.802 15:26:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45186076 kB' 'MemAvailable: 48962656 kB' 'Buffers: 2708 kB' 'Cached: 10677952 kB' 'SwapCached: 0 kB' 'Active: 7416516 kB' 'Inactive: 3766568 kB' 'Active(anon): 7014372 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505512 kB' 'Mapped: 204584 kB' 'Shmem: 6511948 kB' 'KReclaimable: 203384 kB' 'Slab: 773908 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570524 kB' 'KernelStack: 12864 kB' 'PageTables: 8220 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8093100 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198972 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.802 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.802 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.803 15:26:37 -- setup/common.sh@33 -- # echo 0 00:02:45.803 15:26:37 -- setup/common.sh@33 -- # return 0 00:02:45.803 15:26:37 -- setup/hugepages.sh@97 -- # anon=0 00:02:45.803 15:26:37 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:45.803 15:26:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:45.803 15:26:37 -- setup/common.sh@18 -- # local node= 00:02:45.803 15:26:37 -- setup/common.sh@19 -- # local var val 00:02:45.803 15:26:37 -- setup/common.sh@20 -- # local mem_f mem 00:02:45.803 15:26:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:45.803 15:26:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:45.803 15:26:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:45.803 15:26:37 -- setup/common.sh@28 -- # mapfile -t mem 00:02:45.803 15:26:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45191848 kB' 'MemAvailable: 48968428 kB' 'Buffers: 2708 kB' 'Cached: 10677952 kB' 'SwapCached: 0 kB' 'Active: 7416596 kB' 'Inactive: 3766568 kB' 'Active(anon): 7014452 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505648 kB' 'Mapped: 204640 kB' 'Shmem: 6511948 kB' 'KReclaimable: 203384 kB' 'Slab: 773972 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570588 kB' 'KernelStack: 12928 kB' 'PageTables: 8436 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8093112 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198956 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.803 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.803 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.804 15:26:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.804 15:26:37 -- setup/common.sh@33 -- # echo 0 00:02:45.804 15:26:37 -- setup/common.sh@33 -- # return 0 00:02:45.804 15:26:37 -- setup/hugepages.sh@99 -- # surp=0 00:02:45.804 15:26:37 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:45.804 15:26:37 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:45.804 15:26:37 -- setup/common.sh@18 -- # local node= 00:02:45.804 15:26:37 -- setup/common.sh@19 -- # local var val 00:02:45.804 15:26:37 -- setup/common.sh@20 -- # local mem_f mem 00:02:45.804 15:26:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:45.804 15:26:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:45.804 15:26:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:45.804 15:26:37 -- setup/common.sh@28 -- # mapfile -t mem 00:02:45.804 15:26:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.804 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45191060 kB' 'MemAvailable: 48967640 kB' 'Buffers: 2708 kB' 'Cached: 10677964 kB' 'SwapCached: 0 kB' 'Active: 7416728 kB' 'Inactive: 3766568 kB' 'Active(anon): 7014584 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505800 kB' 'Mapped: 204640 kB' 'Shmem: 6511960 kB' 'KReclaimable: 203384 kB' 'Slab: 773952 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570568 kB' 'KernelStack: 12896 kB' 'PageTables: 8320 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8093124 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198924 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.805 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.805 15:26:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.806 15:26:37 -- setup/common.sh@33 -- # echo 0 00:02:45.806 15:26:37 -- setup/common.sh@33 -- # return 0 00:02:45.806 15:26:37 -- setup/hugepages.sh@100 -- # resv=0 00:02:45.806 15:26:37 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:45.806 nr_hugepages=1024 00:02:45.806 15:26:37 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:45.806 resv_hugepages=0 00:02:45.806 15:26:37 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:45.806 surplus_hugepages=0 00:02:45.806 15:26:37 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:45.806 anon_hugepages=0 00:02:45.806 15:26:37 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:45.806 15:26:37 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:45.806 15:26:37 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:45.806 15:26:37 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:45.806 15:26:37 -- setup/common.sh@18 -- # local node= 00:02:45.806 15:26:37 -- setup/common.sh@19 -- # local var val 00:02:45.806 15:26:37 -- setup/common.sh@20 -- # local mem_f mem 00:02:45.806 15:26:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:45.806 15:26:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:45.806 15:26:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:45.806 15:26:37 -- setup/common.sh@28 -- # mapfile -t mem 00:02:45.806 15:26:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45191792 kB' 'MemAvailable: 48968372 kB' 'Buffers: 2708 kB' 'Cached: 10677968 kB' 'SwapCached: 0 kB' 'Active: 7415992 kB' 'Inactive: 3766568 kB' 'Active(anon): 7013848 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505036 kB' 'Mapped: 204564 kB' 'Shmem: 6511964 kB' 'KReclaimable: 203384 kB' 'Slab: 773908 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570524 kB' 'KernelStack: 12880 kB' 'PageTables: 8268 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8093140 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198924 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.806 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.806 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.807 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.807 15:26:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.807 15:26:37 -- setup/common.sh@33 -- # echo 1024 00:02:45.807 15:26:37 -- setup/common.sh@33 -- # return 0 00:02:45.807 15:26:37 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:45.807 15:26:37 -- setup/hugepages.sh@112 -- # get_nodes 00:02:45.807 15:26:37 -- setup/hugepages.sh@27 -- # local node 00:02:45.807 15:26:37 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:45.807 15:26:37 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:45.807 15:26:37 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:45.807 15:26:37 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:45.807 15:26:37 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:45.807 15:26:37 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:45.807 15:26:37 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:45.807 15:26:37 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:45.807 15:26:37 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:45.807 15:26:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:45.807 15:26:37 -- setup/common.sh@18 -- # local node=0 00:02:45.807 15:26:37 -- setup/common.sh@19 -- # local var val 00:02:45.807 15:26:37 -- setup/common.sh@20 -- # local mem_f mem 00:02:45.807 15:26:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:45.807 15:26:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:45.807 15:26:37 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:45.808 15:26:37 -- setup/common.sh@28 -- # mapfile -t mem 00:02:45.808 15:26:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28010808 kB' 'MemUsed: 4864116 kB' 'SwapCached: 0 kB' 'Active: 2327500 kB' 'Inactive: 228000 kB' 'Active(anon): 2153904 kB' 'Inactive(anon): 0 kB' 'Active(file): 173596 kB' 'Inactive(file): 228000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2439452 kB' 'Mapped: 73136 kB' 'AnonPages: 119204 kB' 'Shmem: 2037856 kB' 'KernelStack: 7240 kB' 'PageTables: 3984 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 91120 kB' 'Slab: 405968 kB' 'SReclaimable: 91120 kB' 'SUnreclaim: 314848 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.808 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.808 15:26:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.808 15:26:37 -- setup/common.sh@33 -- # echo 0 00:02:45.808 15:26:37 -- setup/common.sh@33 -- # return 0 00:02:45.808 15:26:37 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:45.808 15:26:37 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:45.809 15:26:37 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:45.809 15:26:37 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:45.809 15:26:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:45.809 15:26:37 -- setup/common.sh@18 -- # local node=1 00:02:45.809 15:26:37 -- setup/common.sh@19 -- # local var val 00:02:45.809 15:26:37 -- setup/common.sh@20 -- # local mem_f mem 00:02:45.809 15:26:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:45.809 15:26:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:45.809 15:26:37 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:45.809 15:26:37 -- setup/common.sh@28 -- # mapfile -t mem 00:02:45.809 15:26:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 17181192 kB' 'MemUsed: 10479544 kB' 'SwapCached: 0 kB' 'Active: 5088788 kB' 'Inactive: 3538568 kB' 'Active(anon): 4860240 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3538568 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8241256 kB' 'Mapped: 131428 kB' 'AnonPages: 386100 kB' 'Shmem: 4474140 kB' 'KernelStack: 5624 kB' 'PageTables: 4236 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112264 kB' 'Slab: 367940 kB' 'SReclaimable: 112264 kB' 'SUnreclaim: 255676 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.809 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.809 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.810 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.810 15:26:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.810 15:26:37 -- setup/common.sh@32 -- # continue 00:02:45.810 15:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.810 15:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.810 15:26:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.810 15:26:37 -- setup/common.sh@33 -- # echo 0 00:02:45.810 15:26:37 -- setup/common.sh@33 -- # return 0 00:02:45.810 15:26:37 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:45.810 15:26:37 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:45.810 15:26:37 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:45.810 15:26:37 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:45.810 15:26:37 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:45.810 node0=512 expecting 512 00:02:45.810 15:26:37 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:45.810 15:26:37 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:45.810 15:26:37 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:45.810 15:26:37 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:45.810 node1=512 expecting 512 00:02:45.810 15:26:37 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:45.810 00:02:45.810 real 0m1.532s 00:02:45.810 user 0m0.633s 00:02:45.810 sys 0m0.866s 00:02:45.810 15:26:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:45.810 15:26:37 -- common/autotest_common.sh@10 -- # set +x 00:02:45.810 ************************************ 00:02:45.810 END TEST per_node_1G_alloc 00:02:45.810 ************************************ 00:02:45.810 15:26:37 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:02:45.810 15:26:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:45.810 15:26:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:45.810 15:26:37 -- common/autotest_common.sh@10 -- # set +x 00:02:45.810 ************************************ 00:02:45.810 START TEST even_2G_alloc 00:02:45.810 ************************************ 00:02:45.810 15:26:37 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:02:45.810 15:26:37 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:02:45.810 15:26:37 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:45.810 15:26:37 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:45.810 15:26:37 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:45.810 15:26:37 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:45.810 15:26:37 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:45.810 15:26:37 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:45.810 15:26:37 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:45.810 15:26:37 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:45.810 15:26:37 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:45.810 15:26:37 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:45.810 15:26:37 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:45.810 15:26:37 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:45.810 15:26:37 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:45.810 15:26:37 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:45.810 15:26:37 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:45.810 15:26:37 -- setup/hugepages.sh@83 -- # : 512 00:02:45.810 15:26:37 -- setup/hugepages.sh@84 -- # : 1 00:02:45.810 15:26:37 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:45.810 15:26:37 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:45.810 15:26:37 -- setup/hugepages.sh@83 -- # : 0 00:02:45.810 15:26:37 -- setup/hugepages.sh@84 -- # : 0 00:02:45.810 15:26:37 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:45.810 15:26:37 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:02:45.810 15:26:37 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:02:45.810 15:26:37 -- setup/hugepages.sh@153 -- # setup output 00:02:45.810 15:26:37 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:45.810 15:26:37 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:47.189 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:47.189 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:47.189 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:47.189 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:47.189 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:47.189 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:47.189 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:47.189 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:47.189 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:47.189 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:47.189 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:47.189 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:47.189 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:47.189 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:47.189 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:47.189 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:47.189 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:47.189 15:26:38 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:02:47.189 15:26:38 -- setup/hugepages.sh@89 -- # local node 00:02:47.189 15:26:38 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:47.189 15:26:38 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:47.189 15:26:38 -- setup/hugepages.sh@92 -- # local surp 00:02:47.189 15:26:38 -- setup/hugepages.sh@93 -- # local resv 00:02:47.189 15:26:38 -- setup/hugepages.sh@94 -- # local anon 00:02:47.189 15:26:38 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:47.189 15:26:38 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:47.189 15:26:38 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:47.189 15:26:38 -- setup/common.sh@18 -- # local node= 00:02:47.189 15:26:38 -- setup/common.sh@19 -- # local var val 00:02:47.189 15:26:38 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.189 15:26:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.189 15:26:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.189 15:26:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.189 15:26:38 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.189 15:26:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.189 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.189 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.189 15:26:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45179716 kB' 'MemAvailable: 48956296 kB' 'Buffers: 2708 kB' 'Cached: 10678048 kB' 'SwapCached: 0 kB' 'Active: 7416752 kB' 'Inactive: 3766568 kB' 'Active(anon): 7014608 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505868 kB' 'Mapped: 204580 kB' 'Shmem: 6512044 kB' 'KReclaimable: 203384 kB' 'Slab: 773840 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570456 kB' 'KernelStack: 12880 kB' 'PageTables: 8268 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8093328 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198924 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:47.189 15:26:38 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.189 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.189 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.189 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.189 15:26:38 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.189 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.190 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.190 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.191 15:26:38 -- setup/common.sh@33 -- # echo 0 00:02:47.191 15:26:38 -- setup/common.sh@33 -- # return 0 00:02:47.191 15:26:38 -- setup/hugepages.sh@97 -- # anon=0 00:02:47.191 15:26:38 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:47.191 15:26:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:47.191 15:26:38 -- setup/common.sh@18 -- # local node= 00:02:47.191 15:26:38 -- setup/common.sh@19 -- # local var val 00:02:47.191 15:26:38 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.191 15:26:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.191 15:26:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.191 15:26:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.191 15:26:38 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.191 15:26:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45186460 kB' 'MemAvailable: 48963040 kB' 'Buffers: 2708 kB' 'Cached: 10678052 kB' 'SwapCached: 0 kB' 'Active: 7416628 kB' 'Inactive: 3766568 kB' 'Active(anon): 7014484 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505716 kB' 'Mapped: 204532 kB' 'Shmem: 6512048 kB' 'KReclaimable: 203384 kB' 'Slab: 773848 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570464 kB' 'KernelStack: 12800 kB' 'PageTables: 7952 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8093340 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198844 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.191 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.191 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.192 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.192 15:26:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.193 15:26:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.193 15:26:38 -- setup/common.sh@33 -- # echo 0 00:02:47.193 15:26:38 -- setup/common.sh@33 -- # return 0 00:02:47.193 15:26:38 -- setup/hugepages.sh@99 -- # surp=0 00:02:47.193 15:26:38 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:47.193 15:26:38 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:47.193 15:26:38 -- setup/common.sh@18 -- # local node= 00:02:47.193 15:26:38 -- setup/common.sh@19 -- # local var val 00:02:47.193 15:26:38 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.193 15:26:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.193 15:26:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.193 15:26:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.193 15:26:38 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.193 15:26:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.193 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.194 15:26:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45186532 kB' 'MemAvailable: 48963112 kB' 'Buffers: 2708 kB' 'Cached: 10678052 kB' 'SwapCached: 0 kB' 'Active: 7416956 kB' 'Inactive: 3766568 kB' 'Active(anon): 7014812 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 506000 kB' 'Mapped: 204524 kB' 'Shmem: 6512048 kB' 'KReclaimable: 203384 kB' 'Slab: 773848 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570464 kB' 'KernelStack: 12816 kB' 'PageTables: 7996 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8093356 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198844 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.194 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.194 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.195 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.195 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.196 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.196 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.197 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.197 15:26:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.198 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.198 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.199 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.199 15:26:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.199 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.199 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.199 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.199 15:26:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.199 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.199 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.199 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.199 15:26:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.199 15:26:38 -- setup/common.sh@33 -- # echo 0 00:02:47.199 15:26:38 -- setup/common.sh@33 -- # return 0 00:02:47.199 15:26:38 -- setup/hugepages.sh@100 -- # resv=0 00:02:47.199 15:26:38 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:47.199 nr_hugepages=1024 00:02:47.199 15:26:38 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:47.199 resv_hugepages=0 00:02:47.199 15:26:38 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:47.199 surplus_hugepages=0 00:02:47.199 15:26:38 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:47.199 anon_hugepages=0 00:02:47.199 15:26:38 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:47.199 15:26:38 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:47.199 15:26:38 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:47.199 15:26:38 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:47.199 15:26:38 -- setup/common.sh@18 -- # local node= 00:02:47.199 15:26:38 -- setup/common.sh@19 -- # local var val 00:02:47.199 15:26:38 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.199 15:26:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.199 15:26:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.199 15:26:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.199 15:26:38 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.199 15:26:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.199 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.199 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.200 15:26:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45186280 kB' 'MemAvailable: 48962860 kB' 'Buffers: 2708 kB' 'Cached: 10678076 kB' 'SwapCached: 0 kB' 'Active: 7416460 kB' 'Inactive: 3766568 kB' 'Active(anon): 7014316 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505496 kB' 'Mapped: 204572 kB' 'Shmem: 6512072 kB' 'KReclaimable: 203384 kB' 'Slab: 773912 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570528 kB' 'KernelStack: 12896 kB' 'PageTables: 8256 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8093368 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198860 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:47.200 15:26:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.200 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.200 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.200 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.200 15:26:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.200 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.200 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.200 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.200 15:26:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.200 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.200 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.200 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.200 15:26:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.200 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.200 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.200 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.200 15:26:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.200 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.200 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.200 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.200 15:26:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.201 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.201 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.201 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.201 15:26:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.201 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.201 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.201 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.201 15:26:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.201 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.201 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.201 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.201 15:26:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.201 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.201 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.201 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.201 15:26:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.201 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.201 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.201 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.201 15:26:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.201 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.201 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.201 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.201 15:26:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.201 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.201 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.201 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.202 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.202 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.203 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.203 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.204 15:26:38 -- setup/common.sh@33 -- # echo 1024 00:02:47.204 15:26:38 -- setup/common.sh@33 -- # return 0 00:02:47.204 15:26:38 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:47.204 15:26:38 -- setup/hugepages.sh@112 -- # get_nodes 00:02:47.204 15:26:38 -- setup/hugepages.sh@27 -- # local node 00:02:47.204 15:26:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:47.204 15:26:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:47.204 15:26:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:47.204 15:26:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:47.204 15:26:38 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:47.204 15:26:38 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:47.204 15:26:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:47.204 15:26:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:47.204 15:26:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:47.204 15:26:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:47.204 15:26:38 -- setup/common.sh@18 -- # local node=0 00:02:47.204 15:26:38 -- setup/common.sh@19 -- # local var val 00:02:47.204 15:26:38 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.204 15:26:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.204 15:26:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:47.204 15:26:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:47.204 15:26:38 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.204 15:26:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28016264 kB' 'MemUsed: 4858660 kB' 'SwapCached: 0 kB' 'Active: 2327712 kB' 'Inactive: 228000 kB' 'Active(anon): 2154116 kB' 'Inactive(anon): 0 kB' 'Active(file): 173596 kB' 'Inactive(file): 228000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2439536 kB' 'Mapped: 73136 kB' 'AnonPages: 119408 kB' 'Shmem: 2037940 kB' 'KernelStack: 7272 kB' 'PageTables: 4024 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 91120 kB' 'Slab: 406044 kB' 'SReclaimable: 91120 kB' 'SUnreclaim: 314924 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.204 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.204 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@33 -- # echo 0 00:02:47.205 15:26:38 -- setup/common.sh@33 -- # return 0 00:02:47.205 15:26:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:47.205 15:26:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:47.205 15:26:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:47.205 15:26:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:47.205 15:26:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:47.205 15:26:38 -- setup/common.sh@18 -- # local node=1 00:02:47.205 15:26:38 -- setup/common.sh@19 -- # local var val 00:02:47.205 15:26:38 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.205 15:26:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.205 15:26:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:47.205 15:26:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:47.205 15:26:38 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.205 15:26:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 17171372 kB' 'MemUsed: 10489364 kB' 'SwapCached: 0 kB' 'Active: 5088720 kB' 'Inactive: 3538568 kB' 'Active(anon): 4860172 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3538568 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8241264 kB' 'Mapped: 131436 kB' 'AnonPages: 386084 kB' 'Shmem: 4474148 kB' 'KernelStack: 5624 kB' 'PageTables: 4232 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112264 kB' 'Slab: 367868 kB' 'SReclaimable: 112264 kB' 'SUnreclaim: 255604 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.205 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.205 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.464 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.464 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.464 15:26:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.464 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.464 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.464 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.464 15:26:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.464 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.464 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.464 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.464 15:26:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.464 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.464 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.464 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.464 15:26:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # continue 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.465 15:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.465 15:26:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.465 15:26:38 -- setup/common.sh@33 -- # echo 0 00:02:47.465 15:26:38 -- setup/common.sh@33 -- # return 0 00:02:47.465 15:26:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:47.465 15:26:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:47.465 15:26:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:47.465 15:26:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:47.465 15:26:38 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:47.465 node0=512 expecting 512 00:02:47.465 15:26:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:47.465 15:26:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:47.465 15:26:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:47.465 15:26:38 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:47.465 node1=512 expecting 512 00:02:47.465 15:26:38 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:47.465 00:02:47.465 real 0m1.460s 00:02:47.465 user 0m0.624s 00:02:47.465 sys 0m0.801s 00:02:47.465 15:26:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:47.465 15:26:38 -- common/autotest_common.sh@10 -- # set +x 00:02:47.465 ************************************ 00:02:47.465 END TEST even_2G_alloc 00:02:47.465 ************************************ 00:02:47.465 15:26:38 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:02:47.465 15:26:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:47.465 15:26:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:47.465 15:26:38 -- common/autotest_common.sh@10 -- # set +x 00:02:47.465 ************************************ 00:02:47.465 START TEST odd_alloc 00:02:47.465 ************************************ 00:02:47.465 15:26:38 -- common/autotest_common.sh@1114 -- # odd_alloc 00:02:47.465 15:26:38 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:02:47.465 15:26:38 -- setup/hugepages.sh@49 -- # local size=2098176 00:02:47.465 15:26:38 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:47.465 15:26:38 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:47.465 15:26:38 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:02:47.465 15:26:38 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:47.465 15:26:38 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:47.465 15:26:38 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:47.465 15:26:38 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:02:47.465 15:26:38 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:47.465 15:26:38 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:47.465 15:26:38 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:47.465 15:26:38 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:47.465 15:26:38 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:47.465 15:26:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:47.465 15:26:38 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:47.465 15:26:38 -- setup/hugepages.sh@83 -- # : 513 00:02:47.465 15:26:38 -- setup/hugepages.sh@84 -- # : 1 00:02:47.465 15:26:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:47.465 15:26:38 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:02:47.465 15:26:38 -- setup/hugepages.sh@83 -- # : 0 00:02:47.465 15:26:38 -- setup/hugepages.sh@84 -- # : 0 00:02:47.465 15:26:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:47.465 15:26:38 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:02:47.465 15:26:38 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:02:47.465 15:26:38 -- setup/hugepages.sh@160 -- # setup output 00:02:47.465 15:26:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:47.466 15:26:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:48.399 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:48.399 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:48.399 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:48.399 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:48.399 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:48.399 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:48.399 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:48.399 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:48.399 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:48.399 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:48.399 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:48.399 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:48.399 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:48.399 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:48.399 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:48.399 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:48.399 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:48.663 15:26:39 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:02:48.663 15:26:39 -- setup/hugepages.sh@89 -- # local node 00:02:48.663 15:26:39 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:48.663 15:26:39 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:48.663 15:26:39 -- setup/hugepages.sh@92 -- # local surp 00:02:48.663 15:26:39 -- setup/hugepages.sh@93 -- # local resv 00:02:48.663 15:26:39 -- setup/hugepages.sh@94 -- # local anon 00:02:48.663 15:26:39 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:48.663 15:26:39 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:48.663 15:26:39 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:48.663 15:26:39 -- setup/common.sh@18 -- # local node= 00:02:48.663 15:26:39 -- setup/common.sh@19 -- # local var val 00:02:48.663 15:26:39 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.663 15:26:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.663 15:26:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.663 15:26:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.663 15:26:39 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.663 15:26:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.663 15:26:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45183392 kB' 'MemAvailable: 48959972 kB' 'Buffers: 2708 kB' 'Cached: 10678136 kB' 'SwapCached: 0 kB' 'Active: 7416752 kB' 'Inactive: 3766568 kB' 'Active(anon): 7014608 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505664 kB' 'Mapped: 203508 kB' 'Shmem: 6512132 kB' 'KReclaimable: 203384 kB' 'Slab: 773680 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570296 kB' 'KernelStack: 13168 kB' 'PageTables: 8056 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8081444 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199132 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.663 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.663 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.664 15:26:39 -- setup/common.sh@33 -- # echo 0 00:02:48.664 15:26:39 -- setup/common.sh@33 -- # return 0 00:02:48.664 15:26:39 -- setup/hugepages.sh@97 -- # anon=0 00:02:48.664 15:26:39 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:48.664 15:26:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:48.664 15:26:39 -- setup/common.sh@18 -- # local node= 00:02:48.664 15:26:39 -- setup/common.sh@19 -- # local var val 00:02:48.664 15:26:39 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.664 15:26:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.664 15:26:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.664 15:26:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.664 15:26:39 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.664 15:26:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45185068 kB' 'MemAvailable: 48961648 kB' 'Buffers: 2708 kB' 'Cached: 10678136 kB' 'SwapCached: 0 kB' 'Active: 7416020 kB' 'Inactive: 3766568 kB' 'Active(anon): 7013876 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504828 kB' 'Mapped: 203544 kB' 'Shmem: 6512132 kB' 'KReclaimable: 203384 kB' 'Slab: 773712 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570328 kB' 'KernelStack: 13184 kB' 'PageTables: 8700 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8082836 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199100 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.664 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.664 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.665 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.665 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.666 15:26:39 -- setup/common.sh@33 -- # echo 0 00:02:48.666 15:26:39 -- setup/common.sh@33 -- # return 0 00:02:48.666 15:26:39 -- setup/hugepages.sh@99 -- # surp=0 00:02:48.666 15:26:39 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:48.666 15:26:39 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:48.666 15:26:39 -- setup/common.sh@18 -- # local node= 00:02:48.666 15:26:39 -- setup/common.sh@19 -- # local var val 00:02:48.666 15:26:39 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.666 15:26:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.666 15:26:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.666 15:26:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.666 15:26:39 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.666 15:26:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45182684 kB' 'MemAvailable: 48959264 kB' 'Buffers: 2708 kB' 'Cached: 10678152 kB' 'SwapCached: 0 kB' 'Active: 7416452 kB' 'Inactive: 3766568 kB' 'Active(anon): 7014308 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505296 kB' 'Mapped: 203544 kB' 'Shmem: 6512148 kB' 'KReclaimable: 203384 kB' 'Slab: 773712 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570328 kB' 'KernelStack: 13248 kB' 'PageTables: 8564 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8078824 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199116 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.666 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.666 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.666 15:26:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.666 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.667 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.667 15:26:40 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.667 15:26:40 -- setup/common.sh@33 -- # echo 0 00:02:48.667 15:26:40 -- setup/common.sh@33 -- # return 0 00:02:48.667 15:26:40 -- setup/hugepages.sh@100 -- # resv=0 00:02:48.667 15:26:40 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:02:48.667 nr_hugepages=1025 00:02:48.667 15:26:40 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:48.667 resv_hugepages=0 00:02:48.667 15:26:40 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:48.667 surplus_hugepages=0 00:02:48.667 15:26:40 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:48.667 anon_hugepages=0 00:02:48.667 15:26:40 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:48.667 15:26:40 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:02:48.667 15:26:40 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:48.667 15:26:40 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:48.668 15:26:40 -- setup/common.sh@18 -- # local node= 00:02:48.668 15:26:40 -- setup/common.sh@19 -- # local var val 00:02:48.668 15:26:40 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.668 15:26:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.668 15:26:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.668 15:26:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.668 15:26:40 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.668 15:26:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45185708 kB' 'MemAvailable: 48962288 kB' 'Buffers: 2708 kB' 'Cached: 10678164 kB' 'SwapCached: 0 kB' 'Active: 7414840 kB' 'Inactive: 3766568 kB' 'Active(anon): 7012696 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503836 kB' 'Mapped: 203544 kB' 'Shmem: 6512160 kB' 'KReclaimable: 203384 kB' 'Slab: 773820 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570436 kB' 'KernelStack: 12928 kB' 'PageTables: 7956 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8078836 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198924 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.668 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.668 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.669 15:26:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.669 15:26:40 -- setup/common.sh@33 -- # echo 1025 00:02:48.669 15:26:40 -- setup/common.sh@33 -- # return 0 00:02:48.669 15:26:40 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:48.669 15:26:40 -- setup/hugepages.sh@112 -- # get_nodes 00:02:48.669 15:26:40 -- setup/hugepages.sh@27 -- # local node 00:02:48.669 15:26:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:48.669 15:26:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:48.669 15:26:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:48.669 15:26:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:02:48.669 15:26:40 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:48.669 15:26:40 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:48.669 15:26:40 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:48.669 15:26:40 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:48.669 15:26:40 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:48.669 15:26:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:48.669 15:26:40 -- setup/common.sh@18 -- # local node=0 00:02:48.669 15:26:40 -- setup/common.sh@19 -- # local var val 00:02:48.669 15:26:40 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.669 15:26:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.669 15:26:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:48.669 15:26:40 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:48.669 15:26:40 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.669 15:26:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.669 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28014644 kB' 'MemUsed: 4860280 kB' 'SwapCached: 0 kB' 'Active: 2326224 kB' 'Inactive: 228000 kB' 'Active(anon): 2152628 kB' 'Inactive(anon): 0 kB' 'Active(file): 173596 kB' 'Inactive(file): 228000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2439572 kB' 'Mapped: 72396 kB' 'AnonPages: 117916 kB' 'Shmem: 2037976 kB' 'KernelStack: 7208 kB' 'PageTables: 3620 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 91120 kB' 'Slab: 405940 kB' 'SReclaimable: 91120 kB' 'SUnreclaim: 314820 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.670 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.670 15:26:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.670 15:26:40 -- setup/common.sh@33 -- # echo 0 00:02:48.670 15:26:40 -- setup/common.sh@33 -- # return 0 00:02:48.670 15:26:40 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:48.670 15:26:40 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:48.670 15:26:40 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:48.670 15:26:40 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:48.670 15:26:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:48.670 15:26:40 -- setup/common.sh@18 -- # local node=1 00:02:48.670 15:26:40 -- setup/common.sh@19 -- # local var val 00:02:48.671 15:26:40 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.671 15:26:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.671 15:26:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:48.671 15:26:40 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:48.671 15:26:40 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.671 15:26:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 17172804 kB' 'MemUsed: 10487932 kB' 'SwapCached: 0 kB' 'Active: 5088900 kB' 'Inactive: 3538568 kB' 'Active(anon): 4860352 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3538568 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8241312 kB' 'Mapped: 131148 kB' 'AnonPages: 386356 kB' 'Shmem: 4474196 kB' 'KernelStack: 5640 kB' 'PageTables: 4272 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112264 kB' 'Slab: 367840 kB' 'SReclaimable: 112264 kB' 'SUnreclaim: 255576 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.671 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.671 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.672 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.672 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.672 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.672 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.672 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.672 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.672 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.672 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.672 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.672 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.672 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.672 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # continue 00:02:48.672 15:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.672 15:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.672 15:26:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.672 15:26:40 -- setup/common.sh@33 -- # echo 0 00:02:48.672 15:26:40 -- setup/common.sh@33 -- # return 0 00:02:48.672 15:26:40 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:48.672 15:26:40 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:48.672 15:26:40 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:48.672 15:26:40 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:48.672 15:26:40 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:02:48.672 node0=512 expecting 513 00:02:48.672 15:26:40 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:48.672 15:26:40 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:48.672 15:26:40 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:48.672 15:26:40 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:02:48.672 node1=513 expecting 512 00:02:48.672 15:26:40 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:02:48.672 00:02:48.672 real 0m1.407s 00:02:48.672 user 0m0.597s 00:02:48.672 sys 0m0.767s 00:02:48.672 15:26:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:48.672 15:26:40 -- common/autotest_common.sh@10 -- # set +x 00:02:48.672 ************************************ 00:02:48.672 END TEST odd_alloc 00:02:48.672 ************************************ 00:02:48.672 15:26:40 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:02:48.672 15:26:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:48.672 15:26:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:48.672 15:26:40 -- common/autotest_common.sh@10 -- # set +x 00:02:48.931 ************************************ 00:02:48.931 START TEST custom_alloc 00:02:48.931 ************************************ 00:02:48.931 15:26:40 -- common/autotest_common.sh@1114 -- # custom_alloc 00:02:48.931 15:26:40 -- setup/hugepages.sh@167 -- # local IFS=, 00:02:48.931 15:26:40 -- setup/hugepages.sh@169 -- # local node 00:02:48.931 15:26:40 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:02:48.931 15:26:40 -- setup/hugepages.sh@170 -- # local nodes_hp 00:02:48.931 15:26:40 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:02:48.931 15:26:40 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:02:48.931 15:26:40 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:48.931 15:26:40 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:48.931 15:26:40 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:48.931 15:26:40 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:48.931 15:26:40 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:48.931 15:26:40 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:48.931 15:26:40 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:48.931 15:26:40 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:48.931 15:26:40 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:48.931 15:26:40 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:48.931 15:26:40 -- setup/hugepages.sh@83 -- # : 256 00:02:48.931 15:26:40 -- setup/hugepages.sh@84 -- # : 1 00:02:48.931 15:26:40 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:48.931 15:26:40 -- setup/hugepages.sh@83 -- # : 0 00:02:48.931 15:26:40 -- setup/hugepages.sh@84 -- # : 0 00:02:48.931 15:26:40 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:02:48.931 15:26:40 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:02:48.931 15:26:40 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:48.931 15:26:40 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:48.931 15:26:40 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:48.931 15:26:40 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:48.931 15:26:40 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:48.931 15:26:40 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:48.931 15:26:40 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:48.931 15:26:40 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:48.931 15:26:40 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:48.931 15:26:40 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:48.931 15:26:40 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:48.931 15:26:40 -- setup/hugepages.sh@78 -- # return 0 00:02:48.931 15:26:40 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:02:48.931 15:26:40 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:48.931 15:26:40 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:48.931 15:26:40 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:48.931 15:26:40 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:48.931 15:26:40 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:02:48.931 15:26:40 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:48.931 15:26:40 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:48.931 15:26:40 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:48.931 15:26:40 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:48.931 15:26:40 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:48.931 15:26:40 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:48.931 15:26:40 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:02:48.931 15:26:40 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:48.931 15:26:40 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:48.931 15:26:40 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:48.931 15:26:40 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:02:48.931 15:26:40 -- setup/hugepages.sh@78 -- # return 0 00:02:48.931 15:26:40 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:02:48.931 15:26:40 -- setup/hugepages.sh@187 -- # setup output 00:02:48.931 15:26:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:48.931 15:26:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:49.866 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:49.866 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:49.866 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:49.866 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:49.866 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:49.866 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:49.866 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:49.866 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:49.866 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:49.866 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:49.866 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:49.866 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:49.866 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:49.866 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:49.866 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:50.128 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:50.128 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:50.128 15:26:41 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:02:50.128 15:26:41 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:02:50.128 15:26:41 -- setup/hugepages.sh@89 -- # local node 00:02:50.128 15:26:41 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:50.128 15:26:41 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:50.128 15:26:41 -- setup/hugepages.sh@92 -- # local surp 00:02:50.128 15:26:41 -- setup/hugepages.sh@93 -- # local resv 00:02:50.128 15:26:41 -- setup/hugepages.sh@94 -- # local anon 00:02:50.128 15:26:41 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:50.128 15:26:41 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:50.128 15:26:41 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:50.128 15:26:41 -- setup/common.sh@18 -- # local node= 00:02:50.128 15:26:41 -- setup/common.sh@19 -- # local var val 00:02:50.128 15:26:41 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.128 15:26:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.128 15:26:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.128 15:26:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.128 15:26:41 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.128 15:26:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.128 15:26:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 44142720 kB' 'MemAvailable: 47919300 kB' 'Buffers: 2708 kB' 'Cached: 10678232 kB' 'SwapCached: 0 kB' 'Active: 7414264 kB' 'Inactive: 3766568 kB' 'Active(anon): 7012120 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503080 kB' 'Mapped: 203576 kB' 'Shmem: 6512228 kB' 'KReclaimable: 203384 kB' 'Slab: 773344 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 569960 kB' 'KernelStack: 12848 kB' 'PageTables: 7908 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8078892 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198940 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.128 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.128 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.129 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.129 15:26:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.129 15:26:41 -- setup/common.sh@33 -- # echo 0 00:02:50.130 15:26:41 -- setup/common.sh@33 -- # return 0 00:02:50.130 15:26:41 -- setup/hugepages.sh@97 -- # anon=0 00:02:50.130 15:26:41 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:50.130 15:26:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:50.130 15:26:41 -- setup/common.sh@18 -- # local node= 00:02:50.130 15:26:41 -- setup/common.sh@19 -- # local var val 00:02:50.130 15:26:41 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.130 15:26:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.130 15:26:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.130 15:26:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.130 15:26:41 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.130 15:26:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 44142972 kB' 'MemAvailable: 47919552 kB' 'Buffers: 2708 kB' 'Cached: 10678236 kB' 'SwapCached: 0 kB' 'Active: 7414004 kB' 'Inactive: 3766568 kB' 'Active(anon): 7011860 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502804 kB' 'Mapped: 203576 kB' 'Shmem: 6512232 kB' 'KReclaimable: 203384 kB' 'Slab: 773316 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 569932 kB' 'KernelStack: 12816 kB' 'PageTables: 7784 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8078904 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198908 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.130 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.130 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.131 15:26:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.131 15:26:41 -- setup/common.sh@33 -- # echo 0 00:02:50.131 15:26:41 -- setup/common.sh@33 -- # return 0 00:02:50.131 15:26:41 -- setup/hugepages.sh@99 -- # surp=0 00:02:50.131 15:26:41 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:50.131 15:26:41 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:50.131 15:26:41 -- setup/common.sh@18 -- # local node= 00:02:50.131 15:26:41 -- setup/common.sh@19 -- # local var val 00:02:50.131 15:26:41 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.131 15:26:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.131 15:26:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.131 15:26:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.131 15:26:41 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.131 15:26:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.131 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 44142972 kB' 'MemAvailable: 47919552 kB' 'Buffers: 2708 kB' 'Cached: 10678240 kB' 'SwapCached: 0 kB' 'Active: 7413760 kB' 'Inactive: 3766568 kB' 'Active(anon): 7011616 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502512 kB' 'Mapped: 203552 kB' 'Shmem: 6512236 kB' 'KReclaimable: 203384 kB' 'Slab: 773380 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 569996 kB' 'KernelStack: 12832 kB' 'PageTables: 7844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8080792 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198892 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.132 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.132 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.133 15:26:41 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.133 15:26:41 -- setup/common.sh@33 -- # echo 0 00:02:50.133 15:26:41 -- setup/common.sh@33 -- # return 0 00:02:50.133 15:26:41 -- setup/hugepages.sh@100 -- # resv=0 00:02:50.133 15:26:41 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:02:50.133 nr_hugepages=1536 00:02:50.133 15:26:41 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:50.133 resv_hugepages=0 00:02:50.133 15:26:41 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:50.133 surplus_hugepages=0 00:02:50.133 15:26:41 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:50.133 anon_hugepages=0 00:02:50.133 15:26:41 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:02:50.133 15:26:41 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:02:50.133 15:26:41 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:50.133 15:26:41 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:50.133 15:26:41 -- setup/common.sh@18 -- # local node= 00:02:50.133 15:26:41 -- setup/common.sh@19 -- # local var val 00:02:50.133 15:26:41 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.133 15:26:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.133 15:26:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.133 15:26:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.133 15:26:41 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.133 15:26:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.133 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 44146984 kB' 'MemAvailable: 47923564 kB' 'Buffers: 2708 kB' 'Cached: 10678240 kB' 'SwapCached: 0 kB' 'Active: 7413896 kB' 'Inactive: 3766568 kB' 'Active(anon): 7011752 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502272 kB' 'Mapped: 203552 kB' 'Shmem: 6512236 kB' 'KReclaimable: 203384 kB' 'Slab: 773364 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 569980 kB' 'KernelStack: 12816 kB' 'PageTables: 7800 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8078932 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198828 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.134 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.134 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.135 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.135 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.395 15:26:41 -- setup/common.sh@33 -- # echo 1536 00:02:50.395 15:26:41 -- setup/common.sh@33 -- # return 0 00:02:50.395 15:26:41 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:02:50.395 15:26:41 -- setup/hugepages.sh@112 -- # get_nodes 00:02:50.395 15:26:41 -- setup/hugepages.sh@27 -- # local node 00:02:50.395 15:26:41 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:50.395 15:26:41 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:50.395 15:26:41 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:50.395 15:26:41 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:50.395 15:26:41 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:50.395 15:26:41 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:50.395 15:26:41 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:50.395 15:26:41 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:50.395 15:26:41 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:50.395 15:26:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:50.395 15:26:41 -- setup/common.sh@18 -- # local node=0 00:02:50.395 15:26:41 -- setup/common.sh@19 -- # local var val 00:02:50.395 15:26:41 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.395 15:26:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.395 15:26:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:50.395 15:26:41 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:50.395 15:26:41 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.395 15:26:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.395 15:26:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28006564 kB' 'MemUsed: 4868360 kB' 'SwapCached: 0 kB' 'Active: 2326980 kB' 'Inactive: 228000 kB' 'Active(anon): 2153384 kB' 'Inactive(anon): 0 kB' 'Active(file): 173596 kB' 'Inactive(file): 228000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2439672 kB' 'Mapped: 72396 kB' 'AnonPages: 118428 kB' 'Shmem: 2038076 kB' 'KernelStack: 7208 kB' 'PageTables: 3632 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 91120 kB' 'Slab: 405640 kB' 'SReclaimable: 91120 kB' 'SUnreclaim: 314520 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.395 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.395 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.396 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.396 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@33 -- # echo 0 00:02:50.397 15:26:41 -- setup/common.sh@33 -- # return 0 00:02:50.397 15:26:41 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:50.397 15:26:41 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:50.397 15:26:41 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:50.397 15:26:41 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:50.397 15:26:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:50.397 15:26:41 -- setup/common.sh@18 -- # local node=1 00:02:50.397 15:26:41 -- setup/common.sh@19 -- # local var val 00:02:50.397 15:26:41 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.397 15:26:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.397 15:26:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:50.397 15:26:41 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:50.397 15:26:41 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.397 15:26:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 16139928 kB' 'MemUsed: 11520808 kB' 'SwapCached: 0 kB' 'Active: 5086732 kB' 'Inactive: 3538568 kB' 'Active(anon): 4858184 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3538568 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8241316 kB' 'Mapped: 131156 kB' 'AnonPages: 384044 kB' 'Shmem: 4474200 kB' 'KernelStack: 5592 kB' 'PageTables: 4108 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112264 kB' 'Slab: 367724 kB' 'SReclaimable: 112264 kB' 'SUnreclaim: 255460 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.397 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.397 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # continue 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.398 15:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.398 15:26:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.398 15:26:41 -- setup/common.sh@33 -- # echo 0 00:02:50.398 15:26:41 -- setup/common.sh@33 -- # return 0 00:02:50.398 15:26:41 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:50.398 15:26:41 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:50.398 15:26:41 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:50.398 15:26:41 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:50.398 15:26:41 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:50.398 node0=512 expecting 512 00:02:50.398 15:26:41 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:50.398 15:26:41 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:50.398 15:26:41 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:50.398 15:26:41 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:02:50.398 node1=1024 expecting 1024 00:02:50.398 15:26:41 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:02:50.398 00:02:50.398 real 0m1.513s 00:02:50.398 user 0m0.624s 00:02:50.398 sys 0m0.849s 00:02:50.398 15:26:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:50.398 15:26:41 -- common/autotest_common.sh@10 -- # set +x 00:02:50.398 ************************************ 00:02:50.398 END TEST custom_alloc 00:02:50.398 ************************************ 00:02:50.398 15:26:41 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:02:50.398 15:26:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:50.398 15:26:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:50.398 15:26:41 -- common/autotest_common.sh@10 -- # set +x 00:02:50.398 ************************************ 00:02:50.398 START TEST no_shrink_alloc 00:02:50.398 ************************************ 00:02:50.398 15:26:41 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:02:50.398 15:26:41 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:02:50.398 15:26:41 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:50.398 15:26:41 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:50.398 15:26:41 -- setup/hugepages.sh@51 -- # shift 00:02:50.398 15:26:41 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:50.398 15:26:41 -- setup/hugepages.sh@52 -- # local node_ids 00:02:50.398 15:26:41 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:50.398 15:26:41 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:50.398 15:26:41 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:50.398 15:26:41 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:50.398 15:26:41 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:50.398 15:26:41 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:50.398 15:26:41 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:50.398 15:26:41 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:50.398 15:26:41 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:50.398 15:26:41 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:50.398 15:26:41 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:50.398 15:26:41 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:50.398 15:26:41 -- setup/hugepages.sh@73 -- # return 0 00:02:50.398 15:26:41 -- setup/hugepages.sh@198 -- # setup output 00:02:50.398 15:26:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:50.398 15:26:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:51.775 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:51.775 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:51.775 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:51.775 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:51.775 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:51.775 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:51.775 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:51.775 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:51.775 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:51.775 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:51.775 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:51.775 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:51.775 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:51.775 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:51.775 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:51.775 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:51.775 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:51.775 15:26:43 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:02:51.775 15:26:43 -- setup/hugepages.sh@89 -- # local node 00:02:51.775 15:26:43 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:51.775 15:26:43 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:51.775 15:26:43 -- setup/hugepages.sh@92 -- # local surp 00:02:51.775 15:26:43 -- setup/hugepages.sh@93 -- # local resv 00:02:51.775 15:26:43 -- setup/hugepages.sh@94 -- # local anon 00:02:51.775 15:26:43 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:51.775 15:26:43 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:51.775 15:26:43 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:51.775 15:26:43 -- setup/common.sh@18 -- # local node= 00:02:51.775 15:26:43 -- setup/common.sh@19 -- # local var val 00:02:51.775 15:26:43 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.775 15:26:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.775 15:26:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.775 15:26:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.775 15:26:43 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.775 15:26:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45157032 kB' 'MemAvailable: 48933612 kB' 'Buffers: 2708 kB' 'Cached: 10678328 kB' 'SwapCached: 0 kB' 'Active: 7419968 kB' 'Inactive: 3766568 kB' 'Active(anon): 7017824 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 508764 kB' 'Mapped: 204168 kB' 'Shmem: 6512324 kB' 'KReclaimable: 203384 kB' 'Slab: 773384 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570000 kB' 'KernelStack: 12864 kB' 'PageTables: 7972 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8085240 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198928 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.775 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.775 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.776 15:26:43 -- setup/common.sh@33 -- # echo 0 00:02:51.776 15:26:43 -- setup/common.sh@33 -- # return 0 00:02:51.776 15:26:43 -- setup/hugepages.sh@97 -- # anon=0 00:02:51.776 15:26:43 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:51.776 15:26:43 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:51.776 15:26:43 -- setup/common.sh@18 -- # local node= 00:02:51.776 15:26:43 -- setup/common.sh@19 -- # local var val 00:02:51.776 15:26:43 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.776 15:26:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.776 15:26:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.776 15:26:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.776 15:26:43 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.776 15:26:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45174688 kB' 'MemAvailable: 48951268 kB' 'Buffers: 2708 kB' 'Cached: 10678332 kB' 'SwapCached: 0 kB' 'Active: 7420104 kB' 'Inactive: 3766568 kB' 'Active(anon): 7017960 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 508804 kB' 'Mapped: 204424 kB' 'Shmem: 6512328 kB' 'KReclaimable: 203384 kB' 'Slab: 773376 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 569992 kB' 'KernelStack: 12816 kB' 'PageTables: 7816 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8085252 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198864 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.776 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.776 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.777 15:26:43 -- setup/common.sh@33 -- # echo 0 00:02:51.777 15:26:43 -- setup/common.sh@33 -- # return 0 00:02:51.777 15:26:43 -- setup/hugepages.sh@99 -- # surp=0 00:02:51.777 15:26:43 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:51.777 15:26:43 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:51.777 15:26:43 -- setup/common.sh@18 -- # local node= 00:02:51.777 15:26:43 -- setup/common.sh@19 -- # local var val 00:02:51.777 15:26:43 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.777 15:26:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.777 15:26:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.777 15:26:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.777 15:26:43 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.777 15:26:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45174240 kB' 'MemAvailable: 48950820 kB' 'Buffers: 2708 kB' 'Cached: 10678332 kB' 'SwapCached: 0 kB' 'Active: 7414684 kB' 'Inactive: 3766568 kB' 'Active(anon): 7012540 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503428 kB' 'Mapped: 203952 kB' 'Shmem: 6512328 kB' 'KReclaimable: 203384 kB' 'Slab: 773376 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 569992 kB' 'KernelStack: 12880 kB' 'PageTables: 7992 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8079148 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198892 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.777 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.777 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.778 15:26:43 -- setup/common.sh@33 -- # echo 0 00:02:51.778 15:26:43 -- setup/common.sh@33 -- # return 0 00:02:51.778 15:26:43 -- setup/hugepages.sh@100 -- # resv=0 00:02:51.778 15:26:43 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:51.778 nr_hugepages=1024 00:02:51.778 15:26:43 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:51.778 resv_hugepages=0 00:02:51.778 15:26:43 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:51.778 surplus_hugepages=0 00:02:51.778 15:26:43 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:51.778 anon_hugepages=0 00:02:51.778 15:26:43 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:51.778 15:26:43 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:51.778 15:26:43 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:51.778 15:26:43 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:51.778 15:26:43 -- setup/common.sh@18 -- # local node= 00:02:51.778 15:26:43 -- setup/common.sh@19 -- # local var val 00:02:51.778 15:26:43 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.778 15:26:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.778 15:26:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.778 15:26:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.778 15:26:43 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.778 15:26:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45173232 kB' 'MemAvailable: 48949812 kB' 'Buffers: 2708 kB' 'Cached: 10678364 kB' 'SwapCached: 0 kB' 'Active: 7413896 kB' 'Inactive: 3766568 kB' 'Active(anon): 7011752 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502696 kB' 'Mapped: 203556 kB' 'Shmem: 6512360 kB' 'KReclaimable: 203384 kB' 'Slab: 773432 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 570048 kB' 'KernelStack: 12864 kB' 'PageTables: 7944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8079164 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198860 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.778 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.778 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.779 15:26:43 -- setup/common.sh@33 -- # echo 1024 00:02:51.779 15:26:43 -- setup/common.sh@33 -- # return 0 00:02:51.779 15:26:43 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:51.779 15:26:43 -- setup/hugepages.sh@112 -- # get_nodes 00:02:51.779 15:26:43 -- setup/hugepages.sh@27 -- # local node 00:02:51.779 15:26:43 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:51.779 15:26:43 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:51.779 15:26:43 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:51.779 15:26:43 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:51.779 15:26:43 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:51.779 15:26:43 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:51.779 15:26:43 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:51.779 15:26:43 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:51.779 15:26:43 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:51.779 15:26:43 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:51.779 15:26:43 -- setup/common.sh@18 -- # local node=0 00:02:51.779 15:26:43 -- setup/common.sh@19 -- # local var val 00:02:51.779 15:26:43 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.779 15:26:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.779 15:26:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:51.779 15:26:43 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:51.779 15:26:43 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.779 15:26:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 26934948 kB' 'MemUsed: 5939976 kB' 'SwapCached: 0 kB' 'Active: 2326636 kB' 'Inactive: 228000 kB' 'Active(anon): 2153040 kB' 'Inactive(anon): 0 kB' 'Active(file): 173596 kB' 'Inactive(file): 228000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2439752 kB' 'Mapped: 72396 kB' 'AnonPages: 118108 kB' 'Shmem: 2038156 kB' 'KernelStack: 7224 kB' 'PageTables: 3680 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 91120 kB' 'Slab: 405628 kB' 'SReclaimable: 91120 kB' 'SUnreclaim: 314508 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # continue 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.779 15:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.779 15:26:43 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.779 15:26:43 -- setup/common.sh@33 -- # echo 0 00:02:51.779 15:26:43 -- setup/common.sh@33 -- # return 0 00:02:51.779 15:26:43 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:51.779 15:26:43 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:51.779 15:26:43 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:51.779 15:26:43 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:51.779 15:26:43 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:51.779 node0=1024 expecting 1024 00:02:51.779 15:26:43 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:51.779 15:26:43 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:02:51.779 15:26:43 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:02:51.779 15:26:43 -- setup/hugepages.sh@202 -- # setup output 00:02:51.779 15:26:43 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:51.779 15:26:43 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:53.158 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:53.158 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:53.158 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:53.158 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:53.158 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:53.158 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:53.158 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:53.158 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:53.158 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:53.158 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:53.158 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:53.158 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:53.158 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:53.158 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:53.158 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:53.158 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:53.158 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:53.158 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:02:53.158 15:26:44 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:02:53.158 15:26:44 -- setup/hugepages.sh@89 -- # local node 00:02:53.158 15:26:44 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:53.158 15:26:44 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:53.158 15:26:44 -- setup/hugepages.sh@92 -- # local surp 00:02:53.158 15:26:44 -- setup/hugepages.sh@93 -- # local resv 00:02:53.158 15:26:44 -- setup/hugepages.sh@94 -- # local anon 00:02:53.158 15:26:44 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:53.158 15:26:44 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:53.158 15:26:44 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:53.158 15:26:44 -- setup/common.sh@18 -- # local node= 00:02:53.158 15:26:44 -- setup/common.sh@19 -- # local var val 00:02:53.158 15:26:44 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.158 15:26:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.158 15:26:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.158 15:26:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.158 15:26:44 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.158 15:26:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45200428 kB' 'MemAvailable: 48977008 kB' 'Buffers: 2708 kB' 'Cached: 10678404 kB' 'SwapCached: 0 kB' 'Active: 7414464 kB' 'Inactive: 3766568 kB' 'Active(anon): 7012320 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503180 kB' 'Mapped: 203656 kB' 'Shmem: 6512400 kB' 'KReclaimable: 203384 kB' 'Slab: 773272 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 569888 kB' 'KernelStack: 12896 kB' 'PageTables: 7964 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8079328 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198908 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.158 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.158 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.159 15:26:44 -- setup/common.sh@33 -- # echo 0 00:02:53.159 15:26:44 -- setup/common.sh@33 -- # return 0 00:02:53.159 15:26:44 -- setup/hugepages.sh@97 -- # anon=0 00:02:53.159 15:26:44 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:53.159 15:26:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:53.159 15:26:44 -- setup/common.sh@18 -- # local node= 00:02:53.159 15:26:44 -- setup/common.sh@19 -- # local var val 00:02:53.159 15:26:44 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.159 15:26:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.159 15:26:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.159 15:26:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.159 15:26:44 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.159 15:26:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45212384 kB' 'MemAvailable: 48988964 kB' 'Buffers: 2708 kB' 'Cached: 10678404 kB' 'SwapCached: 0 kB' 'Active: 7414800 kB' 'Inactive: 3766568 kB' 'Active(anon): 7012656 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503500 kB' 'Mapped: 203604 kB' 'Shmem: 6512400 kB' 'KReclaimable: 203384 kB' 'Slab: 773272 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 569888 kB' 'KernelStack: 12880 kB' 'PageTables: 7912 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8079340 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198860 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.159 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.159 15:26:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.160 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.160 15:26:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.160 15:26:44 -- setup/common.sh@33 -- # echo 0 00:02:53.161 15:26:44 -- setup/common.sh@33 -- # return 0 00:02:53.161 15:26:44 -- setup/hugepages.sh@99 -- # surp=0 00:02:53.161 15:26:44 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:53.161 15:26:44 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:53.161 15:26:44 -- setup/common.sh@18 -- # local node= 00:02:53.161 15:26:44 -- setup/common.sh@19 -- # local var val 00:02:53.161 15:26:44 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.161 15:26:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.161 15:26:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.161 15:26:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.161 15:26:44 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.161 15:26:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45212144 kB' 'MemAvailable: 48988724 kB' 'Buffers: 2708 kB' 'Cached: 10678420 kB' 'SwapCached: 0 kB' 'Active: 7414612 kB' 'Inactive: 3766568 kB' 'Active(anon): 7012468 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503848 kB' 'Mapped: 203556 kB' 'Shmem: 6512416 kB' 'KReclaimable: 203384 kB' 'Slab: 773252 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 569868 kB' 'KernelStack: 12896 kB' 'PageTables: 7916 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8082016 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198940 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.161 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.161 15:26:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.162 15:26:44 -- setup/common.sh@33 -- # echo 0 00:02:53.162 15:26:44 -- setup/common.sh@33 -- # return 0 00:02:53.162 15:26:44 -- setup/hugepages.sh@100 -- # resv=0 00:02:53.162 15:26:44 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:53.162 nr_hugepages=1024 00:02:53.162 15:26:44 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:53.162 resv_hugepages=0 00:02:53.162 15:26:44 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:53.162 surplus_hugepages=0 00:02:53.162 15:26:44 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:53.162 anon_hugepages=0 00:02:53.162 15:26:44 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:53.162 15:26:44 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:53.162 15:26:44 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:53.162 15:26:44 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:53.162 15:26:44 -- setup/common.sh@18 -- # local node= 00:02:53.162 15:26:44 -- setup/common.sh@19 -- # local var val 00:02:53.162 15:26:44 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.162 15:26:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.162 15:26:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.162 15:26:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.162 15:26:44 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.162 15:26:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45211724 kB' 'MemAvailable: 48988304 kB' 'Buffers: 2708 kB' 'Cached: 10678432 kB' 'SwapCached: 0 kB' 'Active: 7415196 kB' 'Inactive: 3766568 kB' 'Active(anon): 7013052 kB' 'Inactive(anon): 0 kB' 'Active(file): 402144 kB' 'Inactive(file): 3766568 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503976 kB' 'Mapped: 203556 kB' 'Shmem: 6512428 kB' 'KReclaimable: 203384 kB' 'Slab: 773340 kB' 'SReclaimable: 203384 kB' 'SUnreclaim: 569956 kB' 'KernelStack: 13072 kB' 'PageTables: 8688 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8083424 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199068 kB' 'VmallocChunk: 0 kB' 'Percpu: 37056 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2600540 kB' 'DirectMap2M: 18290688 kB' 'DirectMap1G: 49283072 kB' 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.162 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.162 15:26:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.163 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.163 15:26:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.163 15:26:44 -- setup/common.sh@33 -- # echo 1024 00:02:53.164 15:26:44 -- setup/common.sh@33 -- # return 0 00:02:53.164 15:26:44 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:53.164 15:26:44 -- setup/hugepages.sh@112 -- # get_nodes 00:02:53.164 15:26:44 -- setup/hugepages.sh@27 -- # local node 00:02:53.164 15:26:44 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:53.164 15:26:44 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:53.164 15:26:44 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:53.164 15:26:44 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:53.164 15:26:44 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:53.164 15:26:44 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:53.164 15:26:44 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:53.164 15:26:44 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:53.164 15:26:44 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:53.164 15:26:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:53.164 15:26:44 -- setup/common.sh@18 -- # local node=0 00:02:53.164 15:26:44 -- setup/common.sh@19 -- # local var val 00:02:53.164 15:26:44 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.164 15:26:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.164 15:26:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:53.164 15:26:44 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:53.164 15:26:44 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.164 15:26:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 26951516 kB' 'MemUsed: 5923408 kB' 'SwapCached: 0 kB' 'Active: 2326880 kB' 'Inactive: 228000 kB' 'Active(anon): 2153284 kB' 'Inactive(anon): 0 kB' 'Active(file): 173596 kB' 'Inactive(file): 228000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2439824 kB' 'Mapped: 72396 kB' 'AnonPages: 118248 kB' 'Shmem: 2038228 kB' 'KernelStack: 7224 kB' 'PageTables: 3580 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 91120 kB' 'Slab: 405624 kB' 'SReclaimable: 91120 kB' 'SUnreclaim: 314504 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.164 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.164 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.165 15:26:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.165 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.165 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.165 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.165 15:26:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.165 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.165 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.165 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.165 15:26:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.165 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.165 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.165 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.165 15:26:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.165 15:26:44 -- setup/common.sh@32 -- # continue 00:02:53.165 15:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.165 15:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.165 15:26:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.165 15:26:44 -- setup/common.sh@33 -- # echo 0 00:02:53.165 15:26:44 -- setup/common.sh@33 -- # return 0 00:02:53.165 15:26:44 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:53.165 15:26:44 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:53.165 15:26:44 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:53.165 15:26:44 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:53.165 15:26:44 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:53.165 node0=1024 expecting 1024 00:02:53.165 15:26:44 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:53.165 00:02:53.165 real 0m2.857s 00:02:53.165 user 0m1.189s 00:02:53.165 sys 0m1.589s 00:02:53.165 15:26:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:53.165 15:26:44 -- common/autotest_common.sh@10 -- # set +x 00:02:53.165 ************************************ 00:02:53.165 END TEST no_shrink_alloc 00:02:53.165 ************************************ 00:02:53.165 15:26:44 -- setup/hugepages.sh@217 -- # clear_hp 00:02:53.165 15:26:44 -- setup/hugepages.sh@37 -- # local node hp 00:02:53.165 15:26:44 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:53.165 15:26:44 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:53.165 15:26:44 -- setup/hugepages.sh@41 -- # echo 0 00:02:53.165 15:26:44 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:53.165 15:26:44 -- setup/hugepages.sh@41 -- # echo 0 00:02:53.165 15:26:44 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:53.165 15:26:44 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:53.165 15:26:44 -- setup/hugepages.sh@41 -- # echo 0 00:02:53.165 15:26:44 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:53.165 15:26:44 -- setup/hugepages.sh@41 -- # echo 0 00:02:53.165 15:26:44 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:53.165 15:26:44 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:53.165 00:02:53.165 real 0m11.516s 00:02:53.165 user 0m4.502s 00:02:53.165 sys 0m5.931s 00:02:53.165 15:26:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:53.165 15:26:44 -- common/autotest_common.sh@10 -- # set +x 00:02:53.165 ************************************ 00:02:53.165 END TEST hugepages 00:02:53.165 ************************************ 00:02:53.165 15:26:44 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:02:53.165 15:26:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:53.165 15:26:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:53.165 15:26:44 -- common/autotest_common.sh@10 -- # set +x 00:02:53.165 ************************************ 00:02:53.165 START TEST driver 00:02:53.165 ************************************ 00:02:53.165 15:26:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:02:53.424 * Looking for test storage... 00:02:53.424 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:53.424 15:26:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:53.424 15:26:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:53.424 15:26:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:53.424 15:26:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:53.424 15:26:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:53.424 15:26:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:53.424 15:26:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:53.424 15:26:44 -- scripts/common.sh@335 -- # IFS=.-: 00:02:53.424 15:26:44 -- scripts/common.sh@335 -- # read -ra ver1 00:02:53.424 15:26:44 -- scripts/common.sh@336 -- # IFS=.-: 00:02:53.424 15:26:44 -- scripts/common.sh@336 -- # read -ra ver2 00:02:53.424 15:26:44 -- scripts/common.sh@337 -- # local 'op=<' 00:02:53.424 15:26:44 -- scripts/common.sh@339 -- # ver1_l=2 00:02:53.424 15:26:44 -- scripts/common.sh@340 -- # ver2_l=1 00:02:53.424 15:26:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:53.424 15:26:44 -- scripts/common.sh@343 -- # case "$op" in 00:02:53.424 15:26:44 -- scripts/common.sh@344 -- # : 1 00:02:53.424 15:26:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:53.424 15:26:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:53.424 15:26:44 -- scripts/common.sh@364 -- # decimal 1 00:02:53.424 15:26:44 -- scripts/common.sh@352 -- # local d=1 00:02:53.424 15:26:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:53.424 15:26:44 -- scripts/common.sh@354 -- # echo 1 00:02:53.424 15:26:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:53.424 15:26:44 -- scripts/common.sh@365 -- # decimal 2 00:02:53.424 15:26:44 -- scripts/common.sh@352 -- # local d=2 00:02:53.424 15:26:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:53.424 15:26:44 -- scripts/common.sh@354 -- # echo 2 00:02:53.424 15:26:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:53.424 15:26:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:53.424 15:26:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:53.424 15:26:44 -- scripts/common.sh@367 -- # return 0 00:02:53.424 15:26:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:53.424 15:26:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:53.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:53.424 --rc genhtml_branch_coverage=1 00:02:53.424 --rc genhtml_function_coverage=1 00:02:53.424 --rc genhtml_legend=1 00:02:53.424 --rc geninfo_all_blocks=1 00:02:53.424 --rc geninfo_unexecuted_blocks=1 00:02:53.424 00:02:53.424 ' 00:02:53.424 15:26:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:53.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:53.424 --rc genhtml_branch_coverage=1 00:02:53.424 --rc genhtml_function_coverage=1 00:02:53.424 --rc genhtml_legend=1 00:02:53.424 --rc geninfo_all_blocks=1 00:02:53.424 --rc geninfo_unexecuted_blocks=1 00:02:53.424 00:02:53.424 ' 00:02:53.424 15:26:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:53.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:53.424 --rc genhtml_branch_coverage=1 00:02:53.424 --rc genhtml_function_coverage=1 00:02:53.424 --rc genhtml_legend=1 00:02:53.424 --rc geninfo_all_blocks=1 00:02:53.424 --rc geninfo_unexecuted_blocks=1 00:02:53.424 00:02:53.424 ' 00:02:53.424 15:26:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:53.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:53.424 --rc genhtml_branch_coverage=1 00:02:53.424 --rc genhtml_function_coverage=1 00:02:53.424 --rc genhtml_legend=1 00:02:53.424 --rc geninfo_all_blocks=1 00:02:53.424 --rc geninfo_unexecuted_blocks=1 00:02:53.424 00:02:53.424 ' 00:02:53.424 15:26:44 -- setup/driver.sh@68 -- # setup reset 00:02:53.424 15:26:44 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:53.424 15:26:44 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:55.958 15:26:47 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:02:55.958 15:26:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:55.958 15:26:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:55.958 15:26:47 -- common/autotest_common.sh@10 -- # set +x 00:02:55.958 ************************************ 00:02:55.958 START TEST guess_driver 00:02:55.958 ************************************ 00:02:55.958 15:26:47 -- common/autotest_common.sh@1114 -- # guess_driver 00:02:55.958 15:26:47 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:02:55.958 15:26:47 -- setup/driver.sh@47 -- # local fail=0 00:02:55.958 15:26:47 -- setup/driver.sh@49 -- # pick_driver 00:02:55.958 15:26:47 -- setup/driver.sh@36 -- # vfio 00:02:55.958 15:26:47 -- setup/driver.sh@21 -- # local iommu_grups 00:02:55.958 15:26:47 -- setup/driver.sh@22 -- # local unsafe_vfio 00:02:55.958 15:26:47 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:02:55.958 15:26:47 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:02:55.958 15:26:47 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:02:55.958 15:26:47 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:02:55.958 15:26:47 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:02:55.958 15:26:47 -- setup/driver.sh@14 -- # mod vfio_pci 00:02:55.958 15:26:47 -- setup/driver.sh@12 -- # dep vfio_pci 00:02:55.958 15:26:47 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:02:55.958 15:26:47 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:02:55.958 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:02:55.958 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:02:55.958 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:02:55.958 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:02:55.958 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:02:55.958 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:02:55.958 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:02:55.958 15:26:47 -- setup/driver.sh@30 -- # return 0 00:02:55.958 15:26:47 -- setup/driver.sh@37 -- # echo vfio-pci 00:02:55.958 15:26:47 -- setup/driver.sh@49 -- # driver=vfio-pci 00:02:55.958 15:26:47 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:02:55.958 15:26:47 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:02:55.958 Looking for driver=vfio-pci 00:02:55.958 15:26:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.958 15:26:47 -- setup/driver.sh@45 -- # setup output config 00:02:55.958 15:26:47 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:55.958 15:26:47 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:57.333 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.333 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.333 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.333 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.333 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.333 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.333 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.333 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.333 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.333 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.333 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.333 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.333 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.333 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.333 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.333 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.333 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.333 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.333 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.333 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.333 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.333 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.333 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.333 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.333 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.333 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.333 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.333 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.333 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.334 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.334 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.334 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.334 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.334 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.334 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.334 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.334 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.334 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.334 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.334 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.334 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.334 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.334 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.334 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.334 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:57.334 15:26:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:57.334 15:26:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:57.334 15:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:58.273 15:26:49 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:58.273 15:26:49 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:58.273 15:26:49 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:58.274 15:26:49 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:02:58.274 15:26:49 -- setup/driver.sh@65 -- # setup reset 00:02:58.274 15:26:49 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:58.274 15:26:49 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:00.802 00:03:00.802 real 0m5.011s 00:03:00.802 user 0m1.160s 00:03:00.802 sys 0m2.047s 00:03:00.802 15:26:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:00.802 15:26:52 -- common/autotest_common.sh@10 -- # set +x 00:03:00.802 ************************************ 00:03:00.802 END TEST guess_driver 00:03:00.802 ************************************ 00:03:00.802 00:03:00.802 real 0m7.683s 00:03:00.802 user 0m1.817s 00:03:00.802 sys 0m3.114s 00:03:00.802 15:26:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:00.802 15:26:52 -- common/autotest_common.sh@10 -- # set +x 00:03:00.802 ************************************ 00:03:00.802 END TEST driver 00:03:00.802 ************************************ 00:03:01.060 15:26:52 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:01.060 15:26:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:01.060 15:26:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:01.060 15:26:52 -- common/autotest_common.sh@10 -- # set +x 00:03:01.060 ************************************ 00:03:01.060 START TEST devices 00:03:01.060 ************************************ 00:03:01.060 15:26:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:01.060 * Looking for test storage... 00:03:01.060 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:01.060 15:26:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:01.061 15:26:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:01.061 15:26:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:01.061 15:26:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:01.061 15:26:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:01.061 15:26:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:01.061 15:26:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:01.061 15:26:52 -- scripts/common.sh@335 -- # IFS=.-: 00:03:01.061 15:26:52 -- scripts/common.sh@335 -- # read -ra ver1 00:03:01.061 15:26:52 -- scripts/common.sh@336 -- # IFS=.-: 00:03:01.061 15:26:52 -- scripts/common.sh@336 -- # read -ra ver2 00:03:01.061 15:26:52 -- scripts/common.sh@337 -- # local 'op=<' 00:03:01.061 15:26:52 -- scripts/common.sh@339 -- # ver1_l=2 00:03:01.061 15:26:52 -- scripts/common.sh@340 -- # ver2_l=1 00:03:01.061 15:26:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:01.061 15:26:52 -- scripts/common.sh@343 -- # case "$op" in 00:03:01.061 15:26:52 -- scripts/common.sh@344 -- # : 1 00:03:01.061 15:26:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:01.061 15:26:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:01.061 15:26:52 -- scripts/common.sh@364 -- # decimal 1 00:03:01.061 15:26:52 -- scripts/common.sh@352 -- # local d=1 00:03:01.061 15:26:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:01.061 15:26:52 -- scripts/common.sh@354 -- # echo 1 00:03:01.061 15:26:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:01.061 15:26:52 -- scripts/common.sh@365 -- # decimal 2 00:03:01.061 15:26:52 -- scripts/common.sh@352 -- # local d=2 00:03:01.061 15:26:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:01.061 15:26:52 -- scripts/common.sh@354 -- # echo 2 00:03:01.061 15:26:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:01.061 15:26:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:01.061 15:26:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:01.061 15:26:52 -- scripts/common.sh@367 -- # return 0 00:03:01.061 15:26:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:01.061 15:26:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:01.061 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.061 --rc genhtml_branch_coverage=1 00:03:01.061 --rc genhtml_function_coverage=1 00:03:01.061 --rc genhtml_legend=1 00:03:01.061 --rc geninfo_all_blocks=1 00:03:01.061 --rc geninfo_unexecuted_blocks=1 00:03:01.061 00:03:01.061 ' 00:03:01.061 15:26:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:01.061 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.061 --rc genhtml_branch_coverage=1 00:03:01.061 --rc genhtml_function_coverage=1 00:03:01.061 --rc genhtml_legend=1 00:03:01.061 --rc geninfo_all_blocks=1 00:03:01.061 --rc geninfo_unexecuted_blocks=1 00:03:01.061 00:03:01.061 ' 00:03:01.061 15:26:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:01.061 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.061 --rc genhtml_branch_coverage=1 00:03:01.061 --rc genhtml_function_coverage=1 00:03:01.061 --rc genhtml_legend=1 00:03:01.061 --rc geninfo_all_blocks=1 00:03:01.061 --rc geninfo_unexecuted_blocks=1 00:03:01.061 00:03:01.061 ' 00:03:01.061 15:26:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:01.061 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.061 --rc genhtml_branch_coverage=1 00:03:01.061 --rc genhtml_function_coverage=1 00:03:01.061 --rc genhtml_legend=1 00:03:01.061 --rc geninfo_all_blocks=1 00:03:01.061 --rc geninfo_unexecuted_blocks=1 00:03:01.061 00:03:01.061 ' 00:03:01.061 15:26:52 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:01.061 15:26:52 -- setup/devices.sh@192 -- # setup reset 00:03:01.061 15:26:52 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:01.061 15:26:52 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:02.434 15:26:53 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:02.434 15:26:53 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:02.434 15:26:53 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:02.434 15:26:53 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:02.434 15:26:53 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:02.434 15:26:53 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:02.434 15:26:53 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:02.434 15:26:53 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:02.434 15:26:53 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:02.434 15:26:53 -- setup/devices.sh@196 -- # blocks=() 00:03:02.434 15:26:53 -- setup/devices.sh@196 -- # declare -a blocks 00:03:02.434 15:26:53 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:02.434 15:26:53 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:02.434 15:26:53 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:02.434 15:26:53 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:02.434 15:26:53 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:02.434 15:26:53 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:02.434 15:26:53 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:02.434 15:26:53 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:02.434 15:26:53 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:02.434 15:26:53 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:02.434 15:26:53 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:02.693 No valid GPT data, bailing 00:03:02.693 15:26:53 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:02.693 15:26:53 -- scripts/common.sh@393 -- # pt= 00:03:02.693 15:26:53 -- scripts/common.sh@394 -- # return 1 00:03:02.693 15:26:53 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:02.693 15:26:53 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:02.693 15:26:53 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:02.693 15:26:53 -- setup/common.sh@80 -- # echo 1000204886016 00:03:02.693 15:26:53 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:02.693 15:26:53 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:02.693 15:26:53 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:02.693 15:26:53 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:02.693 15:26:53 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:02.693 15:26:53 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:02.693 15:26:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:02.693 15:26:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:02.693 15:26:53 -- common/autotest_common.sh@10 -- # set +x 00:03:02.693 ************************************ 00:03:02.693 START TEST nvme_mount 00:03:02.693 ************************************ 00:03:02.693 15:26:53 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:02.693 15:26:53 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:02.693 15:26:53 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:02.693 15:26:53 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:02.693 15:26:53 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:02.693 15:26:53 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:02.693 15:26:53 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:02.693 15:26:53 -- setup/common.sh@40 -- # local part_no=1 00:03:02.693 15:26:53 -- setup/common.sh@41 -- # local size=1073741824 00:03:02.693 15:26:53 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:02.693 15:26:53 -- setup/common.sh@44 -- # parts=() 00:03:02.693 15:26:53 -- setup/common.sh@44 -- # local parts 00:03:02.693 15:26:53 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:02.693 15:26:53 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:02.693 15:26:53 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:02.693 15:26:53 -- setup/common.sh@46 -- # (( part++ )) 00:03:02.693 15:26:53 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:02.693 15:26:53 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:02.693 15:26:53 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:02.693 15:26:53 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:03.627 Creating new GPT entries in memory. 00:03:03.628 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:03.628 other utilities. 00:03:03.628 15:26:54 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:03.628 15:26:54 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:03.628 15:26:54 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:03.628 15:26:54 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:03.628 15:26:54 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:04.560 Creating new GPT entries in memory. 00:03:04.560 The operation has completed successfully. 00:03:04.560 15:26:55 -- setup/common.sh@57 -- # (( part++ )) 00:03:04.560 15:26:55 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:04.560 15:26:55 -- setup/common.sh@62 -- # wait 735874 00:03:04.817 15:26:56 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:04.817 15:26:56 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:04.817 15:26:56 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:04.817 15:26:56 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:04.817 15:26:56 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:04.817 15:26:56 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:04.817 15:26:56 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:04.817 15:26:56 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:04.817 15:26:56 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:04.817 15:26:56 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:04.817 15:26:56 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:04.817 15:26:56 -- setup/devices.sh@53 -- # local found=0 00:03:04.817 15:26:56 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:04.817 15:26:56 -- setup/devices.sh@56 -- # : 00:03:04.817 15:26:56 -- setup/devices.sh@59 -- # local pci status 00:03:04.817 15:26:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.817 15:26:56 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:04.817 15:26:56 -- setup/devices.sh@47 -- # setup output config 00:03:04.817 15:26:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:04.817 15:26:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:05.749 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.749 15:26:57 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:05.749 15:26:57 -- setup/devices.sh@63 -- # found=1 00:03:05.749 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.749 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.749 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.749 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.749 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.749 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.749 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.749 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.749 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.749 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.749 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.749 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.749 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.749 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.749 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.749 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.750 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.750 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.750 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.750 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.750 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.750 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.750 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.750 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.750 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.750 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.750 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.750 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.750 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.750 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.750 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.750 15:26:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:05.750 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.007 15:26:57 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:06.008 15:26:57 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:06.008 15:26:57 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:06.008 15:26:57 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:06.008 15:26:57 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:06.008 15:26:57 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:06.008 15:26:57 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:06.008 15:26:57 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:06.008 15:26:57 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:06.008 15:26:57 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:06.008 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:06.008 15:26:57 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:06.008 15:26:57 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:06.266 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:06.266 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:06.266 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:06.266 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:06.266 15:26:57 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:06.266 15:26:57 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:06.266 15:26:57 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:06.266 15:26:57 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:06.266 15:26:57 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:06.266 15:26:57 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:06.266 15:26:57 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:06.266 15:26:57 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:06.266 15:26:57 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:06.266 15:26:57 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:06.266 15:26:57 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:06.266 15:26:57 -- setup/devices.sh@53 -- # local found=0 00:03:06.266 15:26:57 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:06.266 15:26:57 -- setup/devices.sh@56 -- # : 00:03:06.266 15:26:57 -- setup/devices.sh@59 -- # local pci status 00:03:06.266 15:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.266 15:26:57 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:06.266 15:26:57 -- setup/devices.sh@47 -- # setup output config 00:03:06.266 15:26:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:06.266 15:26:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:07.642 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.642 15:26:58 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:07.642 15:26:58 -- setup/devices.sh@63 -- # found=1 00:03:07.642 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.642 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.642 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.642 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:07.643 15:26:58 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:07.643 15:26:58 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:07.643 15:26:58 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:07.643 15:26:58 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:07.643 15:26:58 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:07.643 15:26:58 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:07.643 15:26:58 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:07.643 15:26:58 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:07.643 15:26:58 -- setup/devices.sh@50 -- # local mount_point= 00:03:07.643 15:26:58 -- setup/devices.sh@51 -- # local test_file= 00:03:07.643 15:26:58 -- setup/devices.sh@53 -- # local found=0 00:03:07.643 15:26:58 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:07.643 15:26:58 -- setup/devices.sh@59 -- # local pci status 00:03:07.643 15:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.643 15:26:58 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:07.643 15:26:58 -- setup/devices.sh@47 -- # setup output config 00:03:07.643 15:26:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:07.643 15:26:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:09.028 15:27:00 -- setup/devices.sh@63 -- # found=1 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.028 15:27:00 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:09.028 15:27:00 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:09.028 15:27:00 -- setup/devices.sh@68 -- # return 0 00:03:09.028 15:27:00 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:09.028 15:27:00 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:09.028 15:27:00 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:09.028 15:27:00 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:09.028 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:09.028 00:03:09.028 real 0m6.368s 00:03:09.028 user 0m1.472s 00:03:09.028 sys 0m2.482s 00:03:09.028 15:27:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:09.028 15:27:00 -- common/autotest_common.sh@10 -- # set +x 00:03:09.028 ************************************ 00:03:09.028 END TEST nvme_mount 00:03:09.028 ************************************ 00:03:09.028 15:27:00 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:09.028 15:27:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:09.028 15:27:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:09.028 15:27:00 -- common/autotest_common.sh@10 -- # set +x 00:03:09.028 ************************************ 00:03:09.028 START TEST dm_mount 00:03:09.028 ************************************ 00:03:09.028 15:27:00 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:09.028 15:27:00 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:09.028 15:27:00 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:09.028 15:27:00 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:09.028 15:27:00 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:09.028 15:27:00 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:09.028 15:27:00 -- setup/common.sh@40 -- # local part_no=2 00:03:09.028 15:27:00 -- setup/common.sh@41 -- # local size=1073741824 00:03:09.028 15:27:00 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:09.028 15:27:00 -- setup/common.sh@44 -- # parts=() 00:03:09.028 15:27:00 -- setup/common.sh@44 -- # local parts 00:03:09.028 15:27:00 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:09.028 15:27:00 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:09.028 15:27:00 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:09.028 15:27:00 -- setup/common.sh@46 -- # (( part++ )) 00:03:09.028 15:27:00 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:09.028 15:27:00 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:09.028 15:27:00 -- setup/common.sh@46 -- # (( part++ )) 00:03:09.028 15:27:00 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:09.028 15:27:00 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:09.028 15:27:00 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:09.028 15:27:00 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:09.965 Creating new GPT entries in memory. 00:03:09.965 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:09.965 other utilities. 00:03:09.965 15:27:01 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:09.965 15:27:01 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:09.965 15:27:01 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:09.965 15:27:01 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:09.965 15:27:01 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:11.339 Creating new GPT entries in memory. 00:03:11.339 The operation has completed successfully. 00:03:11.339 15:27:02 -- setup/common.sh@57 -- # (( part++ )) 00:03:11.339 15:27:02 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:11.339 15:27:02 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:11.339 15:27:02 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:11.339 15:27:02 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:12.274 The operation has completed successfully. 00:03:12.274 15:27:03 -- setup/common.sh@57 -- # (( part++ )) 00:03:12.274 15:27:03 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:12.274 15:27:03 -- setup/common.sh@62 -- # wait 738362 00:03:12.274 15:27:03 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:12.274 15:27:03 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:12.274 15:27:03 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:12.274 15:27:03 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:12.274 15:27:03 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:12.274 15:27:03 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:12.274 15:27:03 -- setup/devices.sh@161 -- # break 00:03:12.274 15:27:03 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:12.274 15:27:03 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:12.274 15:27:03 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:12.274 15:27:03 -- setup/devices.sh@166 -- # dm=dm-0 00:03:12.274 15:27:03 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:12.274 15:27:03 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:12.274 15:27:03 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:12.274 15:27:03 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:12.274 15:27:03 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:12.274 15:27:03 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:12.275 15:27:03 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:12.275 15:27:03 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:12.275 15:27:03 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:12.275 15:27:03 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:12.275 15:27:03 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:12.275 15:27:03 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:12.275 15:27:03 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:12.275 15:27:03 -- setup/devices.sh@53 -- # local found=0 00:03:12.275 15:27:03 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:12.275 15:27:03 -- setup/devices.sh@56 -- # : 00:03:12.275 15:27:03 -- setup/devices.sh@59 -- # local pci status 00:03:12.275 15:27:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:12.275 15:27:03 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:12.275 15:27:03 -- setup/devices.sh@47 -- # setup output config 00:03:12.275 15:27:03 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:12.275 15:27:03 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:13.210 15:27:04 -- setup/devices.sh@63 -- # found=1 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.210 15:27:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.210 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.469 15:27:04 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:13.469 15:27:04 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:13.469 15:27:04 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:13.469 15:27:04 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:13.469 15:27:04 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:13.469 15:27:04 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:13.469 15:27:04 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:13.469 15:27:04 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:13.469 15:27:04 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:13.469 15:27:04 -- setup/devices.sh@50 -- # local mount_point= 00:03:13.469 15:27:04 -- setup/devices.sh@51 -- # local test_file= 00:03:13.469 15:27:04 -- setup/devices.sh@53 -- # local found=0 00:03:13.469 15:27:04 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:13.469 15:27:04 -- setup/devices.sh@59 -- # local pci status 00:03:13.469 15:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.469 15:27:04 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:13.469 15:27:04 -- setup/devices.sh@47 -- # setup output config 00:03:13.469 15:27:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:13.469 15:27:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:14.879 15:27:05 -- setup/devices.sh@63 -- # found=1 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:14.879 15:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.879 15:27:06 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:14.879 15:27:06 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:14.879 15:27:06 -- setup/devices.sh@68 -- # return 0 00:03:14.879 15:27:06 -- setup/devices.sh@187 -- # cleanup_dm 00:03:14.879 15:27:06 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:14.879 15:27:06 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:14.880 15:27:06 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:14.880 15:27:06 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:14.880 15:27:06 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:14.880 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:14.880 15:27:06 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:14.880 15:27:06 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:14.880 00:03:14.880 real 0m5.817s 00:03:14.880 user 0m0.993s 00:03:14.880 sys 0m1.694s 00:03:14.880 15:27:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:14.880 15:27:06 -- common/autotest_common.sh@10 -- # set +x 00:03:14.880 ************************************ 00:03:14.880 END TEST dm_mount 00:03:14.880 ************************************ 00:03:14.880 15:27:06 -- setup/devices.sh@1 -- # cleanup 00:03:14.880 15:27:06 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:14.880 15:27:06 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:14.880 15:27:06 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:14.880 15:27:06 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:14.880 15:27:06 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:14.880 15:27:06 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:15.190 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:15.191 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:15.191 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:15.191 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:15.191 15:27:06 -- setup/devices.sh@12 -- # cleanup_dm 00:03:15.191 15:27:06 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:15.191 15:27:06 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:15.191 15:27:06 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:15.191 15:27:06 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:15.191 15:27:06 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:15.191 15:27:06 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:15.191 00:03:15.191 real 0m14.182s 00:03:15.191 user 0m3.235s 00:03:15.191 sys 0m5.164s 00:03:15.191 15:27:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:15.191 15:27:06 -- common/autotest_common.sh@10 -- # set +x 00:03:15.191 ************************************ 00:03:15.191 END TEST devices 00:03:15.191 ************************************ 00:03:15.191 00:03:15.191 real 0m44.211s 00:03:15.191 user 0m13.096s 00:03:15.191 sys 0m19.579s 00:03:15.191 15:27:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:15.191 15:27:06 -- common/autotest_common.sh@10 -- # set +x 00:03:15.191 ************************************ 00:03:15.191 END TEST setup.sh 00:03:15.191 ************************************ 00:03:15.191 15:27:06 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:16.150 Hugepages 00:03:16.150 node hugesize free / total 00:03:16.150 node0 1048576kB 0 / 0 00:03:16.150 node0 2048kB 2048 / 2048 00:03:16.150 node1 1048576kB 0 / 0 00:03:16.150 node1 2048kB 0 / 0 00:03:16.150 00:03:16.150 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:16.150 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:16.150 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:16.150 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:16.150 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:16.150 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:16.150 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:16.150 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:16.150 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:16.150 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:16.150 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:16.150 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:16.150 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:16.150 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:16.150 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:16.150 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:16.150 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:16.408 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:16.409 15:27:07 -- spdk/autotest.sh@128 -- # uname -s 00:03:16.409 15:27:07 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:16.409 15:27:07 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:16.409 15:27:07 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:17.343 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:17.343 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:17.343 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:17.343 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:17.343 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:17.343 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:17.343 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:17.343 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:17.343 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:17.343 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:17.602 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:17.602 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:17.602 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:17.602 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:17.602 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:17.602 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:18.538 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:18.538 15:27:09 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:19.475 15:27:10 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:19.475 15:27:10 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:19.475 15:27:10 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:19.475 15:27:10 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:19.475 15:27:10 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:19.475 15:27:10 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:19.475 15:27:10 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:19.475 15:27:10 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:19.475 15:27:10 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:19.733 15:27:10 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:19.733 15:27:10 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:19.733 15:27:10 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:20.666 Waiting for block devices as requested 00:03:20.666 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:20.926 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:20.926 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:21.185 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:21.185 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:21.185 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:21.185 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:21.445 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:21.445 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:21.445 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:21.445 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:21.704 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:21.704 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:21.704 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:21.704 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:21.962 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:21.962 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:21.962 15:27:13 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:03:21.962 15:27:13 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:21.962 15:27:13 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:03:21.962 15:27:13 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:03:21.963 15:27:13 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:21.963 15:27:13 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:21.963 15:27:13 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:21.963 15:27:13 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:03:21.963 15:27:13 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:03:21.963 15:27:13 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:03:21.963 15:27:13 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:21.963 15:27:13 -- common/autotest_common.sh@1540 -- # grep oacs 00:03:21.963 15:27:13 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:21.963 15:27:13 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:03:21.963 15:27:13 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:03:21.963 15:27:13 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:03:21.963 15:27:13 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:03:21.963 15:27:13 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:03:21.963 15:27:13 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:03:21.963 15:27:13 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:03:21.963 15:27:13 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:03:21.963 15:27:13 -- common/autotest_common.sh@1552 -- # continue 00:03:21.963 15:27:13 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:03:21.963 15:27:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:21.963 15:27:13 -- common/autotest_common.sh@10 -- # set +x 00:03:22.222 15:27:13 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:03:22.222 15:27:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:22.222 15:27:13 -- common/autotest_common.sh@10 -- # set +x 00:03:22.222 15:27:13 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:23.160 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:23.160 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:23.160 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:23.160 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:23.160 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:23.160 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:23.160 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:23.420 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:23.420 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:23.420 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:23.420 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:23.420 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:23.420 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:23.420 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:23.420 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:23.420 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:24.357 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:24.357 15:27:15 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:03:24.357 15:27:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:24.357 15:27:15 -- common/autotest_common.sh@10 -- # set +x 00:03:24.357 15:27:15 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:03:24.357 15:27:15 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:03:24.357 15:27:15 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:03:24.357 15:27:15 -- common/autotest_common.sh@1572 -- # bdfs=() 00:03:24.357 15:27:15 -- common/autotest_common.sh@1572 -- # local bdfs 00:03:24.357 15:27:15 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:03:24.357 15:27:15 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:24.357 15:27:15 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:24.357 15:27:15 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:24.357 15:27:15 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:24.357 15:27:15 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:24.357 15:27:15 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:24.357 15:27:15 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:24.357 15:27:15 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:03:24.357 15:27:15 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:24.357 15:27:15 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:03:24.357 15:27:15 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:24.357 15:27:15 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:03:24.358 15:27:15 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:03:24.358 15:27:15 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:03:24.358 15:27:15 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=744251 00:03:24.358 15:27:15 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:24.358 15:27:15 -- common/autotest_common.sh@1593 -- # waitforlisten 744251 00:03:24.358 15:27:15 -- common/autotest_common.sh@829 -- # '[' -z 744251 ']' 00:03:24.358 15:27:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:24.358 15:27:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:24.358 15:27:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:24.358 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:24.358 15:27:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:24.358 15:27:15 -- common/autotest_common.sh@10 -- # set +x 00:03:24.617 [2024-11-26 15:27:15.834386] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:24.617 [2024-11-26 15:27:15.834461] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid744251 ] 00:03:24.617 EAL: No free 2048 kB hugepages reported on node 1 00:03:24.617 [2024-11-26 15:27:15.895161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:24.617 [2024-11-26 15:27:16.009295] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:24.618 [2024-11-26 15:27:16.009466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:25.554 15:27:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:25.554 15:27:16 -- common/autotest_common.sh@862 -- # return 0 00:03:25.554 15:27:16 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:03:25.554 15:27:16 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:03:25.554 15:27:16 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:03:28.845 nvme0n1 00:03:28.845 15:27:19 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:03:28.845 [2024-11-26 15:27:20.117215] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:03:28.845 [2024-11-26 15:27:20.117273] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:03:28.845 request: 00:03:28.845 { 00:03:28.845 "nvme_ctrlr_name": "nvme0", 00:03:28.845 "password": "test", 00:03:28.845 "method": "bdev_nvme_opal_revert", 00:03:28.845 "req_id": 1 00:03:28.845 } 00:03:28.845 Got JSON-RPC error response 00:03:28.845 response: 00:03:28.845 { 00:03:28.845 "code": -32603, 00:03:28.845 "message": "Internal error" 00:03:28.845 } 00:03:28.845 15:27:20 -- common/autotest_common.sh@1599 -- # true 00:03:28.846 15:27:20 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:03:28.846 15:27:20 -- common/autotest_common.sh@1603 -- # killprocess 744251 00:03:28.846 15:27:20 -- common/autotest_common.sh@936 -- # '[' -z 744251 ']' 00:03:28.846 15:27:20 -- common/autotest_common.sh@940 -- # kill -0 744251 00:03:28.846 15:27:20 -- common/autotest_common.sh@941 -- # uname 00:03:28.846 15:27:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:28.846 15:27:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 744251 00:03:28.846 15:27:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:28.846 15:27:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:28.846 15:27:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 744251' 00:03:28.846 killing process with pid 744251 00:03:28.846 15:27:20 -- common/autotest_common.sh@955 -- # kill 744251 00:03:28.846 15:27:20 -- common/autotest_common.sh@960 -- # wait 744251 00:03:30.752 15:27:22 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:03:30.752 15:27:22 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:03:30.752 15:27:22 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:03:30.752 15:27:22 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:03:30.752 15:27:22 -- spdk/autotest.sh@160 -- # timing_enter lib 00:03:30.752 15:27:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:30.752 15:27:22 -- common/autotest_common.sh@10 -- # set +x 00:03:30.752 15:27:22 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:30.752 15:27:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:30.752 15:27:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:30.752 15:27:22 -- common/autotest_common.sh@10 -- # set +x 00:03:30.752 ************************************ 00:03:30.752 START TEST env 00:03:30.752 ************************************ 00:03:30.752 15:27:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:30.752 * Looking for test storage... 00:03:30.752 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:03:30.752 15:27:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:30.752 15:27:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:30.752 15:27:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:30.752 15:27:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:30.752 15:27:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:30.752 15:27:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:30.752 15:27:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:30.752 15:27:22 -- scripts/common.sh@335 -- # IFS=.-: 00:03:30.752 15:27:22 -- scripts/common.sh@335 -- # read -ra ver1 00:03:30.752 15:27:22 -- scripts/common.sh@336 -- # IFS=.-: 00:03:30.752 15:27:22 -- scripts/common.sh@336 -- # read -ra ver2 00:03:30.752 15:27:22 -- scripts/common.sh@337 -- # local 'op=<' 00:03:30.752 15:27:22 -- scripts/common.sh@339 -- # ver1_l=2 00:03:30.752 15:27:22 -- scripts/common.sh@340 -- # ver2_l=1 00:03:30.752 15:27:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:30.752 15:27:22 -- scripts/common.sh@343 -- # case "$op" in 00:03:30.752 15:27:22 -- scripts/common.sh@344 -- # : 1 00:03:30.752 15:27:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:30.752 15:27:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:30.752 15:27:22 -- scripts/common.sh@364 -- # decimal 1 00:03:30.752 15:27:22 -- scripts/common.sh@352 -- # local d=1 00:03:30.752 15:27:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:30.752 15:27:22 -- scripts/common.sh@354 -- # echo 1 00:03:30.752 15:27:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:30.752 15:27:22 -- scripts/common.sh@365 -- # decimal 2 00:03:30.752 15:27:22 -- scripts/common.sh@352 -- # local d=2 00:03:30.752 15:27:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:30.752 15:27:22 -- scripts/common.sh@354 -- # echo 2 00:03:30.752 15:27:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:30.752 15:27:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:30.752 15:27:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:30.752 15:27:22 -- scripts/common.sh@367 -- # return 0 00:03:30.752 15:27:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:30.752 15:27:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:30.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.752 --rc genhtml_branch_coverage=1 00:03:30.752 --rc genhtml_function_coverage=1 00:03:30.752 --rc genhtml_legend=1 00:03:30.752 --rc geninfo_all_blocks=1 00:03:30.753 --rc geninfo_unexecuted_blocks=1 00:03:30.753 00:03:30.753 ' 00:03:30.753 15:27:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:30.753 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.753 --rc genhtml_branch_coverage=1 00:03:30.753 --rc genhtml_function_coverage=1 00:03:30.753 --rc genhtml_legend=1 00:03:30.753 --rc geninfo_all_blocks=1 00:03:30.753 --rc geninfo_unexecuted_blocks=1 00:03:30.753 00:03:30.753 ' 00:03:30.753 15:27:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:30.753 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.753 --rc genhtml_branch_coverage=1 00:03:30.753 --rc genhtml_function_coverage=1 00:03:30.753 --rc genhtml_legend=1 00:03:30.753 --rc geninfo_all_blocks=1 00:03:30.753 --rc geninfo_unexecuted_blocks=1 00:03:30.753 00:03:30.753 ' 00:03:30.753 15:27:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:30.753 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.753 --rc genhtml_branch_coverage=1 00:03:30.753 --rc genhtml_function_coverage=1 00:03:30.753 --rc genhtml_legend=1 00:03:30.753 --rc geninfo_all_blocks=1 00:03:30.753 --rc geninfo_unexecuted_blocks=1 00:03:30.753 00:03:30.753 ' 00:03:30.753 15:27:22 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:30.753 15:27:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:30.753 15:27:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:30.753 15:27:22 -- common/autotest_common.sh@10 -- # set +x 00:03:30.753 ************************************ 00:03:30.753 START TEST env_memory 00:03:30.753 ************************************ 00:03:30.753 15:27:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:30.753 00:03:30.753 00:03:30.753 CUnit - A unit testing framework for C - Version 2.1-3 00:03:30.753 http://cunit.sourceforge.net/ 00:03:30.753 00:03:30.753 00:03:30.753 Suite: memory 00:03:30.753 Test: alloc and free memory map ...[2024-11-26 15:27:22.199652] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:03:31.014 passed 00:03:31.014 Test: mem map translation ...[2024-11-26 15:27:22.219918] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:03:31.014 [2024-11-26 15:27:22.219941] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:03:31.014 [2024-11-26 15:27:22.219990] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:03:31.014 [2024-11-26 15:27:22.220002] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:03:31.014 passed 00:03:31.014 Test: mem map registration ...[2024-11-26 15:27:22.261468] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:03:31.014 [2024-11-26 15:27:22.261489] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:03:31.014 passed 00:03:31.014 Test: mem map adjacent registrations ...passed 00:03:31.014 00:03:31.014 Run Summary: Type Total Ran Passed Failed Inactive 00:03:31.014 suites 1 1 n/a 0 0 00:03:31.014 tests 4 4 4 0 0 00:03:31.014 asserts 152 152 152 0 n/a 00:03:31.014 00:03:31.014 Elapsed time = 0.146 seconds 00:03:31.014 00:03:31.014 real 0m0.154s 00:03:31.014 user 0m0.147s 00:03:31.014 sys 0m0.006s 00:03:31.014 15:27:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:31.014 15:27:22 -- common/autotest_common.sh@10 -- # set +x 00:03:31.014 ************************************ 00:03:31.014 END TEST env_memory 00:03:31.014 ************************************ 00:03:31.014 15:27:22 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:31.014 15:27:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:31.014 15:27:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:31.014 15:27:22 -- common/autotest_common.sh@10 -- # set +x 00:03:31.014 ************************************ 00:03:31.014 START TEST env_vtophys 00:03:31.014 ************************************ 00:03:31.014 15:27:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:31.014 EAL: lib.eal log level changed from notice to debug 00:03:31.014 EAL: Detected lcore 0 as core 0 on socket 0 00:03:31.014 EAL: Detected lcore 1 as core 1 on socket 0 00:03:31.014 EAL: Detected lcore 2 as core 2 on socket 0 00:03:31.014 EAL: Detected lcore 3 as core 3 on socket 0 00:03:31.014 EAL: Detected lcore 4 as core 4 on socket 0 00:03:31.014 EAL: Detected lcore 5 as core 5 on socket 0 00:03:31.014 EAL: Detected lcore 6 as core 8 on socket 0 00:03:31.014 EAL: Detected lcore 7 as core 9 on socket 0 00:03:31.014 EAL: Detected lcore 8 as core 10 on socket 0 00:03:31.014 EAL: Detected lcore 9 as core 11 on socket 0 00:03:31.014 EAL: Detected lcore 10 as core 12 on socket 0 00:03:31.014 EAL: Detected lcore 11 as core 13 on socket 0 00:03:31.014 EAL: Detected lcore 12 as core 0 on socket 1 00:03:31.014 EAL: Detected lcore 13 as core 1 on socket 1 00:03:31.014 EAL: Detected lcore 14 as core 2 on socket 1 00:03:31.014 EAL: Detected lcore 15 as core 3 on socket 1 00:03:31.014 EAL: Detected lcore 16 as core 4 on socket 1 00:03:31.014 EAL: Detected lcore 17 as core 5 on socket 1 00:03:31.014 EAL: Detected lcore 18 as core 8 on socket 1 00:03:31.014 EAL: Detected lcore 19 as core 9 on socket 1 00:03:31.014 EAL: Detected lcore 20 as core 10 on socket 1 00:03:31.014 EAL: Detected lcore 21 as core 11 on socket 1 00:03:31.014 EAL: Detected lcore 22 as core 12 on socket 1 00:03:31.014 EAL: Detected lcore 23 as core 13 on socket 1 00:03:31.014 EAL: Detected lcore 24 as core 0 on socket 0 00:03:31.014 EAL: Detected lcore 25 as core 1 on socket 0 00:03:31.014 EAL: Detected lcore 26 as core 2 on socket 0 00:03:31.014 EAL: Detected lcore 27 as core 3 on socket 0 00:03:31.014 EAL: Detected lcore 28 as core 4 on socket 0 00:03:31.014 EAL: Detected lcore 29 as core 5 on socket 0 00:03:31.014 EAL: Detected lcore 30 as core 8 on socket 0 00:03:31.014 EAL: Detected lcore 31 as core 9 on socket 0 00:03:31.014 EAL: Detected lcore 32 as core 10 on socket 0 00:03:31.014 EAL: Detected lcore 33 as core 11 on socket 0 00:03:31.014 EAL: Detected lcore 34 as core 12 on socket 0 00:03:31.014 EAL: Detected lcore 35 as core 13 on socket 0 00:03:31.014 EAL: Detected lcore 36 as core 0 on socket 1 00:03:31.014 EAL: Detected lcore 37 as core 1 on socket 1 00:03:31.014 EAL: Detected lcore 38 as core 2 on socket 1 00:03:31.014 EAL: Detected lcore 39 as core 3 on socket 1 00:03:31.014 EAL: Detected lcore 40 as core 4 on socket 1 00:03:31.014 EAL: Detected lcore 41 as core 5 on socket 1 00:03:31.014 EAL: Detected lcore 42 as core 8 on socket 1 00:03:31.014 EAL: Detected lcore 43 as core 9 on socket 1 00:03:31.014 EAL: Detected lcore 44 as core 10 on socket 1 00:03:31.014 EAL: Detected lcore 45 as core 11 on socket 1 00:03:31.014 EAL: Detected lcore 46 as core 12 on socket 1 00:03:31.014 EAL: Detected lcore 47 as core 13 on socket 1 00:03:31.014 EAL: Maximum logical cores by configuration: 128 00:03:31.014 EAL: Detected CPU lcores: 48 00:03:31.014 EAL: Detected NUMA nodes: 2 00:03:31.014 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:03:31.014 EAL: Detected shared linkage of DPDK 00:03:31.014 EAL: No shared files mode enabled, IPC will be disabled 00:03:31.014 EAL: Bus pci wants IOVA as 'DC' 00:03:31.014 EAL: Buses did not request a specific IOVA mode. 00:03:31.014 EAL: IOMMU is available, selecting IOVA as VA mode. 00:03:31.014 EAL: Selected IOVA mode 'VA' 00:03:31.014 EAL: No free 2048 kB hugepages reported on node 1 00:03:31.014 EAL: Probing VFIO support... 00:03:31.014 EAL: IOMMU type 1 (Type 1) is supported 00:03:31.014 EAL: IOMMU type 7 (sPAPR) is not supported 00:03:31.014 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:03:31.014 EAL: VFIO support initialized 00:03:31.014 EAL: Ask a virtual area of 0x2e000 bytes 00:03:31.014 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:03:31.014 EAL: Setting up physically contiguous memory... 00:03:31.014 EAL: Setting maximum number of open files to 524288 00:03:31.014 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:03:31.014 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:03:31.014 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:03:31.014 EAL: Ask a virtual area of 0x61000 bytes 00:03:31.014 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:03:31.014 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:31.014 EAL: Ask a virtual area of 0x400000000 bytes 00:03:31.014 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:03:31.014 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:03:31.014 EAL: Ask a virtual area of 0x61000 bytes 00:03:31.014 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:03:31.014 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:31.014 EAL: Ask a virtual area of 0x400000000 bytes 00:03:31.014 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:03:31.014 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:03:31.014 EAL: Ask a virtual area of 0x61000 bytes 00:03:31.014 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:03:31.014 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:31.014 EAL: Ask a virtual area of 0x400000000 bytes 00:03:31.014 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:03:31.014 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:03:31.014 EAL: Ask a virtual area of 0x61000 bytes 00:03:31.014 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:03:31.014 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:31.014 EAL: Ask a virtual area of 0x400000000 bytes 00:03:31.014 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:03:31.014 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:03:31.014 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:03:31.014 EAL: Ask a virtual area of 0x61000 bytes 00:03:31.014 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:03:31.014 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:31.014 EAL: Ask a virtual area of 0x400000000 bytes 00:03:31.014 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:03:31.014 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:03:31.014 EAL: Ask a virtual area of 0x61000 bytes 00:03:31.014 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:03:31.014 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:31.014 EAL: Ask a virtual area of 0x400000000 bytes 00:03:31.014 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:03:31.014 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:03:31.014 EAL: Ask a virtual area of 0x61000 bytes 00:03:31.014 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:03:31.014 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:31.014 EAL: Ask a virtual area of 0x400000000 bytes 00:03:31.014 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:03:31.014 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:03:31.014 EAL: Ask a virtual area of 0x61000 bytes 00:03:31.014 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:03:31.014 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:31.014 EAL: Ask a virtual area of 0x400000000 bytes 00:03:31.014 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:03:31.014 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:03:31.014 EAL: Hugepages will be freed exactly as allocated. 00:03:31.015 EAL: No shared files mode enabled, IPC is disabled 00:03:31.015 EAL: No shared files mode enabled, IPC is disabled 00:03:31.015 EAL: TSC frequency is ~2700000 KHz 00:03:31.015 EAL: Main lcore 0 is ready (tid=7f8cb1375a00;cpuset=[0]) 00:03:31.015 EAL: Trying to obtain current memory policy. 00:03:31.015 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:31.015 EAL: Restoring previous memory policy: 0 00:03:31.015 EAL: request: mp_malloc_sync 00:03:31.015 EAL: No shared files mode enabled, IPC is disabled 00:03:31.015 EAL: Heap on socket 0 was expanded by 2MB 00:03:31.015 EAL: No shared files mode enabled, IPC is disabled 00:03:31.015 EAL: No PCI address specified using 'addr=' in: bus=pci 00:03:31.015 EAL: Mem event callback 'spdk:(nil)' registered 00:03:31.015 00:03:31.015 00:03:31.015 CUnit - A unit testing framework for C - Version 2.1-3 00:03:31.015 http://cunit.sourceforge.net/ 00:03:31.015 00:03:31.015 00:03:31.015 Suite: components_suite 00:03:31.015 Test: vtophys_malloc_test ...passed 00:03:31.015 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:03:31.015 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:31.015 EAL: Restoring previous memory policy: 4 00:03:31.015 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.015 EAL: request: mp_malloc_sync 00:03:31.015 EAL: No shared files mode enabled, IPC is disabled 00:03:31.015 EAL: Heap on socket 0 was expanded by 4MB 00:03:31.015 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.015 EAL: request: mp_malloc_sync 00:03:31.015 EAL: No shared files mode enabled, IPC is disabled 00:03:31.015 EAL: Heap on socket 0 was shrunk by 4MB 00:03:31.015 EAL: Trying to obtain current memory policy. 00:03:31.015 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:31.015 EAL: Restoring previous memory policy: 4 00:03:31.015 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.015 EAL: request: mp_malloc_sync 00:03:31.015 EAL: No shared files mode enabled, IPC is disabled 00:03:31.015 EAL: Heap on socket 0 was expanded by 6MB 00:03:31.015 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.015 EAL: request: mp_malloc_sync 00:03:31.015 EAL: No shared files mode enabled, IPC is disabled 00:03:31.015 EAL: Heap on socket 0 was shrunk by 6MB 00:03:31.015 EAL: Trying to obtain current memory policy. 00:03:31.015 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:31.015 EAL: Restoring previous memory policy: 4 00:03:31.015 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.015 EAL: request: mp_malloc_sync 00:03:31.015 EAL: No shared files mode enabled, IPC is disabled 00:03:31.015 EAL: Heap on socket 0 was expanded by 10MB 00:03:31.015 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.015 EAL: request: mp_malloc_sync 00:03:31.015 EAL: No shared files mode enabled, IPC is disabled 00:03:31.015 EAL: Heap on socket 0 was shrunk by 10MB 00:03:31.015 EAL: Trying to obtain current memory policy. 00:03:31.015 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:31.015 EAL: Restoring previous memory policy: 4 00:03:31.015 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.015 EAL: request: mp_malloc_sync 00:03:31.015 EAL: No shared files mode enabled, IPC is disabled 00:03:31.015 EAL: Heap on socket 0 was expanded by 18MB 00:03:31.015 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.015 EAL: request: mp_malloc_sync 00:03:31.015 EAL: No shared files mode enabled, IPC is disabled 00:03:31.015 EAL: Heap on socket 0 was shrunk by 18MB 00:03:31.015 EAL: Trying to obtain current memory policy. 00:03:31.015 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:31.015 EAL: Restoring previous memory policy: 4 00:03:31.015 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.015 EAL: request: mp_malloc_sync 00:03:31.015 EAL: No shared files mode enabled, IPC is disabled 00:03:31.015 EAL: Heap on socket 0 was expanded by 34MB 00:03:31.015 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.015 EAL: request: mp_malloc_sync 00:03:31.015 EAL: No shared files mode enabled, IPC is disabled 00:03:31.015 EAL: Heap on socket 0 was shrunk by 34MB 00:03:31.015 EAL: Trying to obtain current memory policy. 00:03:31.015 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:31.275 EAL: Restoring previous memory policy: 4 00:03:31.275 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.275 EAL: request: mp_malloc_sync 00:03:31.275 EAL: No shared files mode enabled, IPC is disabled 00:03:31.275 EAL: Heap on socket 0 was expanded by 66MB 00:03:31.275 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.275 EAL: request: mp_malloc_sync 00:03:31.275 EAL: No shared files mode enabled, IPC is disabled 00:03:31.275 EAL: Heap on socket 0 was shrunk by 66MB 00:03:31.275 EAL: Trying to obtain current memory policy. 00:03:31.275 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:31.275 EAL: Restoring previous memory policy: 4 00:03:31.275 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.275 EAL: request: mp_malloc_sync 00:03:31.275 EAL: No shared files mode enabled, IPC is disabled 00:03:31.275 EAL: Heap on socket 0 was expanded by 130MB 00:03:31.275 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.275 EAL: request: mp_malloc_sync 00:03:31.275 EAL: No shared files mode enabled, IPC is disabled 00:03:31.275 EAL: Heap on socket 0 was shrunk by 130MB 00:03:31.275 EAL: Trying to obtain current memory policy. 00:03:31.275 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:31.275 EAL: Restoring previous memory policy: 4 00:03:31.275 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.275 EAL: request: mp_malloc_sync 00:03:31.275 EAL: No shared files mode enabled, IPC is disabled 00:03:31.275 EAL: Heap on socket 0 was expanded by 258MB 00:03:31.275 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.535 EAL: request: mp_malloc_sync 00:03:31.535 EAL: No shared files mode enabled, IPC is disabled 00:03:31.535 EAL: Heap on socket 0 was shrunk by 258MB 00:03:31.535 EAL: Trying to obtain current memory policy. 00:03:31.535 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:31.535 EAL: Restoring previous memory policy: 4 00:03:31.535 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.535 EAL: request: mp_malloc_sync 00:03:31.535 EAL: No shared files mode enabled, IPC is disabled 00:03:31.535 EAL: Heap on socket 0 was expanded by 514MB 00:03:31.794 EAL: Calling mem event callback 'spdk:(nil)' 00:03:31.794 EAL: request: mp_malloc_sync 00:03:31.794 EAL: No shared files mode enabled, IPC is disabled 00:03:31.794 EAL: Heap on socket 0 was shrunk by 514MB 00:03:31.794 EAL: Trying to obtain current memory policy. 00:03:31.794 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:32.052 EAL: Restoring previous memory policy: 4 00:03:32.052 EAL: Calling mem event callback 'spdk:(nil)' 00:03:32.052 EAL: request: mp_malloc_sync 00:03:32.052 EAL: No shared files mode enabled, IPC is disabled 00:03:32.052 EAL: Heap on socket 0 was expanded by 1026MB 00:03:32.312 EAL: Calling mem event callback 'spdk:(nil)' 00:03:32.572 EAL: request: mp_malloc_sync 00:03:32.572 EAL: No shared files mode enabled, IPC is disabled 00:03:32.572 EAL: Heap on socket 0 was shrunk by 1026MB 00:03:32.572 passed 00:03:32.572 00:03:32.572 Run Summary: Type Total Ran Passed Failed Inactive 00:03:32.572 suites 1 1 n/a 0 0 00:03:32.572 tests 2 2 2 0 0 00:03:32.572 asserts 497 497 497 0 n/a 00:03:32.572 00:03:32.572 Elapsed time = 1.377 seconds 00:03:32.572 EAL: Calling mem event callback 'spdk:(nil)' 00:03:32.572 EAL: request: mp_malloc_sync 00:03:32.572 EAL: No shared files mode enabled, IPC is disabled 00:03:32.572 EAL: Heap on socket 0 was shrunk by 2MB 00:03:32.572 EAL: No shared files mode enabled, IPC is disabled 00:03:32.572 EAL: No shared files mode enabled, IPC is disabled 00:03:32.572 EAL: No shared files mode enabled, IPC is disabled 00:03:32.572 00:03:32.572 real 0m1.497s 00:03:32.572 user 0m0.858s 00:03:32.572 sys 0m0.600s 00:03:32.572 15:27:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:32.572 15:27:23 -- common/autotest_common.sh@10 -- # set +x 00:03:32.572 ************************************ 00:03:32.572 END TEST env_vtophys 00:03:32.572 ************************************ 00:03:32.572 15:27:23 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:32.572 15:27:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:32.572 15:27:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:32.572 15:27:23 -- common/autotest_common.sh@10 -- # set +x 00:03:32.572 ************************************ 00:03:32.572 START TEST env_pci 00:03:32.572 ************************************ 00:03:32.572 15:27:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:32.572 00:03:32.572 00:03:32.572 CUnit - A unit testing framework for C - Version 2.1-3 00:03:32.572 http://cunit.sourceforge.net/ 00:03:32.572 00:03:32.572 00:03:32.572 Suite: pci 00:03:32.572 Test: pci_hook ...[2024-11-26 15:27:23.882554] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 745294 has claimed it 00:03:32.572 EAL: Cannot find device (10000:00:01.0) 00:03:32.572 EAL: Failed to attach device on primary process 00:03:32.572 passed 00:03:32.572 00:03:32.572 Run Summary: Type Total Ran Passed Failed Inactive 00:03:32.572 suites 1 1 n/a 0 0 00:03:32.572 tests 1 1 1 0 0 00:03:32.572 asserts 25 25 25 0 n/a 00:03:32.572 00:03:32.572 Elapsed time = 0.022 seconds 00:03:32.572 00:03:32.572 real 0m0.035s 00:03:32.572 user 0m0.011s 00:03:32.572 sys 0m0.024s 00:03:32.572 15:27:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:32.572 15:27:23 -- common/autotest_common.sh@10 -- # set +x 00:03:32.572 ************************************ 00:03:32.572 END TEST env_pci 00:03:32.572 ************************************ 00:03:32.572 15:27:23 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:03:32.572 15:27:23 -- env/env.sh@15 -- # uname 00:03:32.572 15:27:23 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:03:32.572 15:27:23 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:03:32.572 15:27:23 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:32.572 15:27:23 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:03:32.572 15:27:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:32.572 15:27:23 -- common/autotest_common.sh@10 -- # set +x 00:03:32.572 ************************************ 00:03:32.572 START TEST env_dpdk_post_init 00:03:32.572 ************************************ 00:03:32.572 15:27:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:32.572 EAL: Detected CPU lcores: 48 00:03:32.572 EAL: Detected NUMA nodes: 2 00:03:32.572 EAL: Detected shared linkage of DPDK 00:03:32.572 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:32.572 EAL: Selected IOVA mode 'VA' 00:03:32.572 EAL: No free 2048 kB hugepages reported on node 1 00:03:32.572 EAL: VFIO support initialized 00:03:32.572 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:32.831 EAL: Using IOMMU type 1 (Type 1) 00:03:32.831 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:03:32.831 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:03:32.831 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:03:32.831 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:03:32.831 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:03:32.832 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:03:32.832 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:03:32.832 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:03:32.832 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:03:32.832 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:03:32.832 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:03:32.832 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:03:32.832 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:03:32.832 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:03:32.832 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:03:32.832 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:03:33.771 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:03:37.064 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:03:37.064 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:03:37.064 Starting DPDK initialization... 00:03:37.064 Starting SPDK post initialization... 00:03:37.064 SPDK NVMe probe 00:03:37.064 Attaching to 0000:88:00.0 00:03:37.064 Attached to 0000:88:00.0 00:03:37.064 Cleaning up... 00:03:37.064 00:03:37.064 real 0m4.410s 00:03:37.064 user 0m3.287s 00:03:37.064 sys 0m0.179s 00:03:37.064 15:27:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:37.064 15:27:28 -- common/autotest_common.sh@10 -- # set +x 00:03:37.064 ************************************ 00:03:37.064 END TEST env_dpdk_post_init 00:03:37.064 ************************************ 00:03:37.064 15:27:28 -- env/env.sh@26 -- # uname 00:03:37.064 15:27:28 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:03:37.064 15:27:28 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:03:37.064 15:27:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:37.064 15:27:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:37.064 15:27:28 -- common/autotest_common.sh@10 -- # set +x 00:03:37.064 ************************************ 00:03:37.064 START TEST env_mem_callbacks 00:03:37.064 ************************************ 00:03:37.064 15:27:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:03:37.064 EAL: Detected CPU lcores: 48 00:03:37.064 EAL: Detected NUMA nodes: 2 00:03:37.064 EAL: Detected shared linkage of DPDK 00:03:37.064 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:37.064 EAL: Selected IOVA mode 'VA' 00:03:37.064 EAL: No free 2048 kB hugepages reported on node 1 00:03:37.064 EAL: VFIO support initialized 00:03:37.064 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:37.064 00:03:37.064 00:03:37.064 CUnit - A unit testing framework for C - Version 2.1-3 00:03:37.064 http://cunit.sourceforge.net/ 00:03:37.064 00:03:37.064 00:03:37.064 Suite: memory 00:03:37.064 Test: test ... 00:03:37.064 register 0x200000200000 2097152 00:03:37.064 malloc 3145728 00:03:37.064 register 0x200000400000 4194304 00:03:37.064 buf 0x200000500000 len 3145728 PASSED 00:03:37.064 malloc 64 00:03:37.064 buf 0x2000004fff40 len 64 PASSED 00:03:37.064 malloc 4194304 00:03:37.064 register 0x200000800000 6291456 00:03:37.064 buf 0x200000a00000 len 4194304 PASSED 00:03:37.064 free 0x200000500000 3145728 00:03:37.064 free 0x2000004fff40 64 00:03:37.064 unregister 0x200000400000 4194304 PASSED 00:03:37.065 free 0x200000a00000 4194304 00:03:37.065 unregister 0x200000800000 6291456 PASSED 00:03:37.065 malloc 8388608 00:03:37.065 register 0x200000400000 10485760 00:03:37.065 buf 0x200000600000 len 8388608 PASSED 00:03:37.065 free 0x200000600000 8388608 00:03:37.065 unregister 0x200000400000 10485760 PASSED 00:03:37.065 passed 00:03:37.065 00:03:37.065 Run Summary: Type Total Ran Passed Failed Inactive 00:03:37.065 suites 1 1 n/a 0 0 00:03:37.065 tests 1 1 1 0 0 00:03:37.065 asserts 15 15 15 0 n/a 00:03:37.065 00:03:37.065 Elapsed time = 0.005 seconds 00:03:37.065 00:03:37.065 real 0m0.048s 00:03:37.065 user 0m0.014s 00:03:37.065 sys 0m0.034s 00:03:37.065 15:27:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:37.065 15:27:28 -- common/autotest_common.sh@10 -- # set +x 00:03:37.065 ************************************ 00:03:37.065 END TEST env_mem_callbacks 00:03:37.065 ************************************ 00:03:37.065 00:03:37.065 real 0m6.417s 00:03:37.065 user 0m4.462s 00:03:37.065 sys 0m0.999s 00:03:37.065 15:27:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:37.065 15:27:28 -- common/autotest_common.sh@10 -- # set +x 00:03:37.065 ************************************ 00:03:37.065 END TEST env 00:03:37.065 ************************************ 00:03:37.065 15:27:28 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:03:37.065 15:27:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:37.065 15:27:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:37.065 15:27:28 -- common/autotest_common.sh@10 -- # set +x 00:03:37.065 ************************************ 00:03:37.065 START TEST rpc 00:03:37.065 ************************************ 00:03:37.065 15:27:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:03:37.323 * Looking for test storage... 00:03:37.323 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:37.323 15:27:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:37.323 15:27:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:37.323 15:27:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:37.323 15:27:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:37.323 15:27:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:37.323 15:27:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:37.323 15:27:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:37.323 15:27:28 -- scripts/common.sh@335 -- # IFS=.-: 00:03:37.323 15:27:28 -- scripts/common.sh@335 -- # read -ra ver1 00:03:37.323 15:27:28 -- scripts/common.sh@336 -- # IFS=.-: 00:03:37.323 15:27:28 -- scripts/common.sh@336 -- # read -ra ver2 00:03:37.323 15:27:28 -- scripts/common.sh@337 -- # local 'op=<' 00:03:37.323 15:27:28 -- scripts/common.sh@339 -- # ver1_l=2 00:03:37.323 15:27:28 -- scripts/common.sh@340 -- # ver2_l=1 00:03:37.323 15:27:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:37.323 15:27:28 -- scripts/common.sh@343 -- # case "$op" in 00:03:37.323 15:27:28 -- scripts/common.sh@344 -- # : 1 00:03:37.323 15:27:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:37.323 15:27:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:37.323 15:27:28 -- scripts/common.sh@364 -- # decimal 1 00:03:37.323 15:27:28 -- scripts/common.sh@352 -- # local d=1 00:03:37.323 15:27:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:37.323 15:27:28 -- scripts/common.sh@354 -- # echo 1 00:03:37.323 15:27:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:37.323 15:27:28 -- scripts/common.sh@365 -- # decimal 2 00:03:37.323 15:27:28 -- scripts/common.sh@352 -- # local d=2 00:03:37.323 15:27:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:37.323 15:27:28 -- scripts/common.sh@354 -- # echo 2 00:03:37.323 15:27:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:37.323 15:27:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:37.323 15:27:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:37.323 15:27:28 -- scripts/common.sh@367 -- # return 0 00:03:37.323 15:27:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:37.323 15:27:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:37.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:37.323 --rc genhtml_branch_coverage=1 00:03:37.323 --rc genhtml_function_coverage=1 00:03:37.323 --rc genhtml_legend=1 00:03:37.323 --rc geninfo_all_blocks=1 00:03:37.323 --rc geninfo_unexecuted_blocks=1 00:03:37.323 00:03:37.323 ' 00:03:37.324 15:27:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:37.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:37.324 --rc genhtml_branch_coverage=1 00:03:37.324 --rc genhtml_function_coverage=1 00:03:37.324 --rc genhtml_legend=1 00:03:37.324 --rc geninfo_all_blocks=1 00:03:37.324 --rc geninfo_unexecuted_blocks=1 00:03:37.324 00:03:37.324 ' 00:03:37.324 15:27:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:37.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:37.324 --rc genhtml_branch_coverage=1 00:03:37.324 --rc genhtml_function_coverage=1 00:03:37.324 --rc genhtml_legend=1 00:03:37.324 --rc geninfo_all_blocks=1 00:03:37.324 --rc geninfo_unexecuted_blocks=1 00:03:37.324 00:03:37.324 ' 00:03:37.324 15:27:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:37.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:37.324 --rc genhtml_branch_coverage=1 00:03:37.324 --rc genhtml_function_coverage=1 00:03:37.324 --rc genhtml_legend=1 00:03:37.324 --rc geninfo_all_blocks=1 00:03:37.324 --rc geninfo_unexecuted_blocks=1 00:03:37.324 00:03:37.324 ' 00:03:37.324 15:27:28 -- rpc/rpc.sh@65 -- # spdk_pid=745965 00:03:37.324 15:27:28 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:03:37.324 15:27:28 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:03:37.324 15:27:28 -- rpc/rpc.sh@67 -- # waitforlisten 745965 00:03:37.324 15:27:28 -- common/autotest_common.sh@829 -- # '[' -z 745965 ']' 00:03:37.324 15:27:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:37.324 15:27:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:37.324 15:27:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:37.324 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:37.324 15:27:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:37.324 15:27:28 -- common/autotest_common.sh@10 -- # set +x 00:03:37.324 [2024-11-26 15:27:28.658263] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:37.324 [2024-11-26 15:27:28.658340] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid745965 ] 00:03:37.324 EAL: No free 2048 kB hugepages reported on node 1 00:03:37.324 [2024-11-26 15:27:28.717710] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:37.582 [2024-11-26 15:27:28.829283] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:37.582 [2024-11-26 15:27:28.829455] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:03:37.582 [2024-11-26 15:27:28.829480] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 745965' to capture a snapshot of events at runtime. 00:03:37.582 [2024-11-26 15:27:28.829496] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid745965 for offline analysis/debug. 00:03:37.582 [2024-11-26 15:27:28.829529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:38.521 15:27:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:38.521 15:27:29 -- common/autotest_common.sh@862 -- # return 0 00:03:38.521 15:27:29 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:38.521 15:27:29 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:38.521 15:27:29 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:03:38.521 15:27:29 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:03:38.521 15:27:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:38.521 15:27:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:38.521 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.521 ************************************ 00:03:38.521 START TEST rpc_integrity 00:03:38.521 ************************************ 00:03:38.521 15:27:29 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:03:38.521 15:27:29 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:03:38.521 15:27:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:38.521 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.521 15:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.521 15:27:29 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:03:38.521 15:27:29 -- rpc/rpc.sh@13 -- # jq length 00:03:38.521 15:27:29 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:03:38.521 15:27:29 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:03:38.521 15:27:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:38.521 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.521 15:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.521 15:27:29 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:03:38.521 15:27:29 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:03:38.521 15:27:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:38.521 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.521 15:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.521 15:27:29 -- rpc/rpc.sh@16 -- # bdevs='[ 00:03:38.521 { 00:03:38.521 "name": "Malloc0", 00:03:38.521 "aliases": [ 00:03:38.521 "13d838a9-db25-4c99-82f6-5dbae73185d8" 00:03:38.521 ], 00:03:38.521 "product_name": "Malloc disk", 00:03:38.521 "block_size": 512, 00:03:38.521 "num_blocks": 16384, 00:03:38.521 "uuid": "13d838a9-db25-4c99-82f6-5dbae73185d8", 00:03:38.521 "assigned_rate_limits": { 00:03:38.521 "rw_ios_per_sec": 0, 00:03:38.521 "rw_mbytes_per_sec": 0, 00:03:38.521 "r_mbytes_per_sec": 0, 00:03:38.521 "w_mbytes_per_sec": 0 00:03:38.521 }, 00:03:38.521 "claimed": false, 00:03:38.521 "zoned": false, 00:03:38.521 "supported_io_types": { 00:03:38.521 "read": true, 00:03:38.521 "write": true, 00:03:38.521 "unmap": true, 00:03:38.521 "write_zeroes": true, 00:03:38.521 "flush": true, 00:03:38.521 "reset": true, 00:03:38.521 "compare": false, 00:03:38.521 "compare_and_write": false, 00:03:38.521 "abort": true, 00:03:38.521 "nvme_admin": false, 00:03:38.521 "nvme_io": false 00:03:38.521 }, 00:03:38.521 "memory_domains": [ 00:03:38.521 { 00:03:38.521 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:38.521 "dma_device_type": 2 00:03:38.521 } 00:03:38.521 ], 00:03:38.521 "driver_specific": {} 00:03:38.521 } 00:03:38.521 ]' 00:03:38.521 15:27:29 -- rpc/rpc.sh@17 -- # jq length 00:03:38.521 15:27:29 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:03:38.521 15:27:29 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:03:38.521 15:27:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:38.521 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.521 [2024-11-26 15:27:29.723380] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:03:38.521 [2024-11-26 15:27:29.723436] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:03:38.521 [2024-11-26 15:27:29.723462] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x66ecb0 00:03:38.521 [2024-11-26 15:27:29.723491] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:03:38.521 [2024-11-26 15:27:29.724833] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:03:38.521 [2024-11-26 15:27:29.724865] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:03:38.521 Passthru0 00:03:38.521 15:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.521 15:27:29 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:03:38.521 15:27:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:38.521 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.521 15:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.521 15:27:29 -- rpc/rpc.sh@20 -- # bdevs='[ 00:03:38.521 { 00:03:38.521 "name": "Malloc0", 00:03:38.521 "aliases": [ 00:03:38.521 "13d838a9-db25-4c99-82f6-5dbae73185d8" 00:03:38.521 ], 00:03:38.521 "product_name": "Malloc disk", 00:03:38.521 "block_size": 512, 00:03:38.521 "num_blocks": 16384, 00:03:38.521 "uuid": "13d838a9-db25-4c99-82f6-5dbae73185d8", 00:03:38.521 "assigned_rate_limits": { 00:03:38.521 "rw_ios_per_sec": 0, 00:03:38.521 "rw_mbytes_per_sec": 0, 00:03:38.521 "r_mbytes_per_sec": 0, 00:03:38.521 "w_mbytes_per_sec": 0 00:03:38.521 }, 00:03:38.521 "claimed": true, 00:03:38.521 "claim_type": "exclusive_write", 00:03:38.521 "zoned": false, 00:03:38.521 "supported_io_types": { 00:03:38.521 "read": true, 00:03:38.521 "write": true, 00:03:38.521 "unmap": true, 00:03:38.521 "write_zeroes": true, 00:03:38.521 "flush": true, 00:03:38.521 "reset": true, 00:03:38.521 "compare": false, 00:03:38.521 "compare_and_write": false, 00:03:38.521 "abort": true, 00:03:38.521 "nvme_admin": false, 00:03:38.521 "nvme_io": false 00:03:38.521 }, 00:03:38.521 "memory_domains": [ 00:03:38.521 { 00:03:38.521 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:38.521 "dma_device_type": 2 00:03:38.521 } 00:03:38.521 ], 00:03:38.521 "driver_specific": {} 00:03:38.521 }, 00:03:38.521 { 00:03:38.521 "name": "Passthru0", 00:03:38.521 "aliases": [ 00:03:38.521 "d9a18bfd-ccb1-582c-89c6-cb4b4649e254" 00:03:38.521 ], 00:03:38.521 "product_name": "passthru", 00:03:38.521 "block_size": 512, 00:03:38.521 "num_blocks": 16384, 00:03:38.521 "uuid": "d9a18bfd-ccb1-582c-89c6-cb4b4649e254", 00:03:38.521 "assigned_rate_limits": { 00:03:38.521 "rw_ios_per_sec": 0, 00:03:38.521 "rw_mbytes_per_sec": 0, 00:03:38.521 "r_mbytes_per_sec": 0, 00:03:38.521 "w_mbytes_per_sec": 0 00:03:38.521 }, 00:03:38.521 "claimed": false, 00:03:38.521 "zoned": false, 00:03:38.521 "supported_io_types": { 00:03:38.521 "read": true, 00:03:38.521 "write": true, 00:03:38.521 "unmap": true, 00:03:38.521 "write_zeroes": true, 00:03:38.521 "flush": true, 00:03:38.521 "reset": true, 00:03:38.521 "compare": false, 00:03:38.521 "compare_and_write": false, 00:03:38.521 "abort": true, 00:03:38.521 "nvme_admin": false, 00:03:38.521 "nvme_io": false 00:03:38.521 }, 00:03:38.521 "memory_domains": [ 00:03:38.521 { 00:03:38.521 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:38.521 "dma_device_type": 2 00:03:38.521 } 00:03:38.521 ], 00:03:38.521 "driver_specific": { 00:03:38.521 "passthru": { 00:03:38.521 "name": "Passthru0", 00:03:38.521 "base_bdev_name": "Malloc0" 00:03:38.521 } 00:03:38.521 } 00:03:38.522 } 00:03:38.522 ]' 00:03:38.522 15:27:29 -- rpc/rpc.sh@21 -- # jq length 00:03:38.522 15:27:29 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:03:38.522 15:27:29 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:03:38.522 15:27:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:38.522 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.522 15:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.522 15:27:29 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:03:38.522 15:27:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:38.522 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.522 15:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.522 15:27:29 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:03:38.522 15:27:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:38.522 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.522 15:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.522 15:27:29 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:03:38.522 15:27:29 -- rpc/rpc.sh@26 -- # jq length 00:03:38.522 15:27:29 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:03:38.522 00:03:38.522 real 0m0.227s 00:03:38.522 user 0m0.148s 00:03:38.522 sys 0m0.023s 00:03:38.522 15:27:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:38.522 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.522 ************************************ 00:03:38.522 END TEST rpc_integrity 00:03:38.522 ************************************ 00:03:38.522 15:27:29 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:03:38.522 15:27:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:38.522 15:27:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:38.522 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.522 ************************************ 00:03:38.522 START TEST rpc_plugins 00:03:38.522 ************************************ 00:03:38.522 15:27:29 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:03:38.522 15:27:29 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:03:38.522 15:27:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:38.522 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.522 15:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.522 15:27:29 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:03:38.522 15:27:29 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:03:38.522 15:27:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:38.522 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.522 15:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.522 15:27:29 -- rpc/rpc.sh@31 -- # bdevs='[ 00:03:38.522 { 00:03:38.522 "name": "Malloc1", 00:03:38.522 "aliases": [ 00:03:38.522 "a8b30de0-5d79-499c-bb24-745f05b38cb1" 00:03:38.522 ], 00:03:38.522 "product_name": "Malloc disk", 00:03:38.522 "block_size": 4096, 00:03:38.522 "num_blocks": 256, 00:03:38.522 "uuid": "a8b30de0-5d79-499c-bb24-745f05b38cb1", 00:03:38.522 "assigned_rate_limits": { 00:03:38.522 "rw_ios_per_sec": 0, 00:03:38.522 "rw_mbytes_per_sec": 0, 00:03:38.522 "r_mbytes_per_sec": 0, 00:03:38.522 "w_mbytes_per_sec": 0 00:03:38.522 }, 00:03:38.522 "claimed": false, 00:03:38.522 "zoned": false, 00:03:38.522 "supported_io_types": { 00:03:38.522 "read": true, 00:03:38.522 "write": true, 00:03:38.522 "unmap": true, 00:03:38.522 "write_zeroes": true, 00:03:38.522 "flush": true, 00:03:38.522 "reset": true, 00:03:38.522 "compare": false, 00:03:38.522 "compare_and_write": false, 00:03:38.522 "abort": true, 00:03:38.522 "nvme_admin": false, 00:03:38.522 "nvme_io": false 00:03:38.522 }, 00:03:38.522 "memory_domains": [ 00:03:38.522 { 00:03:38.522 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:38.522 "dma_device_type": 2 00:03:38.522 } 00:03:38.522 ], 00:03:38.522 "driver_specific": {} 00:03:38.522 } 00:03:38.522 ]' 00:03:38.522 15:27:29 -- rpc/rpc.sh@32 -- # jq length 00:03:38.522 15:27:29 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:03:38.522 15:27:29 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:03:38.522 15:27:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:38.522 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.522 15:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.522 15:27:29 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:03:38.522 15:27:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:38.522 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.522 15:27:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.522 15:27:29 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:03:38.522 15:27:29 -- rpc/rpc.sh@36 -- # jq length 00:03:38.780 15:27:29 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:03:38.780 00:03:38.780 real 0m0.114s 00:03:38.780 user 0m0.071s 00:03:38.780 sys 0m0.012s 00:03:38.780 15:27:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:38.780 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:03:38.780 ************************************ 00:03:38.780 END TEST rpc_plugins 00:03:38.780 ************************************ 00:03:38.780 15:27:30 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:03:38.780 15:27:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:38.780 15:27:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:38.780 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:03:38.780 ************************************ 00:03:38.780 START TEST rpc_trace_cmd_test 00:03:38.780 ************************************ 00:03:38.780 15:27:30 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:03:38.780 15:27:30 -- rpc/rpc.sh@40 -- # local info 00:03:38.780 15:27:30 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:03:38.780 15:27:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:38.780 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:03:38.780 15:27:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:38.780 15:27:30 -- rpc/rpc.sh@42 -- # info='{ 00:03:38.780 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid745965", 00:03:38.780 "tpoint_group_mask": "0x8", 00:03:38.780 "iscsi_conn": { 00:03:38.780 "mask": "0x2", 00:03:38.780 "tpoint_mask": "0x0" 00:03:38.780 }, 00:03:38.780 "scsi": { 00:03:38.780 "mask": "0x4", 00:03:38.780 "tpoint_mask": "0x0" 00:03:38.780 }, 00:03:38.780 "bdev": { 00:03:38.780 "mask": "0x8", 00:03:38.780 "tpoint_mask": "0xffffffffffffffff" 00:03:38.780 }, 00:03:38.780 "nvmf_rdma": { 00:03:38.780 "mask": "0x10", 00:03:38.780 "tpoint_mask": "0x0" 00:03:38.780 }, 00:03:38.780 "nvmf_tcp": { 00:03:38.780 "mask": "0x20", 00:03:38.780 "tpoint_mask": "0x0" 00:03:38.780 }, 00:03:38.780 "ftl": { 00:03:38.780 "mask": "0x40", 00:03:38.780 "tpoint_mask": "0x0" 00:03:38.780 }, 00:03:38.780 "blobfs": { 00:03:38.780 "mask": "0x80", 00:03:38.780 "tpoint_mask": "0x0" 00:03:38.780 }, 00:03:38.780 "dsa": { 00:03:38.780 "mask": "0x200", 00:03:38.780 "tpoint_mask": "0x0" 00:03:38.780 }, 00:03:38.780 "thread": { 00:03:38.780 "mask": "0x400", 00:03:38.780 "tpoint_mask": "0x0" 00:03:38.780 }, 00:03:38.780 "nvme_pcie": { 00:03:38.780 "mask": "0x800", 00:03:38.780 "tpoint_mask": "0x0" 00:03:38.780 }, 00:03:38.780 "iaa": { 00:03:38.780 "mask": "0x1000", 00:03:38.780 "tpoint_mask": "0x0" 00:03:38.780 }, 00:03:38.780 "nvme_tcp": { 00:03:38.780 "mask": "0x2000", 00:03:38.780 "tpoint_mask": "0x0" 00:03:38.780 }, 00:03:38.780 "bdev_nvme": { 00:03:38.780 "mask": "0x4000", 00:03:38.780 "tpoint_mask": "0x0" 00:03:38.780 } 00:03:38.780 }' 00:03:38.780 15:27:30 -- rpc/rpc.sh@43 -- # jq length 00:03:38.780 15:27:30 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:03:38.780 15:27:30 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:03:38.780 15:27:30 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:03:38.780 15:27:30 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:03:38.780 15:27:30 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:03:38.780 15:27:30 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:03:38.780 15:27:30 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:03:38.780 15:27:30 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:03:38.780 15:27:30 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:03:38.780 00:03:38.780 real 0m0.202s 00:03:38.780 user 0m0.182s 00:03:38.780 sys 0m0.014s 00:03:38.780 15:27:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:38.780 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:03:38.780 ************************************ 00:03:38.780 END TEST rpc_trace_cmd_test 00:03:38.780 ************************************ 00:03:39.038 15:27:30 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:03:39.038 15:27:30 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:03:39.038 15:27:30 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:03:39.038 15:27:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:39.038 15:27:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:39.038 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:03:39.038 ************************************ 00:03:39.038 START TEST rpc_daemon_integrity 00:03:39.038 ************************************ 00:03:39.038 15:27:30 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:03:39.038 15:27:30 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:03:39.038 15:27:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:39.038 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:03:39.038 15:27:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:39.038 15:27:30 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:03:39.038 15:27:30 -- rpc/rpc.sh@13 -- # jq length 00:03:39.038 15:27:30 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:03:39.038 15:27:30 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:03:39.038 15:27:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:39.038 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:03:39.038 15:27:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:39.038 15:27:30 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:03:39.038 15:27:30 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:03:39.038 15:27:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:39.038 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:03:39.038 15:27:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:39.038 15:27:30 -- rpc/rpc.sh@16 -- # bdevs='[ 00:03:39.038 { 00:03:39.038 "name": "Malloc2", 00:03:39.038 "aliases": [ 00:03:39.038 "867c25b2-d9b9-4f7e-b3f5-c0b89aa4a87e" 00:03:39.038 ], 00:03:39.038 "product_name": "Malloc disk", 00:03:39.038 "block_size": 512, 00:03:39.038 "num_blocks": 16384, 00:03:39.038 "uuid": "867c25b2-d9b9-4f7e-b3f5-c0b89aa4a87e", 00:03:39.038 "assigned_rate_limits": { 00:03:39.038 "rw_ios_per_sec": 0, 00:03:39.038 "rw_mbytes_per_sec": 0, 00:03:39.038 "r_mbytes_per_sec": 0, 00:03:39.038 "w_mbytes_per_sec": 0 00:03:39.038 }, 00:03:39.038 "claimed": false, 00:03:39.038 "zoned": false, 00:03:39.038 "supported_io_types": { 00:03:39.038 "read": true, 00:03:39.038 "write": true, 00:03:39.038 "unmap": true, 00:03:39.038 "write_zeroes": true, 00:03:39.038 "flush": true, 00:03:39.038 "reset": true, 00:03:39.038 "compare": false, 00:03:39.038 "compare_and_write": false, 00:03:39.038 "abort": true, 00:03:39.038 "nvme_admin": false, 00:03:39.038 "nvme_io": false 00:03:39.038 }, 00:03:39.038 "memory_domains": [ 00:03:39.038 { 00:03:39.038 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:39.038 "dma_device_type": 2 00:03:39.038 } 00:03:39.038 ], 00:03:39.038 "driver_specific": {} 00:03:39.038 } 00:03:39.038 ]' 00:03:39.038 15:27:30 -- rpc/rpc.sh@17 -- # jq length 00:03:39.038 15:27:30 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:03:39.038 15:27:30 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:03:39.038 15:27:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:39.038 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:03:39.038 [2024-11-26 15:27:30.346041] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:03:39.038 [2024-11-26 15:27:30.346097] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:03:39.039 [2024-11-26 15:27:30.346123] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x670590 00:03:39.039 [2024-11-26 15:27:30.346138] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:03:39.039 [2024-11-26 15:27:30.347472] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:03:39.039 [2024-11-26 15:27:30.347499] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:03:39.039 Passthru0 00:03:39.039 15:27:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:39.039 15:27:30 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:03:39.039 15:27:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:39.039 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:03:39.039 15:27:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:39.039 15:27:30 -- rpc/rpc.sh@20 -- # bdevs='[ 00:03:39.039 { 00:03:39.039 "name": "Malloc2", 00:03:39.039 "aliases": [ 00:03:39.039 "867c25b2-d9b9-4f7e-b3f5-c0b89aa4a87e" 00:03:39.039 ], 00:03:39.039 "product_name": "Malloc disk", 00:03:39.039 "block_size": 512, 00:03:39.039 "num_blocks": 16384, 00:03:39.039 "uuid": "867c25b2-d9b9-4f7e-b3f5-c0b89aa4a87e", 00:03:39.039 "assigned_rate_limits": { 00:03:39.039 "rw_ios_per_sec": 0, 00:03:39.039 "rw_mbytes_per_sec": 0, 00:03:39.039 "r_mbytes_per_sec": 0, 00:03:39.039 "w_mbytes_per_sec": 0 00:03:39.039 }, 00:03:39.039 "claimed": true, 00:03:39.039 "claim_type": "exclusive_write", 00:03:39.039 "zoned": false, 00:03:39.039 "supported_io_types": { 00:03:39.039 "read": true, 00:03:39.039 "write": true, 00:03:39.039 "unmap": true, 00:03:39.039 "write_zeroes": true, 00:03:39.039 "flush": true, 00:03:39.039 "reset": true, 00:03:39.039 "compare": false, 00:03:39.039 "compare_and_write": false, 00:03:39.039 "abort": true, 00:03:39.039 "nvme_admin": false, 00:03:39.039 "nvme_io": false 00:03:39.039 }, 00:03:39.039 "memory_domains": [ 00:03:39.039 { 00:03:39.039 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:39.039 "dma_device_type": 2 00:03:39.039 } 00:03:39.039 ], 00:03:39.039 "driver_specific": {} 00:03:39.039 }, 00:03:39.039 { 00:03:39.039 "name": "Passthru0", 00:03:39.039 "aliases": [ 00:03:39.039 "e0dfdedd-cd94-549c-a306-04e94b577309" 00:03:39.039 ], 00:03:39.039 "product_name": "passthru", 00:03:39.039 "block_size": 512, 00:03:39.039 "num_blocks": 16384, 00:03:39.039 "uuid": "e0dfdedd-cd94-549c-a306-04e94b577309", 00:03:39.039 "assigned_rate_limits": { 00:03:39.039 "rw_ios_per_sec": 0, 00:03:39.039 "rw_mbytes_per_sec": 0, 00:03:39.039 "r_mbytes_per_sec": 0, 00:03:39.039 "w_mbytes_per_sec": 0 00:03:39.039 }, 00:03:39.039 "claimed": false, 00:03:39.039 "zoned": false, 00:03:39.039 "supported_io_types": { 00:03:39.039 "read": true, 00:03:39.039 "write": true, 00:03:39.039 "unmap": true, 00:03:39.039 "write_zeroes": true, 00:03:39.039 "flush": true, 00:03:39.039 "reset": true, 00:03:39.039 "compare": false, 00:03:39.039 "compare_and_write": false, 00:03:39.039 "abort": true, 00:03:39.039 "nvme_admin": false, 00:03:39.039 "nvme_io": false 00:03:39.039 }, 00:03:39.039 "memory_domains": [ 00:03:39.039 { 00:03:39.039 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:39.039 "dma_device_type": 2 00:03:39.039 } 00:03:39.039 ], 00:03:39.039 "driver_specific": { 00:03:39.039 "passthru": { 00:03:39.039 "name": "Passthru0", 00:03:39.039 "base_bdev_name": "Malloc2" 00:03:39.039 } 00:03:39.039 } 00:03:39.039 } 00:03:39.039 ]' 00:03:39.039 15:27:30 -- rpc/rpc.sh@21 -- # jq length 00:03:39.039 15:27:30 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:03:39.039 15:27:30 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:03:39.039 15:27:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:39.039 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:03:39.039 15:27:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:39.039 15:27:30 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:03:39.039 15:27:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:39.039 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:03:39.039 15:27:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:39.039 15:27:30 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:03:39.039 15:27:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:39.039 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:03:39.039 15:27:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:39.039 15:27:30 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:03:39.039 15:27:30 -- rpc/rpc.sh@26 -- # jq length 00:03:39.039 15:27:30 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:03:39.039 00:03:39.039 real 0m0.229s 00:03:39.039 user 0m0.142s 00:03:39.039 sys 0m0.025s 00:03:39.039 15:27:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:39.039 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:03:39.039 ************************************ 00:03:39.039 END TEST rpc_daemon_integrity 00:03:39.039 ************************************ 00:03:39.039 15:27:30 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:03:39.039 15:27:30 -- rpc/rpc.sh@84 -- # killprocess 745965 00:03:39.039 15:27:30 -- common/autotest_common.sh@936 -- # '[' -z 745965 ']' 00:03:39.039 15:27:30 -- common/autotest_common.sh@940 -- # kill -0 745965 00:03:39.299 15:27:30 -- common/autotest_common.sh@941 -- # uname 00:03:39.299 15:27:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:39.299 15:27:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 745965 00:03:39.299 15:27:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:39.299 15:27:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:39.299 15:27:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 745965' 00:03:39.299 killing process with pid 745965 00:03:39.299 15:27:30 -- common/autotest_common.sh@955 -- # kill 745965 00:03:39.299 15:27:30 -- common/autotest_common.sh@960 -- # wait 745965 00:03:39.558 00:03:39.558 real 0m2.512s 00:03:39.558 user 0m3.156s 00:03:39.558 sys 0m0.601s 00:03:39.558 15:27:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:39.558 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:03:39.558 ************************************ 00:03:39.558 END TEST rpc 00:03:39.558 ************************************ 00:03:39.817 15:27:31 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:03:39.817 15:27:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:39.817 15:27:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:39.817 15:27:31 -- common/autotest_common.sh@10 -- # set +x 00:03:39.817 ************************************ 00:03:39.817 START TEST rpc_client 00:03:39.817 ************************************ 00:03:39.817 15:27:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:03:39.817 * Looking for test storage... 00:03:39.817 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:03:39.817 15:27:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:39.817 15:27:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:39.817 15:27:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:39.817 15:27:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:39.817 15:27:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:39.817 15:27:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:39.817 15:27:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:39.817 15:27:31 -- scripts/common.sh@335 -- # IFS=.-: 00:03:39.817 15:27:31 -- scripts/common.sh@335 -- # read -ra ver1 00:03:39.817 15:27:31 -- scripts/common.sh@336 -- # IFS=.-: 00:03:39.817 15:27:31 -- scripts/common.sh@336 -- # read -ra ver2 00:03:39.817 15:27:31 -- scripts/common.sh@337 -- # local 'op=<' 00:03:39.817 15:27:31 -- scripts/common.sh@339 -- # ver1_l=2 00:03:39.817 15:27:31 -- scripts/common.sh@340 -- # ver2_l=1 00:03:39.817 15:27:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:39.817 15:27:31 -- scripts/common.sh@343 -- # case "$op" in 00:03:39.817 15:27:31 -- scripts/common.sh@344 -- # : 1 00:03:39.817 15:27:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:39.817 15:27:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:39.817 15:27:31 -- scripts/common.sh@364 -- # decimal 1 00:03:39.817 15:27:31 -- scripts/common.sh@352 -- # local d=1 00:03:39.817 15:27:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:39.817 15:27:31 -- scripts/common.sh@354 -- # echo 1 00:03:39.817 15:27:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:39.817 15:27:31 -- scripts/common.sh@365 -- # decimal 2 00:03:39.817 15:27:31 -- scripts/common.sh@352 -- # local d=2 00:03:39.817 15:27:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:39.817 15:27:31 -- scripts/common.sh@354 -- # echo 2 00:03:39.817 15:27:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:39.817 15:27:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:39.817 15:27:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:39.817 15:27:31 -- scripts/common.sh@367 -- # return 0 00:03:39.817 15:27:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:39.817 15:27:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:39.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.817 --rc genhtml_branch_coverage=1 00:03:39.817 --rc genhtml_function_coverage=1 00:03:39.817 --rc genhtml_legend=1 00:03:39.817 --rc geninfo_all_blocks=1 00:03:39.817 --rc geninfo_unexecuted_blocks=1 00:03:39.817 00:03:39.817 ' 00:03:39.817 15:27:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:39.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.817 --rc genhtml_branch_coverage=1 00:03:39.817 --rc genhtml_function_coverage=1 00:03:39.817 --rc genhtml_legend=1 00:03:39.817 --rc geninfo_all_blocks=1 00:03:39.817 --rc geninfo_unexecuted_blocks=1 00:03:39.817 00:03:39.817 ' 00:03:39.817 15:27:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:39.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.817 --rc genhtml_branch_coverage=1 00:03:39.817 --rc genhtml_function_coverage=1 00:03:39.817 --rc genhtml_legend=1 00:03:39.817 --rc geninfo_all_blocks=1 00:03:39.817 --rc geninfo_unexecuted_blocks=1 00:03:39.817 00:03:39.817 ' 00:03:39.817 15:27:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:39.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.817 --rc genhtml_branch_coverage=1 00:03:39.817 --rc genhtml_function_coverage=1 00:03:39.817 --rc genhtml_legend=1 00:03:39.817 --rc geninfo_all_blocks=1 00:03:39.817 --rc geninfo_unexecuted_blocks=1 00:03:39.817 00:03:39.817 ' 00:03:39.817 15:27:31 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:03:39.817 OK 00:03:39.817 15:27:31 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:03:39.817 00:03:39.817 real 0m0.153s 00:03:39.817 user 0m0.107s 00:03:39.817 sys 0m0.055s 00:03:39.817 15:27:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:39.817 15:27:31 -- common/autotest_common.sh@10 -- # set +x 00:03:39.817 ************************************ 00:03:39.817 END TEST rpc_client 00:03:39.817 ************************************ 00:03:39.817 15:27:31 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:03:39.817 15:27:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:39.817 15:27:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:39.817 15:27:31 -- common/autotest_common.sh@10 -- # set +x 00:03:39.817 ************************************ 00:03:39.817 START TEST json_config 00:03:39.817 ************************************ 00:03:39.817 15:27:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:03:39.817 15:27:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:39.817 15:27:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:39.817 15:27:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:40.078 15:27:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:40.078 15:27:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:40.078 15:27:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:40.078 15:27:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:40.078 15:27:31 -- scripts/common.sh@335 -- # IFS=.-: 00:03:40.078 15:27:31 -- scripts/common.sh@335 -- # read -ra ver1 00:03:40.078 15:27:31 -- scripts/common.sh@336 -- # IFS=.-: 00:03:40.078 15:27:31 -- scripts/common.sh@336 -- # read -ra ver2 00:03:40.078 15:27:31 -- scripts/common.sh@337 -- # local 'op=<' 00:03:40.078 15:27:31 -- scripts/common.sh@339 -- # ver1_l=2 00:03:40.078 15:27:31 -- scripts/common.sh@340 -- # ver2_l=1 00:03:40.078 15:27:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:40.078 15:27:31 -- scripts/common.sh@343 -- # case "$op" in 00:03:40.078 15:27:31 -- scripts/common.sh@344 -- # : 1 00:03:40.079 15:27:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:40.079 15:27:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:40.079 15:27:31 -- scripts/common.sh@364 -- # decimal 1 00:03:40.079 15:27:31 -- scripts/common.sh@352 -- # local d=1 00:03:40.079 15:27:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:40.079 15:27:31 -- scripts/common.sh@354 -- # echo 1 00:03:40.079 15:27:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:40.079 15:27:31 -- scripts/common.sh@365 -- # decimal 2 00:03:40.079 15:27:31 -- scripts/common.sh@352 -- # local d=2 00:03:40.079 15:27:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:40.079 15:27:31 -- scripts/common.sh@354 -- # echo 2 00:03:40.079 15:27:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:40.079 15:27:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:40.079 15:27:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:40.079 15:27:31 -- scripts/common.sh@367 -- # return 0 00:03:40.079 15:27:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:40.079 15:27:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:40.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:40.079 --rc genhtml_branch_coverage=1 00:03:40.079 --rc genhtml_function_coverage=1 00:03:40.079 --rc genhtml_legend=1 00:03:40.079 --rc geninfo_all_blocks=1 00:03:40.079 --rc geninfo_unexecuted_blocks=1 00:03:40.079 00:03:40.079 ' 00:03:40.079 15:27:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:40.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:40.079 --rc genhtml_branch_coverage=1 00:03:40.079 --rc genhtml_function_coverage=1 00:03:40.079 --rc genhtml_legend=1 00:03:40.079 --rc geninfo_all_blocks=1 00:03:40.079 --rc geninfo_unexecuted_blocks=1 00:03:40.079 00:03:40.079 ' 00:03:40.079 15:27:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:40.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:40.079 --rc genhtml_branch_coverage=1 00:03:40.079 --rc genhtml_function_coverage=1 00:03:40.079 --rc genhtml_legend=1 00:03:40.079 --rc geninfo_all_blocks=1 00:03:40.079 --rc geninfo_unexecuted_blocks=1 00:03:40.079 00:03:40.079 ' 00:03:40.079 15:27:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:40.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:40.079 --rc genhtml_branch_coverage=1 00:03:40.079 --rc genhtml_function_coverage=1 00:03:40.079 --rc genhtml_legend=1 00:03:40.079 --rc geninfo_all_blocks=1 00:03:40.079 --rc geninfo_unexecuted_blocks=1 00:03:40.079 00:03:40.079 ' 00:03:40.079 15:27:31 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:40.079 15:27:31 -- nvmf/common.sh@7 -- # uname -s 00:03:40.079 15:27:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:40.079 15:27:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:40.079 15:27:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:40.079 15:27:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:40.079 15:27:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:40.079 15:27:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:40.079 15:27:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:40.079 15:27:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:40.079 15:27:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:40.079 15:27:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:40.079 15:27:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:40.079 15:27:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:40.079 15:27:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:40.079 15:27:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:40.079 15:27:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:03:40.079 15:27:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:40.079 15:27:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:40.079 15:27:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:40.079 15:27:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:40.079 15:27:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:40.079 15:27:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:40.079 15:27:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:40.079 15:27:31 -- paths/export.sh@5 -- # export PATH 00:03:40.079 15:27:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:40.079 15:27:31 -- nvmf/common.sh@46 -- # : 0 00:03:40.079 15:27:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:40.079 15:27:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:40.079 15:27:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:40.079 15:27:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:40.079 15:27:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:40.079 15:27:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:40.079 15:27:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:40.079 15:27:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:40.079 15:27:31 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:03:40.079 15:27:31 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:03:40.079 15:27:31 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:03:40.079 15:27:31 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:03:40.079 15:27:31 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:03:40.079 15:27:31 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:03:40.079 15:27:31 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:03:40.079 15:27:31 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:03:40.079 15:27:31 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:03:40.079 15:27:31 -- json_config/json_config.sh@32 -- # declare -A app_params 00:03:40.079 15:27:31 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:03:40.079 15:27:31 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:03:40.079 15:27:31 -- json_config/json_config.sh@43 -- # last_event_id=0 00:03:40.079 15:27:31 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:03:40.079 15:27:31 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:03:40.079 INFO: JSON configuration test init 00:03:40.079 15:27:31 -- json_config/json_config.sh@420 -- # json_config_test_init 00:03:40.079 15:27:31 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:03:40.079 15:27:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:40.079 15:27:31 -- common/autotest_common.sh@10 -- # set +x 00:03:40.079 15:27:31 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:03:40.079 15:27:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:40.079 15:27:31 -- common/autotest_common.sh@10 -- # set +x 00:03:40.079 15:27:31 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:03:40.079 15:27:31 -- json_config/json_config.sh@98 -- # local app=target 00:03:40.079 15:27:31 -- json_config/json_config.sh@99 -- # shift 00:03:40.079 15:27:31 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:03:40.079 15:27:31 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:03:40.079 15:27:31 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:03:40.079 15:27:31 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:40.079 15:27:31 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:40.079 15:27:31 -- json_config/json_config.sh@111 -- # app_pid[$app]=746487 00:03:40.079 15:27:31 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:03:40.079 15:27:31 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:03:40.079 Waiting for target to run... 00:03:40.079 15:27:31 -- json_config/json_config.sh@114 -- # waitforlisten 746487 /var/tmp/spdk_tgt.sock 00:03:40.079 15:27:31 -- common/autotest_common.sh@829 -- # '[' -z 746487 ']' 00:03:40.079 15:27:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:40.079 15:27:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:40.079 15:27:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:40.079 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:40.079 15:27:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:40.079 15:27:31 -- common/autotest_common.sh@10 -- # set +x 00:03:40.079 [2024-11-26 15:27:31.376745] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:40.079 [2024-11-26 15:27:31.376840] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid746487 ] 00:03:40.079 EAL: No free 2048 kB hugepages reported on node 1 00:03:40.340 [2024-11-26 15:27:31.734390] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:40.598 [2024-11-26 15:27:31.820376] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:40.598 [2024-11-26 15:27:31.820582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:41.165 15:27:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:41.165 15:27:32 -- common/autotest_common.sh@862 -- # return 0 00:03:41.165 15:27:32 -- json_config/json_config.sh@115 -- # echo '' 00:03:41.165 00:03:41.165 15:27:32 -- json_config/json_config.sh@322 -- # create_accel_config 00:03:41.165 15:27:32 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:03:41.165 15:27:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:41.165 15:27:32 -- common/autotest_common.sh@10 -- # set +x 00:03:41.166 15:27:32 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:03:41.166 15:27:32 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:03:41.166 15:27:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:41.166 15:27:32 -- common/autotest_common.sh@10 -- # set +x 00:03:41.166 15:27:32 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:03:41.166 15:27:32 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:03:41.166 15:27:32 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:03:44.461 15:27:35 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:03:44.461 15:27:35 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:03:44.461 15:27:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:44.461 15:27:35 -- common/autotest_common.sh@10 -- # set +x 00:03:44.461 15:27:35 -- json_config/json_config.sh@48 -- # local ret=0 00:03:44.461 15:27:35 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:03:44.461 15:27:35 -- json_config/json_config.sh@49 -- # local enabled_types 00:03:44.461 15:27:35 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:03:44.461 15:27:35 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:03:44.461 15:27:35 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:03:44.461 15:27:35 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:03:44.461 15:27:35 -- json_config/json_config.sh@51 -- # local get_types 00:03:44.461 15:27:35 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:03:44.461 15:27:35 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:03:44.461 15:27:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:44.461 15:27:35 -- common/autotest_common.sh@10 -- # set +x 00:03:44.461 15:27:35 -- json_config/json_config.sh@58 -- # return 0 00:03:44.462 15:27:35 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:03:44.462 15:27:35 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:03:44.462 15:27:35 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:03:44.462 15:27:35 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:03:44.462 15:27:35 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:03:44.462 15:27:35 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:03:44.462 15:27:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:44.462 15:27:35 -- common/autotest_common.sh@10 -- # set +x 00:03:44.462 15:27:35 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:03:44.462 15:27:35 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:03:44.462 15:27:35 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:03:44.462 15:27:35 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:03:44.462 15:27:35 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:03:44.721 MallocForNvmf0 00:03:44.721 15:27:36 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:03:44.721 15:27:36 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:03:44.979 MallocForNvmf1 00:03:44.979 15:27:36 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:03:44.979 15:27:36 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:03:45.237 [2024-11-26 15:27:36.553368] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:03:45.237 15:27:36 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:03:45.237 15:27:36 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:03:45.496 15:27:36 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:03:45.496 15:27:36 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:03:45.754 15:27:37 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:03:45.754 15:27:37 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:03:46.011 15:27:37 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:03:46.011 15:27:37 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:03:46.269 [2024-11-26 15:27:37.552756] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:03:46.269 15:27:37 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:03:46.269 15:27:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:46.269 15:27:37 -- common/autotest_common.sh@10 -- # set +x 00:03:46.269 15:27:37 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:03:46.269 15:27:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:46.270 15:27:37 -- common/autotest_common.sh@10 -- # set +x 00:03:46.270 15:27:37 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:03:46.270 15:27:37 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:03:46.270 15:27:37 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:03:46.528 MallocBdevForConfigChangeCheck 00:03:46.528 15:27:37 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:03:46.528 15:27:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:46.528 15:27:37 -- common/autotest_common.sh@10 -- # set +x 00:03:46.528 15:27:37 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:03:46.528 15:27:37 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:47.096 15:27:38 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:03:47.096 INFO: shutting down applications... 00:03:47.096 15:27:38 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:03:47.096 15:27:38 -- json_config/json_config.sh@431 -- # json_config_clear target 00:03:47.096 15:27:38 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:03:47.096 15:27:38 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:03:48.477 Calling clear_iscsi_subsystem 00:03:48.477 Calling clear_nvmf_subsystem 00:03:48.477 Calling clear_nbd_subsystem 00:03:48.477 Calling clear_ublk_subsystem 00:03:48.477 Calling clear_vhost_blk_subsystem 00:03:48.477 Calling clear_vhost_scsi_subsystem 00:03:48.477 Calling clear_scheduler_subsystem 00:03:48.477 Calling clear_bdev_subsystem 00:03:48.477 Calling clear_accel_subsystem 00:03:48.477 Calling clear_vmd_subsystem 00:03:48.477 Calling clear_sock_subsystem 00:03:48.477 Calling clear_iobuf_subsystem 00:03:48.477 15:27:39 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:03:48.477 15:27:39 -- json_config/json_config.sh@396 -- # count=100 00:03:48.477 15:27:39 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:03:48.477 15:27:39 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:48.477 15:27:39 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:03:48.477 15:27:39 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:03:49.047 15:27:40 -- json_config/json_config.sh@398 -- # break 00:03:49.047 15:27:40 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:03:49.047 15:27:40 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:03:49.047 15:27:40 -- json_config/json_config.sh@120 -- # local app=target 00:03:49.047 15:27:40 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:03:49.047 15:27:40 -- json_config/json_config.sh@124 -- # [[ -n 746487 ]] 00:03:49.047 15:27:40 -- json_config/json_config.sh@127 -- # kill -SIGINT 746487 00:03:49.047 15:27:40 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:03:49.047 15:27:40 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:03:49.047 15:27:40 -- json_config/json_config.sh@130 -- # kill -0 746487 00:03:49.047 15:27:40 -- json_config/json_config.sh@134 -- # sleep 0.5 00:03:49.372 15:27:40 -- json_config/json_config.sh@129 -- # (( i++ )) 00:03:49.372 15:27:40 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:03:49.372 15:27:40 -- json_config/json_config.sh@130 -- # kill -0 746487 00:03:49.372 15:27:40 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:03:49.372 15:27:40 -- json_config/json_config.sh@132 -- # break 00:03:49.372 15:27:40 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:03:49.372 15:27:40 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:03:49.372 SPDK target shutdown done 00:03:49.372 15:27:40 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:03:49.372 INFO: relaunching applications... 00:03:49.372 15:27:40 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:49.372 15:27:40 -- json_config/json_config.sh@98 -- # local app=target 00:03:49.372 15:27:40 -- json_config/json_config.sh@99 -- # shift 00:03:49.372 15:27:40 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:03:49.372 15:27:40 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:03:49.372 15:27:40 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:03:49.372 15:27:40 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:49.372 15:27:40 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:49.372 15:27:40 -- json_config/json_config.sh@111 -- # app_pid[$app]=747812 00:03:49.372 15:27:40 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:49.372 15:27:40 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:03:49.372 Waiting for target to run... 00:03:49.372 15:27:40 -- json_config/json_config.sh@114 -- # waitforlisten 747812 /var/tmp/spdk_tgt.sock 00:03:49.372 15:27:40 -- common/autotest_common.sh@829 -- # '[' -z 747812 ']' 00:03:49.372 15:27:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:49.372 15:27:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:49.372 15:27:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:49.372 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:49.372 15:27:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:49.372 15:27:40 -- common/autotest_common.sh@10 -- # set +x 00:03:49.657 [2024-11-26 15:27:40.836584] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:49.657 [2024-11-26 15:27:40.836698] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid747812 ] 00:03:49.657 EAL: No free 2048 kB hugepages reported on node 1 00:03:49.917 [2024-11-26 15:27:41.179634] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:49.917 [2024-11-26 15:27:41.253609] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:49.917 [2024-11-26 15:27:41.253809] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:53.203 [2024-11-26 15:27:44.278482] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:03:53.203 [2024-11-26 15:27:44.311025] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:03:53.461 15:27:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:53.461 15:27:44 -- common/autotest_common.sh@862 -- # return 0 00:03:53.461 15:27:44 -- json_config/json_config.sh@115 -- # echo '' 00:03:53.461 00:03:53.461 15:27:44 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:03:53.461 15:27:44 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:03:53.461 INFO: Checking if target configuration is the same... 00:03:53.461 15:27:44 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:53.461 15:27:44 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:03:53.461 15:27:44 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:53.461 + '[' 2 -ne 2 ']' 00:03:53.461 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:03:53.461 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:03:53.461 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:53.461 +++ basename /dev/fd/62 00:03:53.461 ++ mktemp /tmp/62.XXX 00:03:53.461 + tmp_file_1=/tmp/62.B35 00:03:53.461 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:53.461 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:03:53.461 + tmp_file_2=/tmp/spdk_tgt_config.json.QH9 00:03:53.461 + ret=0 00:03:53.461 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:53.721 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:53.981 + diff -u /tmp/62.B35 /tmp/spdk_tgt_config.json.QH9 00:03:53.981 + echo 'INFO: JSON config files are the same' 00:03:53.981 INFO: JSON config files are the same 00:03:53.981 + rm /tmp/62.B35 /tmp/spdk_tgt_config.json.QH9 00:03:53.981 + exit 0 00:03:53.981 15:27:45 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:03:53.981 15:27:45 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:03:53.981 INFO: changing configuration and checking if this can be detected... 00:03:53.981 15:27:45 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:03:53.981 15:27:45 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:03:54.240 15:27:45 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:54.240 15:27:45 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:03:54.240 15:27:45 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:54.240 + '[' 2 -ne 2 ']' 00:03:54.240 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:03:54.240 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:03:54.240 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:54.240 +++ basename /dev/fd/62 00:03:54.240 ++ mktemp /tmp/62.XXX 00:03:54.240 + tmp_file_1=/tmp/62.tjy 00:03:54.240 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:54.240 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:03:54.240 + tmp_file_2=/tmp/spdk_tgt_config.json.Vin 00:03:54.240 + ret=0 00:03:54.240 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:54.498 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:54.498 + diff -u /tmp/62.tjy /tmp/spdk_tgt_config.json.Vin 00:03:54.498 + ret=1 00:03:54.498 + echo '=== Start of file: /tmp/62.tjy ===' 00:03:54.498 + cat /tmp/62.tjy 00:03:54.498 + echo '=== End of file: /tmp/62.tjy ===' 00:03:54.498 + echo '' 00:03:54.498 + echo '=== Start of file: /tmp/spdk_tgt_config.json.Vin ===' 00:03:54.498 + cat /tmp/spdk_tgt_config.json.Vin 00:03:54.498 + echo '=== End of file: /tmp/spdk_tgt_config.json.Vin ===' 00:03:54.498 + echo '' 00:03:54.498 + rm /tmp/62.tjy /tmp/spdk_tgt_config.json.Vin 00:03:54.498 + exit 1 00:03:54.498 15:27:45 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:03:54.498 INFO: configuration change detected. 00:03:54.498 15:27:45 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:03:54.498 15:27:45 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:03:54.498 15:27:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:54.498 15:27:45 -- common/autotest_common.sh@10 -- # set +x 00:03:54.498 15:27:45 -- json_config/json_config.sh@360 -- # local ret=0 00:03:54.498 15:27:45 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:03:54.498 15:27:45 -- json_config/json_config.sh@370 -- # [[ -n 747812 ]] 00:03:54.498 15:27:45 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:03:54.498 15:27:45 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:03:54.498 15:27:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:54.498 15:27:45 -- common/autotest_common.sh@10 -- # set +x 00:03:54.498 15:27:45 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:03:54.498 15:27:45 -- json_config/json_config.sh@246 -- # uname -s 00:03:54.499 15:27:45 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:03:54.499 15:27:45 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:03:54.499 15:27:45 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:03:54.499 15:27:45 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:03:54.499 15:27:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:54.499 15:27:45 -- common/autotest_common.sh@10 -- # set +x 00:03:54.499 15:27:45 -- json_config/json_config.sh@376 -- # killprocess 747812 00:03:54.499 15:27:45 -- common/autotest_common.sh@936 -- # '[' -z 747812 ']' 00:03:54.499 15:27:45 -- common/autotest_common.sh@940 -- # kill -0 747812 00:03:54.499 15:27:45 -- common/autotest_common.sh@941 -- # uname 00:03:54.499 15:27:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:54.499 15:27:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 747812 00:03:54.756 15:27:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:54.756 15:27:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:54.756 15:27:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 747812' 00:03:54.756 killing process with pid 747812 00:03:54.756 15:27:45 -- common/autotest_common.sh@955 -- # kill 747812 00:03:54.756 15:27:45 -- common/autotest_common.sh@960 -- # wait 747812 00:03:56.661 15:27:47 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:56.661 15:27:47 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:03:56.661 15:27:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:56.661 15:27:47 -- common/autotest_common.sh@10 -- # set +x 00:03:56.661 15:27:47 -- json_config/json_config.sh@381 -- # return 0 00:03:56.661 15:27:47 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:03:56.661 INFO: Success 00:03:56.661 00:03:56.661 real 0m16.452s 00:03:56.661 user 0m19.217s 00:03:56.661 sys 0m1.896s 00:03:56.661 15:27:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:56.661 15:27:47 -- common/autotest_common.sh@10 -- # set +x 00:03:56.661 ************************************ 00:03:56.661 END TEST json_config 00:03:56.661 ************************************ 00:03:56.661 15:27:47 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:03:56.661 15:27:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:56.661 15:27:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:56.661 15:27:47 -- common/autotest_common.sh@10 -- # set +x 00:03:56.661 ************************************ 00:03:56.661 START TEST json_config_extra_key 00:03:56.661 ************************************ 00:03:56.661 15:27:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:03:56.661 15:27:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:56.661 15:27:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:56.661 15:27:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:56.661 15:27:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:56.661 15:27:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:56.661 15:27:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:56.661 15:27:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:56.661 15:27:47 -- scripts/common.sh@335 -- # IFS=.-: 00:03:56.661 15:27:47 -- scripts/common.sh@335 -- # read -ra ver1 00:03:56.661 15:27:47 -- scripts/common.sh@336 -- # IFS=.-: 00:03:56.661 15:27:47 -- scripts/common.sh@336 -- # read -ra ver2 00:03:56.661 15:27:47 -- scripts/common.sh@337 -- # local 'op=<' 00:03:56.661 15:27:47 -- scripts/common.sh@339 -- # ver1_l=2 00:03:56.661 15:27:47 -- scripts/common.sh@340 -- # ver2_l=1 00:03:56.661 15:27:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:56.661 15:27:47 -- scripts/common.sh@343 -- # case "$op" in 00:03:56.661 15:27:47 -- scripts/common.sh@344 -- # : 1 00:03:56.661 15:27:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:56.661 15:27:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:56.661 15:27:47 -- scripts/common.sh@364 -- # decimal 1 00:03:56.661 15:27:47 -- scripts/common.sh@352 -- # local d=1 00:03:56.661 15:27:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:56.661 15:27:47 -- scripts/common.sh@354 -- # echo 1 00:03:56.661 15:27:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:56.661 15:27:47 -- scripts/common.sh@365 -- # decimal 2 00:03:56.661 15:27:47 -- scripts/common.sh@352 -- # local d=2 00:03:56.661 15:27:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:56.661 15:27:47 -- scripts/common.sh@354 -- # echo 2 00:03:56.661 15:27:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:56.661 15:27:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:56.661 15:27:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:56.661 15:27:47 -- scripts/common.sh@367 -- # return 0 00:03:56.661 15:27:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:56.661 15:27:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:56.661 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:56.661 --rc genhtml_branch_coverage=1 00:03:56.661 --rc genhtml_function_coverage=1 00:03:56.661 --rc genhtml_legend=1 00:03:56.661 --rc geninfo_all_blocks=1 00:03:56.661 --rc geninfo_unexecuted_blocks=1 00:03:56.661 00:03:56.661 ' 00:03:56.661 15:27:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:56.661 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:56.661 --rc genhtml_branch_coverage=1 00:03:56.661 --rc genhtml_function_coverage=1 00:03:56.661 --rc genhtml_legend=1 00:03:56.661 --rc geninfo_all_blocks=1 00:03:56.661 --rc geninfo_unexecuted_blocks=1 00:03:56.661 00:03:56.661 ' 00:03:56.661 15:27:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:56.661 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:56.661 --rc genhtml_branch_coverage=1 00:03:56.661 --rc genhtml_function_coverage=1 00:03:56.661 --rc genhtml_legend=1 00:03:56.661 --rc geninfo_all_blocks=1 00:03:56.661 --rc geninfo_unexecuted_blocks=1 00:03:56.661 00:03:56.661 ' 00:03:56.661 15:27:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:56.661 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:56.661 --rc genhtml_branch_coverage=1 00:03:56.661 --rc genhtml_function_coverage=1 00:03:56.661 --rc genhtml_legend=1 00:03:56.661 --rc geninfo_all_blocks=1 00:03:56.661 --rc geninfo_unexecuted_blocks=1 00:03:56.661 00:03:56.661 ' 00:03:56.661 15:27:47 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:56.661 15:27:47 -- nvmf/common.sh@7 -- # uname -s 00:03:56.661 15:27:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:56.661 15:27:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:56.661 15:27:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:56.661 15:27:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:56.661 15:27:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:56.661 15:27:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:56.661 15:27:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:56.661 15:27:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:56.661 15:27:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:56.661 15:27:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:56.662 15:27:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:56.662 15:27:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:56.662 15:27:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:56.662 15:27:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:56.662 15:27:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:03:56.662 15:27:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:56.662 15:27:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:56.662 15:27:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:56.662 15:27:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:56.662 15:27:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:56.662 15:27:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:56.662 15:27:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:56.662 15:27:47 -- paths/export.sh@5 -- # export PATH 00:03:56.662 15:27:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:56.662 15:27:47 -- nvmf/common.sh@46 -- # : 0 00:03:56.662 15:27:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:56.662 15:27:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:56.662 15:27:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:56.662 15:27:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:56.662 15:27:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:56.662 15:27:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:56.662 15:27:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:56.662 15:27:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:03:56.662 INFO: launching applications... 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@25 -- # shift 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=748770 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:03:56.662 Waiting for target to run... 00:03:56.662 15:27:47 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 748770 /var/tmp/spdk_tgt.sock 00:03:56.662 15:27:47 -- common/autotest_common.sh@829 -- # '[' -z 748770 ']' 00:03:56.662 15:27:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:56.662 15:27:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:56.662 15:27:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:56.662 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:56.662 15:27:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:56.662 15:27:47 -- common/autotest_common.sh@10 -- # set +x 00:03:56.662 [2024-11-26 15:27:47.842062] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:56.662 [2024-11-26 15:27:47.842157] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid748770 ] 00:03:56.662 EAL: No free 2048 kB hugepages reported on node 1 00:03:56.922 [2024-11-26 15:27:48.179342] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:56.923 [2024-11-26 15:27:48.266079] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:56.923 [2024-11-26 15:27:48.266264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:57.491 15:27:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:57.491 15:27:48 -- common/autotest_common.sh@862 -- # return 0 00:03:57.491 15:27:48 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:03:57.491 00:03:57.491 15:27:48 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:03:57.491 INFO: shutting down applications... 00:03:57.491 15:27:48 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:03:57.491 15:27:48 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:03:57.491 15:27:48 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:03:57.491 15:27:48 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 748770 ]] 00:03:57.491 15:27:48 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 748770 00:03:57.491 15:27:48 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:03:57.491 15:27:48 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:03:57.491 15:27:48 -- json_config/json_config_extra_key.sh@50 -- # kill -0 748770 00:03:57.491 15:27:48 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:03:58.060 15:27:49 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:03:58.060 15:27:49 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:03:58.060 15:27:49 -- json_config/json_config_extra_key.sh@50 -- # kill -0 748770 00:03:58.060 15:27:49 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:03:58.626 15:27:49 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:03:58.626 15:27:49 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:03:58.626 15:27:49 -- json_config/json_config_extra_key.sh@50 -- # kill -0 748770 00:03:58.626 15:27:49 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:03:58.626 15:27:49 -- json_config/json_config_extra_key.sh@52 -- # break 00:03:58.626 15:27:49 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:03:58.626 15:27:49 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:03:58.626 SPDK target shutdown done 00:03:58.626 15:27:49 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:03:58.626 Success 00:03:58.626 00:03:58.626 real 0m2.136s 00:03:58.626 user 0m1.676s 00:03:58.626 sys 0m0.424s 00:03:58.626 15:27:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:58.626 15:27:49 -- common/autotest_common.sh@10 -- # set +x 00:03:58.626 ************************************ 00:03:58.626 END TEST json_config_extra_key 00:03:58.626 ************************************ 00:03:58.626 15:27:49 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:03:58.626 15:27:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:58.626 15:27:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:58.626 15:27:49 -- common/autotest_common.sh@10 -- # set +x 00:03:58.626 ************************************ 00:03:58.626 START TEST alias_rpc 00:03:58.626 ************************************ 00:03:58.626 15:27:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:03:58.626 * Looking for test storage... 00:03:58.626 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:03:58.626 15:27:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:58.626 15:27:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:58.626 15:27:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:58.626 15:27:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:58.626 15:27:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:58.626 15:27:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:58.626 15:27:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:58.626 15:27:49 -- scripts/common.sh@335 -- # IFS=.-: 00:03:58.626 15:27:49 -- scripts/common.sh@335 -- # read -ra ver1 00:03:58.626 15:27:49 -- scripts/common.sh@336 -- # IFS=.-: 00:03:58.626 15:27:49 -- scripts/common.sh@336 -- # read -ra ver2 00:03:58.626 15:27:49 -- scripts/common.sh@337 -- # local 'op=<' 00:03:58.626 15:27:49 -- scripts/common.sh@339 -- # ver1_l=2 00:03:58.626 15:27:49 -- scripts/common.sh@340 -- # ver2_l=1 00:03:58.626 15:27:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:58.626 15:27:49 -- scripts/common.sh@343 -- # case "$op" in 00:03:58.626 15:27:49 -- scripts/common.sh@344 -- # : 1 00:03:58.626 15:27:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:58.626 15:27:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:58.626 15:27:49 -- scripts/common.sh@364 -- # decimal 1 00:03:58.626 15:27:49 -- scripts/common.sh@352 -- # local d=1 00:03:58.626 15:27:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:58.626 15:27:49 -- scripts/common.sh@354 -- # echo 1 00:03:58.626 15:27:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:58.626 15:27:49 -- scripts/common.sh@365 -- # decimal 2 00:03:58.626 15:27:49 -- scripts/common.sh@352 -- # local d=2 00:03:58.626 15:27:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:58.626 15:27:49 -- scripts/common.sh@354 -- # echo 2 00:03:58.626 15:27:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:58.626 15:27:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:58.626 15:27:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:58.626 15:27:49 -- scripts/common.sh@367 -- # return 0 00:03:58.626 15:27:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:58.626 15:27:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:58.626 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:58.626 --rc genhtml_branch_coverage=1 00:03:58.626 --rc genhtml_function_coverage=1 00:03:58.627 --rc genhtml_legend=1 00:03:58.627 --rc geninfo_all_blocks=1 00:03:58.627 --rc geninfo_unexecuted_blocks=1 00:03:58.627 00:03:58.627 ' 00:03:58.627 15:27:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:58.627 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:58.627 --rc genhtml_branch_coverage=1 00:03:58.627 --rc genhtml_function_coverage=1 00:03:58.627 --rc genhtml_legend=1 00:03:58.627 --rc geninfo_all_blocks=1 00:03:58.627 --rc geninfo_unexecuted_blocks=1 00:03:58.627 00:03:58.627 ' 00:03:58.627 15:27:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:58.627 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:58.627 --rc genhtml_branch_coverage=1 00:03:58.627 --rc genhtml_function_coverage=1 00:03:58.627 --rc genhtml_legend=1 00:03:58.627 --rc geninfo_all_blocks=1 00:03:58.627 --rc geninfo_unexecuted_blocks=1 00:03:58.627 00:03:58.627 ' 00:03:58.627 15:27:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:58.627 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:58.627 --rc genhtml_branch_coverage=1 00:03:58.627 --rc genhtml_function_coverage=1 00:03:58.627 --rc genhtml_legend=1 00:03:58.627 --rc geninfo_all_blocks=1 00:03:58.627 --rc geninfo_unexecuted_blocks=1 00:03:58.627 00:03:58.627 ' 00:03:58.627 15:27:49 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:03:58.627 15:27:49 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=749096 00:03:58.627 15:27:49 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:58.627 15:27:49 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 749096 00:03:58.627 15:27:49 -- common/autotest_common.sh@829 -- # '[' -z 749096 ']' 00:03:58.627 15:27:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:58.627 15:27:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:58.627 15:27:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:58.627 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:58.627 15:27:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:58.627 15:27:49 -- common/autotest_common.sh@10 -- # set +x 00:03:58.627 [2024-11-26 15:27:50.014933] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:58.627 [2024-11-26 15:27:50.015071] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid749096 ] 00:03:58.627 EAL: No free 2048 kB hugepages reported on node 1 00:03:58.886 [2024-11-26 15:27:50.077306] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:58.886 [2024-11-26 15:27:50.184644] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:58.886 [2024-11-26 15:27:50.184864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:59.822 15:27:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:59.822 15:27:50 -- common/autotest_common.sh@862 -- # return 0 00:03:59.822 15:27:50 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:03:59.822 15:27:51 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 749096 00:03:59.822 15:27:51 -- common/autotest_common.sh@936 -- # '[' -z 749096 ']' 00:03:59.822 15:27:51 -- common/autotest_common.sh@940 -- # kill -0 749096 00:03:59.822 15:27:51 -- common/autotest_common.sh@941 -- # uname 00:03:59.822 15:27:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:59.822 15:27:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 749096 00:04:00.082 15:27:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:00.082 15:27:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:00.082 15:27:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 749096' 00:04:00.082 killing process with pid 749096 00:04:00.082 15:27:51 -- common/autotest_common.sh@955 -- # kill 749096 00:04:00.082 15:27:51 -- common/autotest_common.sh@960 -- # wait 749096 00:04:00.340 00:04:00.340 real 0m1.926s 00:04:00.340 user 0m2.234s 00:04:00.340 sys 0m0.472s 00:04:00.340 15:27:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:00.340 15:27:51 -- common/autotest_common.sh@10 -- # set +x 00:04:00.340 ************************************ 00:04:00.340 END TEST alias_rpc 00:04:00.340 ************************************ 00:04:00.340 15:27:51 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:00.340 15:27:51 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:00.341 15:27:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:00.341 15:27:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:00.341 15:27:51 -- common/autotest_common.sh@10 -- # set +x 00:04:00.341 ************************************ 00:04:00.341 START TEST spdkcli_tcp 00:04:00.341 ************************************ 00:04:00.341 15:27:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:00.599 * Looking for test storage... 00:04:00.599 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:00.599 15:27:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:00.599 15:27:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:00.599 15:27:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:00.599 15:27:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:00.599 15:27:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:00.599 15:27:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:00.599 15:27:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:00.599 15:27:51 -- scripts/common.sh@335 -- # IFS=.-: 00:04:00.599 15:27:51 -- scripts/common.sh@335 -- # read -ra ver1 00:04:00.599 15:27:51 -- scripts/common.sh@336 -- # IFS=.-: 00:04:00.599 15:27:51 -- scripts/common.sh@336 -- # read -ra ver2 00:04:00.599 15:27:51 -- scripts/common.sh@337 -- # local 'op=<' 00:04:00.599 15:27:51 -- scripts/common.sh@339 -- # ver1_l=2 00:04:00.599 15:27:51 -- scripts/common.sh@340 -- # ver2_l=1 00:04:00.599 15:27:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:00.599 15:27:51 -- scripts/common.sh@343 -- # case "$op" in 00:04:00.599 15:27:51 -- scripts/common.sh@344 -- # : 1 00:04:00.599 15:27:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:00.599 15:27:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:00.599 15:27:51 -- scripts/common.sh@364 -- # decimal 1 00:04:00.599 15:27:51 -- scripts/common.sh@352 -- # local d=1 00:04:00.599 15:27:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:00.599 15:27:51 -- scripts/common.sh@354 -- # echo 1 00:04:00.599 15:27:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:00.599 15:27:51 -- scripts/common.sh@365 -- # decimal 2 00:04:00.600 15:27:51 -- scripts/common.sh@352 -- # local d=2 00:04:00.600 15:27:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:00.600 15:27:51 -- scripts/common.sh@354 -- # echo 2 00:04:00.600 15:27:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:00.600 15:27:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:00.600 15:27:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:00.600 15:27:51 -- scripts/common.sh@367 -- # return 0 00:04:00.600 15:27:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:00.600 15:27:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:00.600 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:00.600 --rc genhtml_branch_coverage=1 00:04:00.600 --rc genhtml_function_coverage=1 00:04:00.600 --rc genhtml_legend=1 00:04:00.600 --rc geninfo_all_blocks=1 00:04:00.600 --rc geninfo_unexecuted_blocks=1 00:04:00.600 00:04:00.600 ' 00:04:00.600 15:27:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:00.600 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:00.600 --rc genhtml_branch_coverage=1 00:04:00.600 --rc genhtml_function_coverage=1 00:04:00.600 --rc genhtml_legend=1 00:04:00.600 --rc geninfo_all_blocks=1 00:04:00.600 --rc geninfo_unexecuted_blocks=1 00:04:00.600 00:04:00.600 ' 00:04:00.600 15:27:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:00.600 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:00.600 --rc genhtml_branch_coverage=1 00:04:00.600 --rc genhtml_function_coverage=1 00:04:00.600 --rc genhtml_legend=1 00:04:00.600 --rc geninfo_all_blocks=1 00:04:00.600 --rc geninfo_unexecuted_blocks=1 00:04:00.600 00:04:00.600 ' 00:04:00.600 15:27:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:00.600 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:00.600 --rc genhtml_branch_coverage=1 00:04:00.600 --rc genhtml_function_coverage=1 00:04:00.600 --rc genhtml_legend=1 00:04:00.600 --rc geninfo_all_blocks=1 00:04:00.600 --rc geninfo_unexecuted_blocks=1 00:04:00.600 00:04:00.600 ' 00:04:00.600 15:27:51 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:00.600 15:27:51 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:00.600 15:27:51 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:00.600 15:27:51 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:00.600 15:27:51 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:00.600 15:27:51 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:00.600 15:27:51 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:00.600 15:27:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:00.600 15:27:51 -- common/autotest_common.sh@10 -- # set +x 00:04:00.600 15:27:51 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=749427 00:04:00.600 15:27:51 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:00.600 15:27:51 -- spdkcli/tcp.sh@27 -- # waitforlisten 749427 00:04:00.600 15:27:51 -- common/autotest_common.sh@829 -- # '[' -z 749427 ']' 00:04:00.600 15:27:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:00.600 15:27:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:00.600 15:27:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:00.600 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:00.600 15:27:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:00.600 15:27:51 -- common/autotest_common.sh@10 -- # set +x 00:04:00.600 [2024-11-26 15:27:51.965306] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:00.600 [2024-11-26 15:27:51.965381] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid749427 ] 00:04:00.600 EAL: No free 2048 kB hugepages reported on node 1 00:04:00.600 [2024-11-26 15:27:52.022932] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:00.860 [2024-11-26 15:27:52.133939] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:00.860 [2024-11-26 15:27:52.134161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:00.860 [2024-11-26 15:27:52.134168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:01.798 15:27:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:01.798 15:27:52 -- common/autotest_common.sh@862 -- # return 0 00:04:01.798 15:27:52 -- spdkcli/tcp.sh@31 -- # socat_pid=749560 00:04:01.798 15:27:52 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:01.799 15:27:52 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:01.799 [ 00:04:01.799 "bdev_malloc_delete", 00:04:01.799 "bdev_malloc_create", 00:04:01.799 "bdev_null_resize", 00:04:01.799 "bdev_null_delete", 00:04:01.799 "bdev_null_create", 00:04:01.799 "bdev_nvme_cuse_unregister", 00:04:01.799 "bdev_nvme_cuse_register", 00:04:01.799 "bdev_opal_new_user", 00:04:01.799 "bdev_opal_set_lock_state", 00:04:01.799 "bdev_opal_delete", 00:04:01.799 "bdev_opal_get_info", 00:04:01.799 "bdev_opal_create", 00:04:01.799 "bdev_nvme_opal_revert", 00:04:01.799 "bdev_nvme_opal_init", 00:04:01.799 "bdev_nvme_send_cmd", 00:04:01.799 "bdev_nvme_get_path_iostat", 00:04:01.799 "bdev_nvme_get_mdns_discovery_info", 00:04:01.799 "bdev_nvme_stop_mdns_discovery", 00:04:01.799 "bdev_nvme_start_mdns_discovery", 00:04:01.799 "bdev_nvme_set_multipath_policy", 00:04:01.799 "bdev_nvme_set_preferred_path", 00:04:01.799 "bdev_nvme_get_io_paths", 00:04:01.799 "bdev_nvme_remove_error_injection", 00:04:01.799 "bdev_nvme_add_error_injection", 00:04:01.799 "bdev_nvme_get_discovery_info", 00:04:01.799 "bdev_nvme_stop_discovery", 00:04:01.799 "bdev_nvme_start_discovery", 00:04:01.799 "bdev_nvme_get_controller_health_info", 00:04:01.799 "bdev_nvme_disable_controller", 00:04:01.799 "bdev_nvme_enable_controller", 00:04:01.799 "bdev_nvme_reset_controller", 00:04:01.799 "bdev_nvme_get_transport_statistics", 00:04:01.799 "bdev_nvme_apply_firmware", 00:04:01.799 "bdev_nvme_detach_controller", 00:04:01.799 "bdev_nvme_get_controllers", 00:04:01.799 "bdev_nvme_attach_controller", 00:04:01.799 "bdev_nvme_set_hotplug", 00:04:01.799 "bdev_nvme_set_options", 00:04:01.799 "bdev_passthru_delete", 00:04:01.799 "bdev_passthru_create", 00:04:01.799 "bdev_lvol_grow_lvstore", 00:04:01.799 "bdev_lvol_get_lvols", 00:04:01.799 "bdev_lvol_get_lvstores", 00:04:01.799 "bdev_lvol_delete", 00:04:01.799 "bdev_lvol_set_read_only", 00:04:01.799 "bdev_lvol_resize", 00:04:01.799 "bdev_lvol_decouple_parent", 00:04:01.799 "bdev_lvol_inflate", 00:04:01.799 "bdev_lvol_rename", 00:04:01.799 "bdev_lvol_clone_bdev", 00:04:01.799 "bdev_lvol_clone", 00:04:01.799 "bdev_lvol_snapshot", 00:04:01.799 "bdev_lvol_create", 00:04:01.799 "bdev_lvol_delete_lvstore", 00:04:01.799 "bdev_lvol_rename_lvstore", 00:04:01.799 "bdev_lvol_create_lvstore", 00:04:01.799 "bdev_raid_set_options", 00:04:01.799 "bdev_raid_remove_base_bdev", 00:04:01.799 "bdev_raid_add_base_bdev", 00:04:01.799 "bdev_raid_delete", 00:04:01.799 "bdev_raid_create", 00:04:01.799 "bdev_raid_get_bdevs", 00:04:01.799 "bdev_error_inject_error", 00:04:01.799 "bdev_error_delete", 00:04:01.799 "bdev_error_create", 00:04:01.799 "bdev_split_delete", 00:04:01.799 "bdev_split_create", 00:04:01.799 "bdev_delay_delete", 00:04:01.799 "bdev_delay_create", 00:04:01.799 "bdev_delay_update_latency", 00:04:01.799 "bdev_zone_block_delete", 00:04:01.799 "bdev_zone_block_create", 00:04:01.799 "blobfs_create", 00:04:01.799 "blobfs_detect", 00:04:01.799 "blobfs_set_cache_size", 00:04:01.799 "bdev_aio_delete", 00:04:01.799 "bdev_aio_rescan", 00:04:01.799 "bdev_aio_create", 00:04:01.799 "bdev_ftl_set_property", 00:04:01.799 "bdev_ftl_get_properties", 00:04:01.799 "bdev_ftl_get_stats", 00:04:01.799 "bdev_ftl_unmap", 00:04:01.799 "bdev_ftl_unload", 00:04:01.799 "bdev_ftl_delete", 00:04:01.799 "bdev_ftl_load", 00:04:01.799 "bdev_ftl_create", 00:04:01.799 "bdev_virtio_attach_controller", 00:04:01.799 "bdev_virtio_scsi_get_devices", 00:04:01.799 "bdev_virtio_detach_controller", 00:04:01.799 "bdev_virtio_blk_set_hotplug", 00:04:01.799 "bdev_iscsi_delete", 00:04:01.799 "bdev_iscsi_create", 00:04:01.799 "bdev_iscsi_set_options", 00:04:01.799 "accel_error_inject_error", 00:04:01.799 "ioat_scan_accel_module", 00:04:01.799 "dsa_scan_accel_module", 00:04:01.799 "iaa_scan_accel_module", 00:04:01.799 "iscsi_set_options", 00:04:01.799 "iscsi_get_auth_groups", 00:04:01.799 "iscsi_auth_group_remove_secret", 00:04:01.799 "iscsi_auth_group_add_secret", 00:04:01.799 "iscsi_delete_auth_group", 00:04:01.799 "iscsi_create_auth_group", 00:04:01.799 "iscsi_set_discovery_auth", 00:04:01.799 "iscsi_get_options", 00:04:01.799 "iscsi_target_node_request_logout", 00:04:01.799 "iscsi_target_node_set_redirect", 00:04:01.799 "iscsi_target_node_set_auth", 00:04:01.799 "iscsi_target_node_add_lun", 00:04:01.799 "iscsi_get_connections", 00:04:01.799 "iscsi_portal_group_set_auth", 00:04:01.799 "iscsi_start_portal_group", 00:04:01.799 "iscsi_delete_portal_group", 00:04:01.799 "iscsi_create_portal_group", 00:04:01.799 "iscsi_get_portal_groups", 00:04:01.799 "iscsi_delete_target_node", 00:04:01.799 "iscsi_target_node_remove_pg_ig_maps", 00:04:01.799 "iscsi_target_node_add_pg_ig_maps", 00:04:01.799 "iscsi_create_target_node", 00:04:01.799 "iscsi_get_target_nodes", 00:04:01.799 "iscsi_delete_initiator_group", 00:04:01.799 "iscsi_initiator_group_remove_initiators", 00:04:01.799 "iscsi_initiator_group_add_initiators", 00:04:01.799 "iscsi_create_initiator_group", 00:04:01.799 "iscsi_get_initiator_groups", 00:04:01.799 "nvmf_set_crdt", 00:04:01.799 "nvmf_set_config", 00:04:01.799 "nvmf_set_max_subsystems", 00:04:01.799 "nvmf_subsystem_get_listeners", 00:04:01.799 "nvmf_subsystem_get_qpairs", 00:04:01.799 "nvmf_subsystem_get_controllers", 00:04:01.799 "nvmf_get_stats", 00:04:01.799 "nvmf_get_transports", 00:04:01.799 "nvmf_create_transport", 00:04:01.799 "nvmf_get_targets", 00:04:01.799 "nvmf_delete_target", 00:04:01.799 "nvmf_create_target", 00:04:01.799 "nvmf_subsystem_allow_any_host", 00:04:01.799 "nvmf_subsystem_remove_host", 00:04:01.799 "nvmf_subsystem_add_host", 00:04:01.799 "nvmf_subsystem_remove_ns", 00:04:01.799 "nvmf_subsystem_add_ns", 00:04:01.799 "nvmf_subsystem_listener_set_ana_state", 00:04:01.799 "nvmf_discovery_get_referrals", 00:04:01.799 "nvmf_discovery_remove_referral", 00:04:01.799 "nvmf_discovery_add_referral", 00:04:01.799 "nvmf_subsystem_remove_listener", 00:04:01.799 "nvmf_subsystem_add_listener", 00:04:01.799 "nvmf_delete_subsystem", 00:04:01.799 "nvmf_create_subsystem", 00:04:01.799 "nvmf_get_subsystems", 00:04:01.799 "env_dpdk_get_mem_stats", 00:04:01.799 "nbd_get_disks", 00:04:01.799 "nbd_stop_disk", 00:04:01.799 "nbd_start_disk", 00:04:01.799 "ublk_recover_disk", 00:04:01.799 "ublk_get_disks", 00:04:01.799 "ublk_stop_disk", 00:04:01.799 "ublk_start_disk", 00:04:01.799 "ublk_destroy_target", 00:04:01.799 "ublk_create_target", 00:04:01.799 "virtio_blk_create_transport", 00:04:01.799 "virtio_blk_get_transports", 00:04:01.799 "vhost_controller_set_coalescing", 00:04:01.799 "vhost_get_controllers", 00:04:01.799 "vhost_delete_controller", 00:04:01.799 "vhost_create_blk_controller", 00:04:01.799 "vhost_scsi_controller_remove_target", 00:04:01.799 "vhost_scsi_controller_add_target", 00:04:01.799 "vhost_start_scsi_controller", 00:04:01.799 "vhost_create_scsi_controller", 00:04:01.800 "thread_set_cpumask", 00:04:01.800 "framework_get_scheduler", 00:04:01.800 "framework_set_scheduler", 00:04:01.800 "framework_get_reactors", 00:04:01.800 "thread_get_io_channels", 00:04:01.800 "thread_get_pollers", 00:04:01.800 "thread_get_stats", 00:04:01.800 "framework_monitor_context_switch", 00:04:01.800 "spdk_kill_instance", 00:04:01.800 "log_enable_timestamps", 00:04:01.800 "log_get_flags", 00:04:01.800 "log_clear_flag", 00:04:01.800 "log_set_flag", 00:04:01.800 "log_get_level", 00:04:01.800 "log_set_level", 00:04:01.800 "log_get_print_level", 00:04:01.800 "log_set_print_level", 00:04:01.800 "framework_enable_cpumask_locks", 00:04:01.800 "framework_disable_cpumask_locks", 00:04:01.800 "framework_wait_init", 00:04:01.800 "framework_start_init", 00:04:01.800 "scsi_get_devices", 00:04:01.800 "bdev_get_histogram", 00:04:01.800 "bdev_enable_histogram", 00:04:01.800 "bdev_set_qos_limit", 00:04:01.800 "bdev_set_qd_sampling_period", 00:04:01.800 "bdev_get_bdevs", 00:04:01.800 "bdev_reset_iostat", 00:04:01.800 "bdev_get_iostat", 00:04:01.800 "bdev_examine", 00:04:01.800 "bdev_wait_for_examine", 00:04:01.800 "bdev_set_options", 00:04:01.800 "notify_get_notifications", 00:04:01.800 "notify_get_types", 00:04:01.800 "accel_get_stats", 00:04:01.800 "accel_set_options", 00:04:01.800 "accel_set_driver", 00:04:01.800 "accel_crypto_key_destroy", 00:04:01.800 "accel_crypto_keys_get", 00:04:01.800 "accel_crypto_key_create", 00:04:01.800 "accel_assign_opc", 00:04:01.800 "accel_get_module_info", 00:04:01.800 "accel_get_opc_assignments", 00:04:01.800 "vmd_rescan", 00:04:01.800 "vmd_remove_device", 00:04:01.800 "vmd_enable", 00:04:01.800 "sock_set_default_impl", 00:04:01.800 "sock_impl_set_options", 00:04:01.800 "sock_impl_get_options", 00:04:01.800 "iobuf_get_stats", 00:04:01.800 "iobuf_set_options", 00:04:01.800 "framework_get_pci_devices", 00:04:01.800 "framework_get_config", 00:04:01.800 "framework_get_subsystems", 00:04:01.800 "trace_get_info", 00:04:01.800 "trace_get_tpoint_group_mask", 00:04:01.800 "trace_disable_tpoint_group", 00:04:01.800 "trace_enable_tpoint_group", 00:04:01.800 "trace_clear_tpoint_mask", 00:04:01.800 "trace_set_tpoint_mask", 00:04:01.800 "spdk_get_version", 00:04:01.800 "rpc_get_methods" 00:04:01.800 ] 00:04:01.800 15:27:53 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:01.800 15:27:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:01.800 15:27:53 -- common/autotest_common.sh@10 -- # set +x 00:04:01.800 15:27:53 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:01.800 15:27:53 -- spdkcli/tcp.sh@38 -- # killprocess 749427 00:04:01.800 15:27:53 -- common/autotest_common.sh@936 -- # '[' -z 749427 ']' 00:04:01.800 15:27:53 -- common/autotest_common.sh@940 -- # kill -0 749427 00:04:01.800 15:27:53 -- common/autotest_common.sh@941 -- # uname 00:04:01.800 15:27:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:01.800 15:27:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 749427 00:04:02.059 15:27:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:02.059 15:27:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:02.059 15:27:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 749427' 00:04:02.059 killing process with pid 749427 00:04:02.059 15:27:53 -- common/autotest_common.sh@955 -- # kill 749427 00:04:02.059 15:27:53 -- common/autotest_common.sh@960 -- # wait 749427 00:04:02.319 00:04:02.319 real 0m1.927s 00:04:02.319 user 0m3.671s 00:04:02.319 sys 0m0.489s 00:04:02.319 15:27:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:02.319 15:27:53 -- common/autotest_common.sh@10 -- # set +x 00:04:02.319 ************************************ 00:04:02.319 END TEST spdkcli_tcp 00:04:02.319 ************************************ 00:04:02.319 15:27:53 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:02.319 15:27:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:02.319 15:27:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:02.319 15:27:53 -- common/autotest_common.sh@10 -- # set +x 00:04:02.319 ************************************ 00:04:02.319 START TEST dpdk_mem_utility 00:04:02.319 ************************************ 00:04:02.319 15:27:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:02.579 * Looking for test storage... 00:04:02.579 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:02.579 15:27:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:02.579 15:27:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:02.579 15:27:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:02.579 15:27:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:02.579 15:27:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:02.579 15:27:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:02.579 15:27:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:02.579 15:27:53 -- scripts/common.sh@335 -- # IFS=.-: 00:04:02.579 15:27:53 -- scripts/common.sh@335 -- # read -ra ver1 00:04:02.579 15:27:53 -- scripts/common.sh@336 -- # IFS=.-: 00:04:02.579 15:27:53 -- scripts/common.sh@336 -- # read -ra ver2 00:04:02.579 15:27:53 -- scripts/common.sh@337 -- # local 'op=<' 00:04:02.579 15:27:53 -- scripts/common.sh@339 -- # ver1_l=2 00:04:02.579 15:27:53 -- scripts/common.sh@340 -- # ver2_l=1 00:04:02.579 15:27:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:02.579 15:27:53 -- scripts/common.sh@343 -- # case "$op" in 00:04:02.579 15:27:53 -- scripts/common.sh@344 -- # : 1 00:04:02.579 15:27:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:02.579 15:27:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:02.579 15:27:53 -- scripts/common.sh@364 -- # decimal 1 00:04:02.579 15:27:53 -- scripts/common.sh@352 -- # local d=1 00:04:02.579 15:27:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:02.579 15:27:53 -- scripts/common.sh@354 -- # echo 1 00:04:02.579 15:27:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:02.579 15:27:53 -- scripts/common.sh@365 -- # decimal 2 00:04:02.579 15:27:53 -- scripts/common.sh@352 -- # local d=2 00:04:02.579 15:27:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:02.579 15:27:53 -- scripts/common.sh@354 -- # echo 2 00:04:02.579 15:27:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:02.579 15:27:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:02.579 15:27:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:02.579 15:27:53 -- scripts/common.sh@367 -- # return 0 00:04:02.579 15:27:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:02.579 15:27:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:02.579 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:02.579 --rc genhtml_branch_coverage=1 00:04:02.579 --rc genhtml_function_coverage=1 00:04:02.579 --rc genhtml_legend=1 00:04:02.579 --rc geninfo_all_blocks=1 00:04:02.579 --rc geninfo_unexecuted_blocks=1 00:04:02.579 00:04:02.579 ' 00:04:02.579 15:27:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:02.579 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:02.579 --rc genhtml_branch_coverage=1 00:04:02.579 --rc genhtml_function_coverage=1 00:04:02.579 --rc genhtml_legend=1 00:04:02.579 --rc geninfo_all_blocks=1 00:04:02.579 --rc geninfo_unexecuted_blocks=1 00:04:02.579 00:04:02.579 ' 00:04:02.579 15:27:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:02.579 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:02.579 --rc genhtml_branch_coverage=1 00:04:02.579 --rc genhtml_function_coverage=1 00:04:02.579 --rc genhtml_legend=1 00:04:02.579 --rc geninfo_all_blocks=1 00:04:02.579 --rc geninfo_unexecuted_blocks=1 00:04:02.580 00:04:02.580 ' 00:04:02.580 15:27:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:02.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:02.580 --rc genhtml_branch_coverage=1 00:04:02.580 --rc genhtml_function_coverage=1 00:04:02.580 --rc genhtml_legend=1 00:04:02.580 --rc geninfo_all_blocks=1 00:04:02.580 --rc geninfo_unexecuted_blocks=1 00:04:02.580 00:04:02.580 ' 00:04:02.580 15:27:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:02.580 15:27:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=749713 00:04:02.580 15:27:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:02.580 15:27:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 749713 00:04:02.580 15:27:53 -- common/autotest_common.sh@829 -- # '[' -z 749713 ']' 00:04:02.580 15:27:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:02.580 15:27:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:02.580 15:27:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:02.580 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:02.580 15:27:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:02.580 15:27:53 -- common/autotest_common.sh@10 -- # set +x 00:04:02.580 [2024-11-26 15:27:53.928541] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:02.580 [2024-11-26 15:27:53.928642] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid749713 ] 00:04:02.580 EAL: No free 2048 kB hugepages reported on node 1 00:04:02.580 [2024-11-26 15:27:53.990089] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:02.840 [2024-11-26 15:27:54.105894] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:02.840 [2024-11-26 15:27:54.106076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:03.779 15:27:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:03.779 15:27:54 -- common/autotest_common.sh@862 -- # return 0 00:04:03.779 15:27:54 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:03.779 15:27:54 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:03.779 15:27:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:03.779 15:27:54 -- common/autotest_common.sh@10 -- # set +x 00:04:03.779 { 00:04:03.779 "filename": "/tmp/spdk_mem_dump.txt" 00:04:03.779 } 00:04:03.779 15:27:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:03.779 15:27:54 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:03.779 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:03.779 1 heaps totaling size 814.000000 MiB 00:04:03.780 size: 814.000000 MiB heap id: 0 00:04:03.780 end heaps---------- 00:04:03.780 8 mempools totaling size 598.116089 MiB 00:04:03.780 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:03.780 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:03.780 size: 84.521057 MiB name: bdev_io_749713 00:04:03.780 size: 51.011292 MiB name: evtpool_749713 00:04:03.780 size: 50.003479 MiB name: msgpool_749713 00:04:03.780 size: 21.763794 MiB name: PDU_Pool 00:04:03.780 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:03.780 size: 0.026123 MiB name: Session_Pool 00:04:03.780 end mempools------- 00:04:03.780 6 memzones totaling size 4.142822 MiB 00:04:03.780 size: 1.000366 MiB name: RG_ring_0_749713 00:04:03.780 size: 1.000366 MiB name: RG_ring_1_749713 00:04:03.780 size: 1.000366 MiB name: RG_ring_4_749713 00:04:03.780 size: 1.000366 MiB name: RG_ring_5_749713 00:04:03.780 size: 0.125366 MiB name: RG_ring_2_749713 00:04:03.780 size: 0.015991 MiB name: RG_ring_3_749713 00:04:03.780 end memzones------- 00:04:03.780 15:27:54 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:03.780 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:03.780 list of free elements. size: 12.519348 MiB 00:04:03.780 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:03.780 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:03.780 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:03.780 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:03.780 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:03.780 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:03.780 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:03.780 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:03.780 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:03.780 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:03.780 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:03.780 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:03.780 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:03.780 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:03.780 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:03.780 list of standard malloc elements. size: 199.218079 MiB 00:04:03.780 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:03.780 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:03.780 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:03.780 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:03.780 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:03.780 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:03.780 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:03.780 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:03.780 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:03.780 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:03.780 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:03.780 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:03.780 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:03.780 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:03.780 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:03.780 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:03.780 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:03.780 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:03.780 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:03.780 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:03.780 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:03.780 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:03.780 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:03.780 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:03.780 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:03.780 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:03.780 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:03.780 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:03.780 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:03.780 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:03.780 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:03.780 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:03.780 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:03.780 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:03.780 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:03.780 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:03.780 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:03.780 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:03.780 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:03.780 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:03.780 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:03.780 list of memzone associated elements. size: 602.262573 MiB 00:04:03.780 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:03.780 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:03.780 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:03.780 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:03.780 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:03.780 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_749713_0 00:04:03.780 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:03.780 associated memzone info: size: 48.002930 MiB name: MP_evtpool_749713_0 00:04:03.780 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:03.780 associated memzone info: size: 48.002930 MiB name: MP_msgpool_749713_0 00:04:03.780 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:03.780 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:03.780 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:03.780 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:03.780 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:03.780 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_749713 00:04:03.780 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:03.780 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_749713 00:04:03.780 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:03.780 associated memzone info: size: 1.007996 MiB name: MP_evtpool_749713 00:04:03.780 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:03.780 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:03.780 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:03.780 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:03.780 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:03.780 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:03.780 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:03.780 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:03.780 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:03.780 associated memzone info: size: 1.000366 MiB name: RG_ring_0_749713 00:04:03.780 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:03.780 associated memzone info: size: 1.000366 MiB name: RG_ring_1_749713 00:04:03.780 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:03.780 associated memzone info: size: 1.000366 MiB name: RG_ring_4_749713 00:04:03.780 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:03.780 associated memzone info: size: 1.000366 MiB name: RG_ring_5_749713 00:04:03.780 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:03.780 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_749713 00:04:03.780 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:03.780 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:03.780 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:03.780 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:03.780 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:03.780 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:03.780 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:03.780 associated memzone info: size: 0.125366 MiB name: RG_ring_2_749713 00:04:03.780 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:03.780 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:03.780 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:03.780 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:03.780 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:03.780 associated memzone info: size: 0.015991 MiB name: RG_ring_3_749713 00:04:03.780 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:03.780 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:03.780 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:03.780 associated memzone info: size: 0.000183 MiB name: MP_msgpool_749713 00:04:03.780 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:03.780 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_749713 00:04:03.780 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:03.780 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:03.780 15:27:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:03.780 15:27:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 749713 00:04:03.780 15:27:55 -- common/autotest_common.sh@936 -- # '[' -z 749713 ']' 00:04:03.780 15:27:55 -- common/autotest_common.sh@940 -- # kill -0 749713 00:04:03.780 15:27:55 -- common/autotest_common.sh@941 -- # uname 00:04:03.780 15:27:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:03.780 15:27:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 749713 00:04:03.780 15:27:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:03.780 15:27:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:03.780 15:27:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 749713' 00:04:03.780 killing process with pid 749713 00:04:03.781 15:27:55 -- common/autotest_common.sh@955 -- # kill 749713 00:04:03.781 15:27:55 -- common/autotest_common.sh@960 -- # wait 749713 00:04:04.350 00:04:04.350 real 0m1.793s 00:04:04.350 user 0m2.002s 00:04:04.350 sys 0m0.467s 00:04:04.350 15:27:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:04.350 15:27:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.350 ************************************ 00:04:04.350 END TEST dpdk_mem_utility 00:04:04.350 ************************************ 00:04:04.350 15:27:55 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:04.350 15:27:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.350 15:27:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.350 15:27:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.350 ************************************ 00:04:04.350 START TEST event 00:04:04.350 ************************************ 00:04:04.350 15:27:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:04.350 * Looking for test storage... 00:04:04.350 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:04.350 15:27:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:04.350 15:27:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:04.350 15:27:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:04.350 15:27:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:04.350 15:27:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:04.350 15:27:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:04.350 15:27:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:04.350 15:27:55 -- scripts/common.sh@335 -- # IFS=.-: 00:04:04.350 15:27:55 -- scripts/common.sh@335 -- # read -ra ver1 00:04:04.350 15:27:55 -- scripts/common.sh@336 -- # IFS=.-: 00:04:04.350 15:27:55 -- scripts/common.sh@336 -- # read -ra ver2 00:04:04.350 15:27:55 -- scripts/common.sh@337 -- # local 'op=<' 00:04:04.350 15:27:55 -- scripts/common.sh@339 -- # ver1_l=2 00:04:04.350 15:27:55 -- scripts/common.sh@340 -- # ver2_l=1 00:04:04.350 15:27:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:04.350 15:27:55 -- scripts/common.sh@343 -- # case "$op" in 00:04:04.350 15:27:55 -- scripts/common.sh@344 -- # : 1 00:04:04.350 15:27:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:04.350 15:27:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:04.350 15:27:55 -- scripts/common.sh@364 -- # decimal 1 00:04:04.350 15:27:55 -- scripts/common.sh@352 -- # local d=1 00:04:04.350 15:27:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:04.350 15:27:55 -- scripts/common.sh@354 -- # echo 1 00:04:04.350 15:27:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:04.350 15:27:55 -- scripts/common.sh@365 -- # decimal 2 00:04:04.350 15:27:55 -- scripts/common.sh@352 -- # local d=2 00:04:04.350 15:27:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:04.350 15:27:55 -- scripts/common.sh@354 -- # echo 2 00:04:04.350 15:27:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:04.350 15:27:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:04.350 15:27:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:04.350 15:27:55 -- scripts/common.sh@367 -- # return 0 00:04:04.350 15:27:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:04.350 15:27:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:04.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.350 --rc genhtml_branch_coverage=1 00:04:04.350 --rc genhtml_function_coverage=1 00:04:04.350 --rc genhtml_legend=1 00:04:04.350 --rc geninfo_all_blocks=1 00:04:04.350 --rc geninfo_unexecuted_blocks=1 00:04:04.350 00:04:04.350 ' 00:04:04.350 15:27:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:04.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.350 --rc genhtml_branch_coverage=1 00:04:04.350 --rc genhtml_function_coverage=1 00:04:04.350 --rc genhtml_legend=1 00:04:04.350 --rc geninfo_all_blocks=1 00:04:04.350 --rc geninfo_unexecuted_blocks=1 00:04:04.350 00:04:04.350 ' 00:04:04.350 15:27:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:04.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.350 --rc genhtml_branch_coverage=1 00:04:04.350 --rc genhtml_function_coverage=1 00:04:04.350 --rc genhtml_legend=1 00:04:04.350 --rc geninfo_all_blocks=1 00:04:04.350 --rc geninfo_unexecuted_blocks=1 00:04:04.350 00:04:04.350 ' 00:04:04.350 15:27:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:04.350 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.350 --rc genhtml_branch_coverage=1 00:04:04.350 --rc genhtml_function_coverage=1 00:04:04.350 --rc genhtml_legend=1 00:04:04.350 --rc geninfo_all_blocks=1 00:04:04.350 --rc geninfo_unexecuted_blocks=1 00:04:04.350 00:04:04.350 ' 00:04:04.350 15:27:55 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:04.350 15:27:55 -- bdev/nbd_common.sh@6 -- # set -e 00:04:04.350 15:27:55 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:04.350 15:27:55 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:04.350 15:27:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.350 15:27:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.350 ************************************ 00:04:04.350 START TEST event_perf 00:04:04.350 ************************************ 00:04:04.350 15:27:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:04.350 Running I/O for 1 seconds...[2024-11-26 15:27:55.716282] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:04.351 [2024-11-26 15:27:55.716371] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid749980 ] 00:04:04.351 EAL: No free 2048 kB hugepages reported on node 1 00:04:04.351 [2024-11-26 15:27:55.782622] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:04.610 [2024-11-26 15:27:55.900833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:04.610 [2024-11-26 15:27:55.900928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:04.610 [2024-11-26 15:27:55.900931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:04.610 [2024-11-26 15:27:55.900901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:05.992 Running I/O for 1 seconds... 00:04:05.992 lcore 0: 227814 00:04:05.992 lcore 1: 227813 00:04:05.992 lcore 2: 227813 00:04:05.992 lcore 3: 227813 00:04:05.992 done. 00:04:05.992 00:04:05.992 real 0m1.324s 00:04:05.992 user 0m4.225s 00:04:05.992 sys 0m0.093s 00:04:05.992 15:27:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:05.992 15:27:57 -- common/autotest_common.sh@10 -- # set +x 00:04:05.992 ************************************ 00:04:05.992 END TEST event_perf 00:04:05.992 ************************************ 00:04:05.992 15:27:57 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:05.992 15:27:57 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:05.992 15:27:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:05.992 15:27:57 -- common/autotest_common.sh@10 -- # set +x 00:04:05.992 ************************************ 00:04:05.992 START TEST event_reactor 00:04:05.992 ************************************ 00:04:05.992 15:27:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:05.992 [2024-11-26 15:27:57.066359] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:05.992 [2024-11-26 15:27:57.066450] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid750139 ] 00:04:05.992 EAL: No free 2048 kB hugepages reported on node 1 00:04:05.992 [2024-11-26 15:27:57.129228] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:05.992 [2024-11-26 15:27:57.245337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:06.931 test_start 00:04:06.931 oneshot 00:04:06.931 tick 100 00:04:06.931 tick 100 00:04:06.931 tick 250 00:04:06.931 tick 100 00:04:06.931 tick 100 00:04:06.931 tick 100 00:04:06.931 tick 250 00:04:06.931 tick 500 00:04:06.931 tick 100 00:04:06.931 tick 100 00:04:06.931 tick 250 00:04:06.931 tick 100 00:04:06.931 tick 100 00:04:06.931 test_end 00:04:06.931 00:04:06.931 real 0m1.315s 00:04:06.931 user 0m1.225s 00:04:06.931 sys 0m0.085s 00:04:06.931 15:27:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:06.931 15:27:58 -- common/autotest_common.sh@10 -- # set +x 00:04:06.931 ************************************ 00:04:06.931 END TEST event_reactor 00:04:06.931 ************************************ 00:04:07.189 15:27:58 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:07.189 15:27:58 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:07.189 15:27:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.189 15:27:58 -- common/autotest_common.sh@10 -- # set +x 00:04:07.189 ************************************ 00:04:07.189 START TEST event_reactor_perf 00:04:07.189 ************************************ 00:04:07.189 15:27:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:07.189 [2024-11-26 15:27:58.408413] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:07.189 [2024-11-26 15:27:58.408505] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid750323 ] 00:04:07.189 EAL: No free 2048 kB hugepages reported on node 1 00:04:07.189 [2024-11-26 15:27:58.471289] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:07.189 [2024-11-26 15:27:58.586524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:08.564 test_start 00:04:08.564 test_end 00:04:08.564 Performance: 353294 events per second 00:04:08.564 00:04:08.564 real 0m1.317s 00:04:08.564 user 0m1.232s 00:04:08.564 sys 0m0.078s 00:04:08.564 15:27:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:08.564 15:27:59 -- common/autotest_common.sh@10 -- # set +x 00:04:08.564 ************************************ 00:04:08.564 END TEST event_reactor_perf 00:04:08.564 ************************************ 00:04:08.564 15:27:59 -- event/event.sh@49 -- # uname -s 00:04:08.564 15:27:59 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:08.564 15:27:59 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:08.564 15:27:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.564 15:27:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.564 15:27:59 -- common/autotest_common.sh@10 -- # set +x 00:04:08.564 ************************************ 00:04:08.564 START TEST event_scheduler 00:04:08.564 ************************************ 00:04:08.564 15:27:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:08.564 * Looking for test storage... 00:04:08.564 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:08.564 15:27:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:08.564 15:27:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:08.564 15:27:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:08.564 15:27:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:08.564 15:27:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:08.564 15:27:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:08.564 15:27:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:08.564 15:27:59 -- scripts/common.sh@335 -- # IFS=.-: 00:04:08.564 15:27:59 -- scripts/common.sh@335 -- # read -ra ver1 00:04:08.564 15:27:59 -- scripts/common.sh@336 -- # IFS=.-: 00:04:08.564 15:27:59 -- scripts/common.sh@336 -- # read -ra ver2 00:04:08.564 15:27:59 -- scripts/common.sh@337 -- # local 'op=<' 00:04:08.564 15:27:59 -- scripts/common.sh@339 -- # ver1_l=2 00:04:08.564 15:27:59 -- scripts/common.sh@340 -- # ver2_l=1 00:04:08.564 15:27:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:08.564 15:27:59 -- scripts/common.sh@343 -- # case "$op" in 00:04:08.564 15:27:59 -- scripts/common.sh@344 -- # : 1 00:04:08.564 15:27:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:08.564 15:27:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:08.564 15:27:59 -- scripts/common.sh@364 -- # decimal 1 00:04:08.564 15:27:59 -- scripts/common.sh@352 -- # local d=1 00:04:08.564 15:27:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:08.564 15:27:59 -- scripts/common.sh@354 -- # echo 1 00:04:08.564 15:27:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:08.564 15:27:59 -- scripts/common.sh@365 -- # decimal 2 00:04:08.564 15:27:59 -- scripts/common.sh@352 -- # local d=2 00:04:08.564 15:27:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:08.564 15:27:59 -- scripts/common.sh@354 -- # echo 2 00:04:08.564 15:27:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:08.564 15:27:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:08.564 15:27:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:08.564 15:27:59 -- scripts/common.sh@367 -- # return 0 00:04:08.564 15:27:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:08.564 15:27:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:08.564 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:08.564 --rc genhtml_branch_coverage=1 00:04:08.564 --rc genhtml_function_coverage=1 00:04:08.564 --rc genhtml_legend=1 00:04:08.564 --rc geninfo_all_blocks=1 00:04:08.564 --rc geninfo_unexecuted_blocks=1 00:04:08.564 00:04:08.564 ' 00:04:08.564 15:27:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:08.564 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:08.565 --rc genhtml_branch_coverage=1 00:04:08.565 --rc genhtml_function_coverage=1 00:04:08.565 --rc genhtml_legend=1 00:04:08.565 --rc geninfo_all_blocks=1 00:04:08.565 --rc geninfo_unexecuted_blocks=1 00:04:08.565 00:04:08.565 ' 00:04:08.565 15:27:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:08.565 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:08.565 --rc genhtml_branch_coverage=1 00:04:08.565 --rc genhtml_function_coverage=1 00:04:08.565 --rc genhtml_legend=1 00:04:08.565 --rc geninfo_all_blocks=1 00:04:08.565 --rc geninfo_unexecuted_blocks=1 00:04:08.565 00:04:08.565 ' 00:04:08.565 15:27:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:08.565 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:08.565 --rc genhtml_branch_coverage=1 00:04:08.565 --rc genhtml_function_coverage=1 00:04:08.565 --rc genhtml_legend=1 00:04:08.565 --rc geninfo_all_blocks=1 00:04:08.565 --rc geninfo_unexecuted_blocks=1 00:04:08.565 00:04:08.565 ' 00:04:08.565 15:27:59 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:08.565 15:27:59 -- scheduler/scheduler.sh@35 -- # scheduler_pid=750616 00:04:08.565 15:27:59 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:08.565 15:27:59 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:08.565 15:27:59 -- scheduler/scheduler.sh@37 -- # waitforlisten 750616 00:04:08.565 15:27:59 -- common/autotest_common.sh@829 -- # '[' -z 750616 ']' 00:04:08.565 15:27:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:08.565 15:27:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:08.565 15:27:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:08.565 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:08.565 15:27:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:08.565 15:27:59 -- common/autotest_common.sh@10 -- # set +x 00:04:08.565 [2024-11-26 15:27:59.905929] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:08.565 [2024-11-26 15:27:59.906026] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid750616 ] 00:04:08.565 EAL: No free 2048 kB hugepages reported on node 1 00:04:08.565 [2024-11-26 15:27:59.962225] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:08.823 [2024-11-26 15:28:00.072998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:08.823 [2024-11-26 15:28:00.073067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:08.823 [2024-11-26 15:28:00.073119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:08.823 [2024-11-26 15:28:00.073123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:08.823 15:28:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:08.823 15:28:00 -- common/autotest_common.sh@862 -- # return 0 00:04:08.823 15:28:00 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:08.823 15:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.823 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:08.823 POWER: Env isn't set yet! 00:04:08.823 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:08.823 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:08.823 POWER: Cannot get available frequencies of lcore 0 00:04:08.823 POWER: Attempting to initialise PSTAT power management... 00:04:08.823 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:08.823 POWER: Initialized successfully for lcore 0 power management 00:04:08.823 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:08.823 POWER: Initialized successfully for lcore 1 power management 00:04:08.823 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:08.823 POWER: Initialized successfully for lcore 2 power management 00:04:08.823 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:08.823 POWER: Initialized successfully for lcore 3 power management 00:04:08.823 [2024-11-26 15:28:00.161903] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:08.823 [2024-11-26 15:28:00.161920] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:08.823 [2024-11-26 15:28:00.161931] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:08.823 15:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.823 15:28:00 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:08.823 15:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.823 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:08.823 [2024-11-26 15:28:00.267313] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:08.823 15:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.823 15:28:00 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:08.823 15:28:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.823 15:28:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.823 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:09.084 ************************************ 00:04:09.084 START TEST scheduler_create_thread 00:04:09.084 ************************************ 00:04:09.084 15:28:00 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:09.084 15:28:00 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:09.084 15:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.084 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:09.084 2 00:04:09.084 15:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.084 15:28:00 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:09.084 15:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.084 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:09.084 3 00:04:09.084 15:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.084 15:28:00 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:09.084 15:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.084 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:09.084 4 00:04:09.084 15:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.084 15:28:00 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:09.084 15:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.084 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:09.084 5 00:04:09.084 15:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.084 15:28:00 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:09.084 15:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.084 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:09.084 6 00:04:09.084 15:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.084 15:28:00 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:09.084 15:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.084 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:09.084 7 00:04:09.084 15:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.084 15:28:00 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:09.084 15:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.084 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:09.084 8 00:04:09.084 15:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.084 15:28:00 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:09.084 15:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.084 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:09.084 9 00:04:09.084 15:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.084 15:28:00 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:09.084 15:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.084 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:09.084 10 00:04:09.084 15:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.084 15:28:00 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:09.084 15:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.084 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:09.084 15:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.084 15:28:00 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:09.084 15:28:00 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:09.084 15:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.084 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:09.084 15:28:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.084 15:28:00 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:09.084 15:28:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.084 15:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:10.467 15:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.467 15:28:01 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:10.467 15:28:01 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:10.467 15:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.467 15:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:11.845 15:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.845 00:04:11.845 real 0m2.616s 00:04:11.845 user 0m0.012s 00:04:11.845 sys 0m0.002s 00:04:11.845 15:28:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:11.845 15:28:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.845 ************************************ 00:04:11.845 END TEST scheduler_create_thread 00:04:11.845 ************************************ 00:04:11.845 15:28:02 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:11.845 15:28:02 -- scheduler/scheduler.sh@46 -- # killprocess 750616 00:04:11.845 15:28:02 -- common/autotest_common.sh@936 -- # '[' -z 750616 ']' 00:04:11.845 15:28:02 -- common/autotest_common.sh@940 -- # kill -0 750616 00:04:11.845 15:28:02 -- common/autotest_common.sh@941 -- # uname 00:04:11.845 15:28:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:11.845 15:28:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 750616 00:04:11.845 15:28:02 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:11.845 15:28:02 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:11.845 15:28:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 750616' 00:04:11.845 killing process with pid 750616 00:04:11.845 15:28:02 -- common/autotest_common.sh@955 -- # kill 750616 00:04:11.845 15:28:02 -- common/autotest_common.sh@960 -- # wait 750616 00:04:12.104 [2024-11-26 15:28:03.370067] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:12.104 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:12.105 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:12.105 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:12.105 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:12.105 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:12.105 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:12.105 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:12.105 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:12.363 00:04:12.363 real 0m3.903s 00:04:12.363 user 0m5.852s 00:04:12.363 sys 0m0.330s 00:04:12.363 15:28:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:12.363 15:28:03 -- common/autotest_common.sh@10 -- # set +x 00:04:12.363 ************************************ 00:04:12.363 END TEST event_scheduler 00:04:12.363 ************************************ 00:04:12.363 15:28:03 -- event/event.sh@51 -- # modprobe -n nbd 00:04:12.363 15:28:03 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:12.363 15:28:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:12.363 15:28:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:12.363 15:28:03 -- common/autotest_common.sh@10 -- # set +x 00:04:12.363 ************************************ 00:04:12.363 START TEST app_repeat 00:04:12.363 ************************************ 00:04:12.363 15:28:03 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:12.363 15:28:03 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:12.363 15:28:03 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:12.363 15:28:03 -- event/event.sh@13 -- # local nbd_list 00:04:12.363 15:28:03 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:12.363 15:28:03 -- event/event.sh@14 -- # local bdev_list 00:04:12.363 15:28:03 -- event/event.sh@15 -- # local repeat_times=4 00:04:12.363 15:28:03 -- event/event.sh@17 -- # modprobe nbd 00:04:12.363 15:28:03 -- event/event.sh@19 -- # repeat_pid=751079 00:04:12.363 15:28:03 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:12.364 15:28:03 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:12.364 15:28:03 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 751079' 00:04:12.364 Process app_repeat pid: 751079 00:04:12.364 15:28:03 -- event/event.sh@23 -- # for i in {0..2} 00:04:12.364 15:28:03 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:12.364 spdk_app_start Round 0 00:04:12.364 15:28:03 -- event/event.sh@25 -- # waitforlisten 751079 /var/tmp/spdk-nbd.sock 00:04:12.364 15:28:03 -- common/autotest_common.sh@829 -- # '[' -z 751079 ']' 00:04:12.364 15:28:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:12.364 15:28:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:12.364 15:28:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:12.364 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:12.364 15:28:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:12.364 15:28:03 -- common/autotest_common.sh@10 -- # set +x 00:04:12.364 [2024-11-26 15:28:03.699351] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:12.364 [2024-11-26 15:28:03.699435] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid751079 ] 00:04:12.364 EAL: No free 2048 kB hugepages reported on node 1 00:04:12.364 [2024-11-26 15:28:03.761806] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:12.622 [2024-11-26 15:28:03.875000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:12.622 [2024-11-26 15:28:03.875007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:13.559 15:28:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:13.559 15:28:04 -- common/autotest_common.sh@862 -- # return 0 00:04:13.559 15:28:04 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:13.559 Malloc0 00:04:13.559 15:28:04 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:13.817 Malloc1 00:04:13.817 15:28:05 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@12 -- # local i 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:13.817 15:28:05 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:14.076 /dev/nbd0 00:04:14.076 15:28:05 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:14.076 15:28:05 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:14.076 15:28:05 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:14.076 15:28:05 -- common/autotest_common.sh@867 -- # local i 00:04:14.076 15:28:05 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:14.076 15:28:05 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:14.076 15:28:05 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:14.076 15:28:05 -- common/autotest_common.sh@871 -- # break 00:04:14.076 15:28:05 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:14.076 15:28:05 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:14.076 15:28:05 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:14.076 1+0 records in 00:04:14.076 1+0 records out 00:04:14.076 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000138836 s, 29.5 MB/s 00:04:14.076 15:28:05 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:14.076 15:28:05 -- common/autotest_common.sh@884 -- # size=4096 00:04:14.076 15:28:05 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:14.076 15:28:05 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:14.076 15:28:05 -- common/autotest_common.sh@887 -- # return 0 00:04:14.076 15:28:05 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:14.076 15:28:05 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:14.076 15:28:05 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:14.334 /dev/nbd1 00:04:14.334 15:28:05 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:14.334 15:28:05 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:14.334 15:28:05 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:14.334 15:28:05 -- common/autotest_common.sh@867 -- # local i 00:04:14.334 15:28:05 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:14.334 15:28:05 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:14.334 15:28:05 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:14.334 15:28:05 -- common/autotest_common.sh@871 -- # break 00:04:14.334 15:28:05 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:14.334 15:28:05 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:14.334 15:28:05 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:14.594 1+0 records in 00:04:14.595 1+0 records out 00:04:14.595 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000201506 s, 20.3 MB/s 00:04:14.595 15:28:05 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:14.595 15:28:05 -- common/autotest_common.sh@884 -- # size=4096 00:04:14.595 15:28:05 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:14.595 15:28:05 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:14.595 15:28:05 -- common/autotest_common.sh@887 -- # return 0 00:04:14.595 15:28:05 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:14.595 15:28:05 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:14.595 15:28:05 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:14.595 15:28:05 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:14.595 15:28:05 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:14.853 15:28:06 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:14.853 { 00:04:14.853 "nbd_device": "/dev/nbd0", 00:04:14.853 "bdev_name": "Malloc0" 00:04:14.853 }, 00:04:14.853 { 00:04:14.853 "nbd_device": "/dev/nbd1", 00:04:14.853 "bdev_name": "Malloc1" 00:04:14.853 } 00:04:14.853 ]' 00:04:14.853 15:28:06 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:14.853 { 00:04:14.853 "nbd_device": "/dev/nbd0", 00:04:14.853 "bdev_name": "Malloc0" 00:04:14.853 }, 00:04:14.853 { 00:04:14.853 "nbd_device": "/dev/nbd1", 00:04:14.853 "bdev_name": "Malloc1" 00:04:14.853 } 00:04:14.853 ]' 00:04:14.853 15:28:06 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:14.853 15:28:06 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:14.853 /dev/nbd1' 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:14.854 /dev/nbd1' 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@65 -- # count=2 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@95 -- # count=2 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:14.854 256+0 records in 00:04:14.854 256+0 records out 00:04:14.854 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00508239 s, 206 MB/s 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:14.854 256+0 records in 00:04:14.854 256+0 records out 00:04:14.854 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229287 s, 45.7 MB/s 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:14.854 256+0 records in 00:04:14.854 256+0 records out 00:04:14.854 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239184 s, 43.8 MB/s 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@51 -- # local i 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:14.854 15:28:06 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:15.112 15:28:06 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:15.112 15:28:06 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:15.112 15:28:06 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:15.112 15:28:06 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:15.112 15:28:06 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:15.112 15:28:06 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:15.112 15:28:06 -- bdev/nbd_common.sh@41 -- # break 00:04:15.112 15:28:06 -- bdev/nbd_common.sh@45 -- # return 0 00:04:15.112 15:28:06 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:15.112 15:28:06 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:15.370 15:28:06 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:15.370 15:28:06 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:15.370 15:28:06 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:15.370 15:28:06 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:15.370 15:28:06 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:15.370 15:28:06 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:15.370 15:28:06 -- bdev/nbd_common.sh@41 -- # break 00:04:15.370 15:28:06 -- bdev/nbd_common.sh@45 -- # return 0 00:04:15.370 15:28:06 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:15.370 15:28:06 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:15.370 15:28:06 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:15.628 15:28:06 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:15.628 15:28:06 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:15.628 15:28:06 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:15.628 15:28:07 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:15.628 15:28:07 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:15.628 15:28:07 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:15.628 15:28:07 -- bdev/nbd_common.sh@65 -- # true 00:04:15.628 15:28:07 -- bdev/nbd_common.sh@65 -- # count=0 00:04:15.628 15:28:07 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:15.628 15:28:07 -- bdev/nbd_common.sh@104 -- # count=0 00:04:15.628 15:28:07 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:15.628 15:28:07 -- bdev/nbd_common.sh@109 -- # return 0 00:04:15.628 15:28:07 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:15.887 15:28:07 -- event/event.sh@35 -- # sleep 3 00:04:16.146 [2024-11-26 15:28:07.570965] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:16.404 [2024-11-26 15:28:07.683170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:16.404 [2024-11-26 15:28:07.683169] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:16.404 [2024-11-26 15:28:07.744285] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:16.404 [2024-11-26 15:28:07.744377] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:18.942 15:28:10 -- event/event.sh@23 -- # for i in {0..2} 00:04:18.942 15:28:10 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:18.942 spdk_app_start Round 1 00:04:18.942 15:28:10 -- event/event.sh@25 -- # waitforlisten 751079 /var/tmp/spdk-nbd.sock 00:04:18.942 15:28:10 -- common/autotest_common.sh@829 -- # '[' -z 751079 ']' 00:04:18.942 15:28:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:18.942 15:28:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:18.942 15:28:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:18.942 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:18.942 15:28:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:18.942 15:28:10 -- common/autotest_common.sh@10 -- # set +x 00:04:19.201 15:28:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:19.201 15:28:10 -- common/autotest_common.sh@862 -- # return 0 00:04:19.201 15:28:10 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:19.459 Malloc0 00:04:19.459 15:28:10 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:19.723 Malloc1 00:04:19.723 15:28:11 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:19.723 15:28:11 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:19.724 15:28:11 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:19.724 15:28:11 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:19.724 15:28:11 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:19.724 15:28:11 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:19.724 15:28:11 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:19.724 15:28:11 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:19.724 15:28:11 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:19.724 15:28:11 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:19.724 15:28:11 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:19.724 15:28:11 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:19.724 15:28:11 -- bdev/nbd_common.sh@12 -- # local i 00:04:19.724 15:28:11 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:19.724 15:28:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:19.724 15:28:11 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:19.982 /dev/nbd0 00:04:19.982 15:28:11 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:19.982 15:28:11 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:19.982 15:28:11 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:19.982 15:28:11 -- common/autotest_common.sh@867 -- # local i 00:04:19.982 15:28:11 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:19.982 15:28:11 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:19.982 15:28:11 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:19.982 15:28:11 -- common/autotest_common.sh@871 -- # break 00:04:19.982 15:28:11 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:19.982 15:28:11 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:19.982 15:28:11 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:19.982 1+0 records in 00:04:19.982 1+0 records out 00:04:19.982 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000172224 s, 23.8 MB/s 00:04:19.982 15:28:11 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:19.982 15:28:11 -- common/autotest_common.sh@884 -- # size=4096 00:04:19.982 15:28:11 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:19.982 15:28:11 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:19.982 15:28:11 -- common/autotest_common.sh@887 -- # return 0 00:04:19.982 15:28:11 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:19.982 15:28:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:19.982 15:28:11 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:20.240 /dev/nbd1 00:04:20.240 15:28:11 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:20.240 15:28:11 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:20.240 15:28:11 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:20.240 15:28:11 -- common/autotest_common.sh@867 -- # local i 00:04:20.240 15:28:11 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:20.240 15:28:11 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:20.240 15:28:11 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:20.240 15:28:11 -- common/autotest_common.sh@871 -- # break 00:04:20.240 15:28:11 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:20.240 15:28:11 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:20.240 15:28:11 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:20.240 1+0 records in 00:04:20.240 1+0 records out 00:04:20.240 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000213114 s, 19.2 MB/s 00:04:20.240 15:28:11 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:20.240 15:28:11 -- common/autotest_common.sh@884 -- # size=4096 00:04:20.240 15:28:11 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:20.240 15:28:11 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:20.240 15:28:11 -- common/autotest_common.sh@887 -- # return 0 00:04:20.240 15:28:11 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:20.240 15:28:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:20.240 15:28:11 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:20.240 15:28:11 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:20.240 15:28:11 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:20.498 15:28:11 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:20.498 { 00:04:20.498 "nbd_device": "/dev/nbd0", 00:04:20.498 "bdev_name": "Malloc0" 00:04:20.498 }, 00:04:20.498 { 00:04:20.498 "nbd_device": "/dev/nbd1", 00:04:20.498 "bdev_name": "Malloc1" 00:04:20.498 } 00:04:20.498 ]' 00:04:20.498 15:28:11 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:20.498 { 00:04:20.498 "nbd_device": "/dev/nbd0", 00:04:20.499 "bdev_name": "Malloc0" 00:04:20.499 }, 00:04:20.499 { 00:04:20.499 "nbd_device": "/dev/nbd1", 00:04:20.499 "bdev_name": "Malloc1" 00:04:20.499 } 00:04:20.499 ]' 00:04:20.499 15:28:11 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:20.757 /dev/nbd1' 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:20.757 /dev/nbd1' 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@65 -- # count=2 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@95 -- # count=2 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:20.757 256+0 records in 00:04:20.757 256+0 records out 00:04:20.757 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00501769 s, 209 MB/s 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:20.757 256+0 records in 00:04:20.757 256+0 records out 00:04:20.757 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203455 s, 51.5 MB/s 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:20.757 15:28:11 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:20.757 256+0 records in 00:04:20.757 256+0 records out 00:04:20.757 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229029 s, 45.8 MB/s 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@51 -- # local i 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:20.757 15:28:12 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:21.015 15:28:12 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:21.015 15:28:12 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:21.015 15:28:12 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:21.015 15:28:12 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:21.016 15:28:12 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:21.016 15:28:12 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:21.016 15:28:12 -- bdev/nbd_common.sh@41 -- # break 00:04:21.016 15:28:12 -- bdev/nbd_common.sh@45 -- # return 0 00:04:21.016 15:28:12 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:21.016 15:28:12 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:21.274 15:28:12 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:21.274 15:28:12 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:21.274 15:28:12 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:21.274 15:28:12 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:21.274 15:28:12 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:21.274 15:28:12 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:21.274 15:28:12 -- bdev/nbd_common.sh@41 -- # break 00:04:21.274 15:28:12 -- bdev/nbd_common.sh@45 -- # return 0 00:04:21.274 15:28:12 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:21.274 15:28:12 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:21.274 15:28:12 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:21.532 15:28:12 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:21.532 15:28:12 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:21.532 15:28:12 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:21.533 15:28:12 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:21.533 15:28:12 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:21.533 15:28:12 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:21.533 15:28:12 -- bdev/nbd_common.sh@65 -- # true 00:04:21.533 15:28:12 -- bdev/nbd_common.sh@65 -- # count=0 00:04:21.533 15:28:12 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:21.533 15:28:12 -- bdev/nbd_common.sh@104 -- # count=0 00:04:21.533 15:28:12 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:21.533 15:28:12 -- bdev/nbd_common.sh@109 -- # return 0 00:04:21.533 15:28:12 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:21.818 15:28:13 -- event/event.sh@35 -- # sleep 3 00:04:22.105 [2024-11-26 15:28:13.423663] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:22.364 [2024-11-26 15:28:13.536261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:22.364 [2024-11-26 15:28:13.536266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:22.364 [2024-11-26 15:28:13.596365] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:22.364 [2024-11-26 15:28:13.596457] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:24.905 15:28:16 -- event/event.sh@23 -- # for i in {0..2} 00:04:24.905 15:28:16 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:24.905 spdk_app_start Round 2 00:04:24.905 15:28:16 -- event/event.sh@25 -- # waitforlisten 751079 /var/tmp/spdk-nbd.sock 00:04:24.905 15:28:16 -- common/autotest_common.sh@829 -- # '[' -z 751079 ']' 00:04:24.905 15:28:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:24.905 15:28:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:24.905 15:28:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:24.905 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:24.905 15:28:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:24.905 15:28:16 -- common/autotest_common.sh@10 -- # set +x 00:04:25.164 15:28:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:25.164 15:28:16 -- common/autotest_common.sh@862 -- # return 0 00:04:25.164 15:28:16 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:25.422 Malloc0 00:04:25.422 15:28:16 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:25.680 Malloc1 00:04:25.680 15:28:16 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@12 -- # local i 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:25.680 15:28:16 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:25.938 /dev/nbd0 00:04:25.938 15:28:17 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:25.938 15:28:17 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:25.938 15:28:17 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:25.938 15:28:17 -- common/autotest_common.sh@867 -- # local i 00:04:25.938 15:28:17 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:25.938 15:28:17 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:25.938 15:28:17 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:25.938 15:28:17 -- common/autotest_common.sh@871 -- # break 00:04:25.938 15:28:17 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:25.938 15:28:17 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:25.938 15:28:17 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:25.938 1+0 records in 00:04:25.938 1+0 records out 00:04:25.938 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000251994 s, 16.3 MB/s 00:04:25.938 15:28:17 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:25.938 15:28:17 -- common/autotest_common.sh@884 -- # size=4096 00:04:25.938 15:28:17 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:25.938 15:28:17 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:25.938 15:28:17 -- common/autotest_common.sh@887 -- # return 0 00:04:25.938 15:28:17 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:25.938 15:28:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:25.938 15:28:17 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:26.197 /dev/nbd1 00:04:26.197 15:28:17 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:26.197 15:28:17 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:26.197 15:28:17 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:26.197 15:28:17 -- common/autotest_common.sh@867 -- # local i 00:04:26.197 15:28:17 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:26.197 15:28:17 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:26.197 15:28:17 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:26.197 15:28:17 -- common/autotest_common.sh@871 -- # break 00:04:26.197 15:28:17 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:26.197 15:28:17 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:26.197 15:28:17 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:26.197 1+0 records in 00:04:26.197 1+0 records out 00:04:26.197 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000230717 s, 17.8 MB/s 00:04:26.197 15:28:17 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:26.197 15:28:17 -- common/autotest_common.sh@884 -- # size=4096 00:04:26.197 15:28:17 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:26.197 15:28:17 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:26.197 15:28:17 -- common/autotest_common.sh@887 -- # return 0 00:04:26.197 15:28:17 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:26.197 15:28:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:26.197 15:28:17 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:26.197 15:28:17 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:26.197 15:28:17 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:26.456 { 00:04:26.456 "nbd_device": "/dev/nbd0", 00:04:26.456 "bdev_name": "Malloc0" 00:04:26.456 }, 00:04:26.456 { 00:04:26.456 "nbd_device": "/dev/nbd1", 00:04:26.456 "bdev_name": "Malloc1" 00:04:26.456 } 00:04:26.456 ]' 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:26.456 { 00:04:26.456 "nbd_device": "/dev/nbd0", 00:04:26.456 "bdev_name": "Malloc0" 00:04:26.456 }, 00:04:26.456 { 00:04:26.456 "nbd_device": "/dev/nbd1", 00:04:26.456 "bdev_name": "Malloc1" 00:04:26.456 } 00:04:26.456 ]' 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:26.456 /dev/nbd1' 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:26.456 /dev/nbd1' 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@65 -- # count=2 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@95 -- # count=2 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:26.456 256+0 records in 00:04:26.456 256+0 records out 00:04:26.456 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00540957 s, 194 MB/s 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:26.456 256+0 records in 00:04:26.456 256+0 records out 00:04:26.456 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02307 s, 45.5 MB/s 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:26.456 256+0 records in 00:04:26.456 256+0 records out 00:04:26.456 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240921 s, 43.5 MB/s 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:26.456 15:28:17 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:26.715 15:28:17 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:26.715 15:28:17 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:26.715 15:28:17 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:26.715 15:28:17 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:26.715 15:28:17 -- bdev/nbd_common.sh@51 -- # local i 00:04:26.715 15:28:17 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:26.715 15:28:17 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:26.975 15:28:18 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:26.975 15:28:18 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:26.975 15:28:18 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:26.975 15:28:18 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:26.975 15:28:18 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:26.975 15:28:18 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:26.975 15:28:18 -- bdev/nbd_common.sh@41 -- # break 00:04:26.975 15:28:18 -- bdev/nbd_common.sh@45 -- # return 0 00:04:26.975 15:28:18 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:26.975 15:28:18 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:27.234 15:28:18 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:27.234 15:28:18 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:27.234 15:28:18 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:27.234 15:28:18 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:27.234 15:28:18 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:27.234 15:28:18 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:27.234 15:28:18 -- bdev/nbd_common.sh@41 -- # break 00:04:27.234 15:28:18 -- bdev/nbd_common.sh@45 -- # return 0 00:04:27.234 15:28:18 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:27.234 15:28:18 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:27.234 15:28:18 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:27.492 15:28:18 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:27.492 15:28:18 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:27.492 15:28:18 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:27.492 15:28:18 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:27.492 15:28:18 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:27.492 15:28:18 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:27.492 15:28:18 -- bdev/nbd_common.sh@65 -- # true 00:04:27.492 15:28:18 -- bdev/nbd_common.sh@65 -- # count=0 00:04:27.492 15:28:18 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:27.492 15:28:18 -- bdev/nbd_common.sh@104 -- # count=0 00:04:27.492 15:28:18 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:27.492 15:28:18 -- bdev/nbd_common.sh@109 -- # return 0 00:04:27.492 15:28:18 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:27.752 15:28:19 -- event/event.sh@35 -- # sleep 3 00:04:28.011 [2024-11-26 15:28:19.312976] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:28.011 [2024-11-26 15:28:19.424630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:28.011 [2024-11-26 15:28:19.424634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:28.270 [2024-11-26 15:28:19.486169] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:28.270 [2024-11-26 15:28:19.486263] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:30.806 15:28:22 -- event/event.sh@38 -- # waitforlisten 751079 /var/tmp/spdk-nbd.sock 00:04:30.806 15:28:22 -- common/autotest_common.sh@829 -- # '[' -z 751079 ']' 00:04:30.806 15:28:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:30.806 15:28:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:30.806 15:28:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:30.806 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:30.806 15:28:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:30.806 15:28:22 -- common/autotest_common.sh@10 -- # set +x 00:04:31.065 15:28:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:31.065 15:28:22 -- common/autotest_common.sh@862 -- # return 0 00:04:31.065 15:28:22 -- event/event.sh@39 -- # killprocess 751079 00:04:31.065 15:28:22 -- common/autotest_common.sh@936 -- # '[' -z 751079 ']' 00:04:31.065 15:28:22 -- common/autotest_common.sh@940 -- # kill -0 751079 00:04:31.065 15:28:22 -- common/autotest_common.sh@941 -- # uname 00:04:31.065 15:28:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:31.065 15:28:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 751079 00:04:31.065 15:28:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:31.065 15:28:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:31.065 15:28:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 751079' 00:04:31.065 killing process with pid 751079 00:04:31.065 15:28:22 -- common/autotest_common.sh@955 -- # kill 751079 00:04:31.065 15:28:22 -- common/autotest_common.sh@960 -- # wait 751079 00:04:31.324 spdk_app_start is called in Round 0. 00:04:31.324 Shutdown signal received, stop current app iteration 00:04:31.324 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:31.324 spdk_app_start is called in Round 1. 00:04:31.324 Shutdown signal received, stop current app iteration 00:04:31.324 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:31.324 spdk_app_start is called in Round 2. 00:04:31.324 Shutdown signal received, stop current app iteration 00:04:31.324 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:31.324 spdk_app_start is called in Round 3. 00:04:31.324 Shutdown signal received, stop current app iteration 00:04:31.324 15:28:22 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:04:31.324 15:28:22 -- event/event.sh@42 -- # return 0 00:04:31.324 00:04:31.324 real 0m18.917s 00:04:31.324 user 0m41.287s 00:04:31.324 sys 0m3.125s 00:04:31.324 15:28:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:31.324 15:28:22 -- common/autotest_common.sh@10 -- # set +x 00:04:31.324 ************************************ 00:04:31.324 END TEST app_repeat 00:04:31.324 ************************************ 00:04:31.324 15:28:22 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:04:31.324 15:28:22 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:31.324 15:28:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:31.324 15:28:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:31.324 15:28:22 -- common/autotest_common.sh@10 -- # set +x 00:04:31.324 ************************************ 00:04:31.324 START TEST cpu_locks 00:04:31.324 ************************************ 00:04:31.324 15:28:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:31.324 * Looking for test storage... 00:04:31.324 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:31.324 15:28:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:31.324 15:28:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:31.324 15:28:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:31.324 15:28:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:31.324 15:28:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:31.324 15:28:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:31.324 15:28:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:31.324 15:28:22 -- scripts/common.sh@335 -- # IFS=.-: 00:04:31.324 15:28:22 -- scripts/common.sh@335 -- # read -ra ver1 00:04:31.324 15:28:22 -- scripts/common.sh@336 -- # IFS=.-: 00:04:31.324 15:28:22 -- scripts/common.sh@336 -- # read -ra ver2 00:04:31.324 15:28:22 -- scripts/common.sh@337 -- # local 'op=<' 00:04:31.324 15:28:22 -- scripts/common.sh@339 -- # ver1_l=2 00:04:31.324 15:28:22 -- scripts/common.sh@340 -- # ver2_l=1 00:04:31.324 15:28:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:31.324 15:28:22 -- scripts/common.sh@343 -- # case "$op" in 00:04:31.324 15:28:22 -- scripts/common.sh@344 -- # : 1 00:04:31.324 15:28:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:31.324 15:28:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:31.324 15:28:22 -- scripts/common.sh@364 -- # decimal 1 00:04:31.324 15:28:22 -- scripts/common.sh@352 -- # local d=1 00:04:31.324 15:28:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:31.324 15:28:22 -- scripts/common.sh@354 -- # echo 1 00:04:31.324 15:28:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:31.324 15:28:22 -- scripts/common.sh@365 -- # decimal 2 00:04:31.324 15:28:22 -- scripts/common.sh@352 -- # local d=2 00:04:31.324 15:28:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:31.324 15:28:22 -- scripts/common.sh@354 -- # echo 2 00:04:31.324 15:28:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:31.324 15:28:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:31.324 15:28:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:31.324 15:28:22 -- scripts/common.sh@367 -- # return 0 00:04:31.324 15:28:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:31.324 15:28:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:31.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.324 --rc genhtml_branch_coverage=1 00:04:31.324 --rc genhtml_function_coverage=1 00:04:31.324 --rc genhtml_legend=1 00:04:31.324 --rc geninfo_all_blocks=1 00:04:31.324 --rc geninfo_unexecuted_blocks=1 00:04:31.324 00:04:31.324 ' 00:04:31.324 15:28:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:31.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.324 --rc genhtml_branch_coverage=1 00:04:31.324 --rc genhtml_function_coverage=1 00:04:31.324 --rc genhtml_legend=1 00:04:31.324 --rc geninfo_all_blocks=1 00:04:31.324 --rc geninfo_unexecuted_blocks=1 00:04:31.324 00:04:31.324 ' 00:04:31.324 15:28:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:31.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.324 --rc genhtml_branch_coverage=1 00:04:31.324 --rc genhtml_function_coverage=1 00:04:31.324 --rc genhtml_legend=1 00:04:31.324 --rc geninfo_all_blocks=1 00:04:31.324 --rc geninfo_unexecuted_blocks=1 00:04:31.324 00:04:31.324 ' 00:04:31.324 15:28:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:31.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.324 --rc genhtml_branch_coverage=1 00:04:31.324 --rc genhtml_function_coverage=1 00:04:31.324 --rc genhtml_legend=1 00:04:31.324 --rc geninfo_all_blocks=1 00:04:31.324 --rc geninfo_unexecuted_blocks=1 00:04:31.324 00:04:31.324 ' 00:04:31.324 15:28:22 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:04:31.324 15:28:22 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:04:31.324 15:28:22 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:04:31.324 15:28:22 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:04:31.324 15:28:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:31.324 15:28:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:31.324 15:28:22 -- common/autotest_common.sh@10 -- # set +x 00:04:31.324 ************************************ 00:04:31.324 START TEST default_locks 00:04:31.324 ************************************ 00:04:31.324 15:28:22 -- common/autotest_common.sh@1114 -- # default_locks 00:04:31.324 15:28:22 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=753650 00:04:31.324 15:28:22 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:31.324 15:28:22 -- event/cpu_locks.sh@47 -- # waitforlisten 753650 00:04:31.324 15:28:22 -- common/autotest_common.sh@829 -- # '[' -z 753650 ']' 00:04:31.324 15:28:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:31.324 15:28:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:31.324 15:28:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:31.324 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:31.324 15:28:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:31.324 15:28:22 -- common/autotest_common.sh@10 -- # set +x 00:04:31.583 [2024-11-26 15:28:22.814496] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:31.583 [2024-11-26 15:28:22.814574] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid753650 ] 00:04:31.583 EAL: No free 2048 kB hugepages reported on node 1 00:04:31.583 [2024-11-26 15:28:22.874139] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:31.583 [2024-11-26 15:28:22.987789] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:31.583 [2024-11-26 15:28:22.987969] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:32.520 15:28:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:32.520 15:28:23 -- common/autotest_common.sh@862 -- # return 0 00:04:32.520 15:28:23 -- event/cpu_locks.sh@49 -- # locks_exist 753650 00:04:32.520 15:28:23 -- event/cpu_locks.sh@22 -- # lslocks -p 753650 00:04:32.520 15:28:23 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:32.780 lslocks: write error 00:04:32.780 15:28:24 -- event/cpu_locks.sh@50 -- # killprocess 753650 00:04:32.780 15:28:24 -- common/autotest_common.sh@936 -- # '[' -z 753650 ']' 00:04:32.780 15:28:24 -- common/autotest_common.sh@940 -- # kill -0 753650 00:04:32.780 15:28:24 -- common/autotest_common.sh@941 -- # uname 00:04:32.780 15:28:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:32.780 15:28:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 753650 00:04:32.780 15:28:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:32.780 15:28:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:32.780 15:28:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 753650' 00:04:32.780 killing process with pid 753650 00:04:32.780 15:28:24 -- common/autotest_common.sh@955 -- # kill 753650 00:04:32.780 15:28:24 -- common/autotest_common.sh@960 -- # wait 753650 00:04:33.347 15:28:24 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 753650 00:04:33.347 15:28:24 -- common/autotest_common.sh@650 -- # local es=0 00:04:33.347 15:28:24 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 753650 00:04:33.347 15:28:24 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:33.347 15:28:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:33.347 15:28:24 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:33.347 15:28:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:33.347 15:28:24 -- common/autotest_common.sh@653 -- # waitforlisten 753650 00:04:33.347 15:28:24 -- common/autotest_common.sh@829 -- # '[' -z 753650 ']' 00:04:33.347 15:28:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:33.347 15:28:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:33.347 15:28:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:33.347 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:33.347 15:28:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:33.347 15:28:24 -- common/autotest_common.sh@10 -- # set +x 00:04:33.347 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (753650) - No such process 00:04:33.347 ERROR: process (pid: 753650) is no longer running 00:04:33.347 15:28:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:33.347 15:28:24 -- common/autotest_common.sh@862 -- # return 1 00:04:33.347 15:28:24 -- common/autotest_common.sh@653 -- # es=1 00:04:33.347 15:28:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:33.347 15:28:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:33.347 15:28:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:33.347 15:28:24 -- event/cpu_locks.sh@54 -- # no_locks 00:04:33.347 15:28:24 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:33.347 15:28:24 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:33.347 15:28:24 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:33.347 00:04:33.347 real 0m1.803s 00:04:33.347 user 0m1.994s 00:04:33.347 sys 0m0.537s 00:04:33.347 15:28:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.347 15:28:24 -- common/autotest_common.sh@10 -- # set +x 00:04:33.347 ************************************ 00:04:33.347 END TEST default_locks 00:04:33.347 ************************************ 00:04:33.347 15:28:24 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:04:33.347 15:28:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.347 15:28:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.347 15:28:24 -- common/autotest_common.sh@10 -- # set +x 00:04:33.347 ************************************ 00:04:33.347 START TEST default_locks_via_rpc 00:04:33.347 ************************************ 00:04:33.347 15:28:24 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:04:33.347 15:28:24 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=753948 00:04:33.347 15:28:24 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:33.347 15:28:24 -- event/cpu_locks.sh@63 -- # waitforlisten 753948 00:04:33.347 15:28:24 -- common/autotest_common.sh@829 -- # '[' -z 753948 ']' 00:04:33.347 15:28:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:33.347 15:28:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:33.347 15:28:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:33.347 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:33.347 15:28:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:33.347 15:28:24 -- common/autotest_common.sh@10 -- # set +x 00:04:33.347 [2024-11-26 15:28:24.644173] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:33.347 [2024-11-26 15:28:24.644255] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid753948 ] 00:04:33.347 EAL: No free 2048 kB hugepages reported on node 1 00:04:33.347 [2024-11-26 15:28:24.704568] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:33.606 [2024-11-26 15:28:24.814400] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:33.606 [2024-11-26 15:28:24.814586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:34.176 15:28:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:34.176 15:28:25 -- common/autotest_common.sh@862 -- # return 0 00:04:34.176 15:28:25 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:04:34.176 15:28:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.176 15:28:25 -- common/autotest_common.sh@10 -- # set +x 00:04:34.176 15:28:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:34.176 15:28:25 -- event/cpu_locks.sh@67 -- # no_locks 00:04:34.176 15:28:25 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:34.176 15:28:25 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:34.176 15:28:25 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:34.176 15:28:25 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:04:34.176 15:28:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.176 15:28:25 -- common/autotest_common.sh@10 -- # set +x 00:04:34.176 15:28:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:34.176 15:28:25 -- event/cpu_locks.sh@71 -- # locks_exist 753948 00:04:34.176 15:28:25 -- event/cpu_locks.sh@22 -- # lslocks -p 753948 00:04:34.176 15:28:25 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:34.437 15:28:25 -- event/cpu_locks.sh@73 -- # killprocess 753948 00:04:34.437 15:28:25 -- common/autotest_common.sh@936 -- # '[' -z 753948 ']' 00:04:34.437 15:28:25 -- common/autotest_common.sh@940 -- # kill -0 753948 00:04:34.437 15:28:25 -- common/autotest_common.sh@941 -- # uname 00:04:34.437 15:28:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:34.437 15:28:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 753948 00:04:34.697 15:28:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:34.697 15:28:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:34.697 15:28:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 753948' 00:04:34.697 killing process with pid 753948 00:04:34.697 15:28:25 -- common/autotest_common.sh@955 -- # kill 753948 00:04:34.697 15:28:25 -- common/autotest_common.sh@960 -- # wait 753948 00:04:34.956 00:04:34.956 real 0m1.763s 00:04:34.956 user 0m1.924s 00:04:34.956 sys 0m0.552s 00:04:34.956 15:28:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:34.956 15:28:26 -- common/autotest_common.sh@10 -- # set +x 00:04:34.956 ************************************ 00:04:34.956 END TEST default_locks_via_rpc 00:04:34.956 ************************************ 00:04:34.956 15:28:26 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:04:34.956 15:28:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.956 15:28:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.956 15:28:26 -- common/autotest_common.sh@10 -- # set +x 00:04:34.956 ************************************ 00:04:34.956 START TEST non_locking_app_on_locked_coremask 00:04:34.956 ************************************ 00:04:34.956 15:28:26 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:04:34.956 15:28:26 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=754125 00:04:34.956 15:28:26 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:34.956 15:28:26 -- event/cpu_locks.sh@81 -- # waitforlisten 754125 /var/tmp/spdk.sock 00:04:34.956 15:28:26 -- common/autotest_common.sh@829 -- # '[' -z 754125 ']' 00:04:34.956 15:28:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:34.956 15:28:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:34.956 15:28:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:34.956 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:34.956 15:28:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:34.956 15:28:26 -- common/autotest_common.sh@10 -- # set +x 00:04:35.215 [2024-11-26 15:28:26.440970] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:35.215 [2024-11-26 15:28:26.441058] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid754125 ] 00:04:35.215 EAL: No free 2048 kB hugepages reported on node 1 00:04:35.215 [2024-11-26 15:28:26.502018] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:35.215 [2024-11-26 15:28:26.619951] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:35.215 [2024-11-26 15:28:26.620141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:36.149 15:28:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:36.149 15:28:27 -- common/autotest_common.sh@862 -- # return 0 00:04:36.149 15:28:27 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=754265 00:04:36.149 15:28:27 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:04:36.149 15:28:27 -- event/cpu_locks.sh@85 -- # waitforlisten 754265 /var/tmp/spdk2.sock 00:04:36.149 15:28:27 -- common/autotest_common.sh@829 -- # '[' -z 754265 ']' 00:04:36.149 15:28:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:36.149 15:28:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:36.149 15:28:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:36.149 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:36.149 15:28:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:36.149 15:28:27 -- common/autotest_common.sh@10 -- # set +x 00:04:36.149 [2024-11-26 15:28:27.447660] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:36.149 [2024-11-26 15:28:27.447756] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid754265 ] 00:04:36.149 EAL: No free 2048 kB hugepages reported on node 1 00:04:36.149 [2024-11-26 15:28:27.541592] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:36.149 [2024-11-26 15:28:27.541638] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:36.407 [2024-11-26 15:28:27.773025] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:36.407 [2024-11-26 15:28:27.773223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:36.977 15:28:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:36.977 15:28:28 -- common/autotest_common.sh@862 -- # return 0 00:04:36.977 15:28:28 -- event/cpu_locks.sh@87 -- # locks_exist 754125 00:04:36.977 15:28:28 -- event/cpu_locks.sh@22 -- # lslocks -p 754125 00:04:36.977 15:28:28 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:37.544 lslocks: write error 00:04:37.544 15:28:28 -- event/cpu_locks.sh@89 -- # killprocess 754125 00:04:37.544 15:28:28 -- common/autotest_common.sh@936 -- # '[' -z 754125 ']' 00:04:37.544 15:28:28 -- common/autotest_common.sh@940 -- # kill -0 754125 00:04:37.544 15:28:28 -- common/autotest_common.sh@941 -- # uname 00:04:37.544 15:28:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:37.544 15:28:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 754125 00:04:37.544 15:28:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:37.544 15:28:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:37.544 15:28:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 754125' 00:04:37.544 killing process with pid 754125 00:04:37.544 15:28:28 -- common/autotest_common.sh@955 -- # kill 754125 00:04:37.544 15:28:28 -- common/autotest_common.sh@960 -- # wait 754125 00:04:38.483 15:28:29 -- event/cpu_locks.sh@90 -- # killprocess 754265 00:04:38.483 15:28:29 -- common/autotest_common.sh@936 -- # '[' -z 754265 ']' 00:04:38.483 15:28:29 -- common/autotest_common.sh@940 -- # kill -0 754265 00:04:38.483 15:28:29 -- common/autotest_common.sh@941 -- # uname 00:04:38.483 15:28:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:38.483 15:28:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 754265 00:04:38.483 15:28:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:38.483 15:28:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:38.483 15:28:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 754265' 00:04:38.483 killing process with pid 754265 00:04:38.483 15:28:29 -- common/autotest_common.sh@955 -- # kill 754265 00:04:38.483 15:28:29 -- common/autotest_common.sh@960 -- # wait 754265 00:04:39.053 00:04:39.053 real 0m3.870s 00:04:39.053 user 0m4.250s 00:04:39.053 sys 0m1.058s 00:04:39.053 15:28:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:39.053 15:28:30 -- common/autotest_common.sh@10 -- # set +x 00:04:39.053 ************************************ 00:04:39.053 END TEST non_locking_app_on_locked_coremask 00:04:39.053 ************************************ 00:04:39.053 15:28:30 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:04:39.053 15:28:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:39.053 15:28:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:39.053 15:28:30 -- common/autotest_common.sh@10 -- # set +x 00:04:39.053 ************************************ 00:04:39.053 START TEST locking_app_on_unlocked_coremask 00:04:39.053 ************************************ 00:04:39.054 15:28:30 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:04:39.054 15:28:30 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=754701 00:04:39.054 15:28:30 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:04:39.054 15:28:30 -- event/cpu_locks.sh@99 -- # waitforlisten 754701 /var/tmp/spdk.sock 00:04:39.054 15:28:30 -- common/autotest_common.sh@829 -- # '[' -z 754701 ']' 00:04:39.054 15:28:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:39.054 15:28:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:39.054 15:28:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:39.054 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:39.054 15:28:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:39.054 15:28:30 -- common/autotest_common.sh@10 -- # set +x 00:04:39.054 [2024-11-26 15:28:30.343257] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:39.054 [2024-11-26 15:28:30.343365] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid754701 ] 00:04:39.054 EAL: No free 2048 kB hugepages reported on node 1 00:04:39.054 [2024-11-26 15:28:30.403618] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:39.054 [2024-11-26 15:28:30.403661] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:39.314 [2024-11-26 15:28:30.513900] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:39.314 [2024-11-26 15:28:30.514064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:39.883 15:28:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:39.883 15:28:31 -- common/autotest_common.sh@862 -- # return 0 00:04:39.883 15:28:31 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=754841 00:04:39.883 15:28:31 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:04:39.883 15:28:31 -- event/cpu_locks.sh@103 -- # waitforlisten 754841 /var/tmp/spdk2.sock 00:04:39.883 15:28:31 -- common/autotest_common.sh@829 -- # '[' -z 754841 ']' 00:04:39.883 15:28:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:39.883 15:28:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:39.883 15:28:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:39.883 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:39.883 15:28:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:39.883 15:28:31 -- common/autotest_common.sh@10 -- # set +x 00:04:40.143 [2024-11-26 15:28:31.362724] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:40.143 [2024-11-26 15:28:31.362801] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid754841 ] 00:04:40.143 EAL: No free 2048 kB hugepages reported on node 1 00:04:40.143 [2024-11-26 15:28:31.450916] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:40.403 [2024-11-26 15:28:31.681959] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:40.403 [2024-11-26 15:28:31.682155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:40.970 15:28:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:40.970 15:28:32 -- common/autotest_common.sh@862 -- # return 0 00:04:40.970 15:28:32 -- event/cpu_locks.sh@105 -- # locks_exist 754841 00:04:40.970 15:28:32 -- event/cpu_locks.sh@22 -- # lslocks -p 754841 00:04:40.970 15:28:32 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:41.539 lslocks: write error 00:04:41.539 15:28:32 -- event/cpu_locks.sh@107 -- # killprocess 754701 00:04:41.539 15:28:32 -- common/autotest_common.sh@936 -- # '[' -z 754701 ']' 00:04:41.539 15:28:32 -- common/autotest_common.sh@940 -- # kill -0 754701 00:04:41.539 15:28:32 -- common/autotest_common.sh@941 -- # uname 00:04:41.539 15:28:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:41.539 15:28:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 754701 00:04:41.539 15:28:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:41.539 15:28:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:41.539 15:28:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 754701' 00:04:41.539 killing process with pid 754701 00:04:41.539 15:28:32 -- common/autotest_common.sh@955 -- # kill 754701 00:04:41.539 15:28:32 -- common/autotest_common.sh@960 -- # wait 754701 00:04:42.479 15:28:33 -- event/cpu_locks.sh@108 -- # killprocess 754841 00:04:42.479 15:28:33 -- common/autotest_common.sh@936 -- # '[' -z 754841 ']' 00:04:42.479 15:28:33 -- common/autotest_common.sh@940 -- # kill -0 754841 00:04:42.479 15:28:33 -- common/autotest_common.sh@941 -- # uname 00:04:42.479 15:28:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:42.479 15:28:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 754841 00:04:42.479 15:28:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:42.479 15:28:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:42.479 15:28:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 754841' 00:04:42.479 killing process with pid 754841 00:04:42.479 15:28:33 -- common/autotest_common.sh@955 -- # kill 754841 00:04:42.479 15:28:33 -- common/autotest_common.sh@960 -- # wait 754841 00:04:43.047 00:04:43.047 real 0m3.937s 00:04:43.047 user 0m4.328s 00:04:43.047 sys 0m1.097s 00:04:43.047 15:28:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.047 15:28:34 -- common/autotest_common.sh@10 -- # set +x 00:04:43.047 ************************************ 00:04:43.047 END TEST locking_app_on_unlocked_coremask 00:04:43.047 ************************************ 00:04:43.047 15:28:34 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:04:43.047 15:28:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:43.047 15:28:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.047 15:28:34 -- common/autotest_common.sh@10 -- # set +x 00:04:43.047 ************************************ 00:04:43.047 START TEST locking_app_on_locked_coremask 00:04:43.047 ************************************ 00:04:43.047 15:28:34 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:04:43.047 15:28:34 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=755158 00:04:43.047 15:28:34 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:43.047 15:28:34 -- event/cpu_locks.sh@116 -- # waitforlisten 755158 /var/tmp/spdk.sock 00:04:43.047 15:28:34 -- common/autotest_common.sh@829 -- # '[' -z 755158 ']' 00:04:43.047 15:28:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:43.047 15:28:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:43.047 15:28:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:43.047 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:43.047 15:28:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:43.047 15:28:34 -- common/autotest_common.sh@10 -- # set +x 00:04:43.047 [2024-11-26 15:28:34.304674] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:43.047 [2024-11-26 15:28:34.304775] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid755158 ] 00:04:43.047 EAL: No free 2048 kB hugepages reported on node 1 00:04:43.047 [2024-11-26 15:28:34.365812] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:43.047 [2024-11-26 15:28:34.482724] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:43.047 [2024-11-26 15:28:34.482877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:43.986 15:28:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:43.986 15:28:35 -- common/autotest_common.sh@862 -- # return 0 00:04:43.986 15:28:35 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=755299 00:04:43.986 15:28:35 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:04:43.986 15:28:35 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 755299 /var/tmp/spdk2.sock 00:04:43.986 15:28:35 -- common/autotest_common.sh@650 -- # local es=0 00:04:43.986 15:28:35 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 755299 /var/tmp/spdk2.sock 00:04:43.986 15:28:35 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:43.986 15:28:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:43.986 15:28:35 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:43.986 15:28:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:43.986 15:28:35 -- common/autotest_common.sh@653 -- # waitforlisten 755299 /var/tmp/spdk2.sock 00:04:43.986 15:28:35 -- common/autotest_common.sh@829 -- # '[' -z 755299 ']' 00:04:43.986 15:28:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:43.986 15:28:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:43.986 15:28:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:43.986 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:43.986 15:28:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:43.986 15:28:35 -- common/autotest_common.sh@10 -- # set +x 00:04:43.986 [2024-11-26 15:28:35.313864] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:43.986 [2024-11-26 15:28:35.313935] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid755299 ] 00:04:43.986 EAL: No free 2048 kB hugepages reported on node 1 00:04:43.986 [2024-11-26 15:28:35.395536] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 755158 has claimed it. 00:04:43.986 [2024-11-26 15:28:35.395610] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:04:44.924 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (755299) - No such process 00:04:44.924 ERROR: process (pid: 755299) is no longer running 00:04:44.924 15:28:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:44.924 15:28:36 -- common/autotest_common.sh@862 -- # return 1 00:04:44.924 15:28:36 -- common/autotest_common.sh@653 -- # es=1 00:04:44.924 15:28:36 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:44.924 15:28:36 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:44.924 15:28:36 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:44.924 15:28:36 -- event/cpu_locks.sh@122 -- # locks_exist 755158 00:04:44.924 15:28:36 -- event/cpu_locks.sh@22 -- # lslocks -p 755158 00:04:44.924 15:28:36 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:44.924 lslocks: write error 00:04:44.924 15:28:36 -- event/cpu_locks.sh@124 -- # killprocess 755158 00:04:44.924 15:28:36 -- common/autotest_common.sh@936 -- # '[' -z 755158 ']' 00:04:44.924 15:28:36 -- common/autotest_common.sh@940 -- # kill -0 755158 00:04:44.924 15:28:36 -- common/autotest_common.sh@941 -- # uname 00:04:44.924 15:28:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:44.924 15:28:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 755158 00:04:44.924 15:28:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:44.924 15:28:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:44.924 15:28:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 755158' 00:04:44.924 killing process with pid 755158 00:04:44.924 15:28:36 -- common/autotest_common.sh@955 -- # kill 755158 00:04:44.924 15:28:36 -- common/autotest_common.sh@960 -- # wait 755158 00:04:45.493 00:04:45.493 real 0m2.513s 00:04:45.493 user 0m2.900s 00:04:45.493 sys 0m0.631s 00:04:45.493 15:28:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.493 15:28:36 -- common/autotest_common.sh@10 -- # set +x 00:04:45.493 ************************************ 00:04:45.493 END TEST locking_app_on_locked_coremask 00:04:45.493 ************************************ 00:04:45.493 15:28:36 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:04:45.493 15:28:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:45.493 15:28:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.493 15:28:36 -- common/autotest_common.sh@10 -- # set +x 00:04:45.493 ************************************ 00:04:45.493 START TEST locking_overlapped_coremask 00:04:45.493 ************************************ 00:04:45.493 15:28:36 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:04:45.493 15:28:36 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=755587 00:04:45.493 15:28:36 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:04:45.493 15:28:36 -- event/cpu_locks.sh@133 -- # waitforlisten 755587 /var/tmp/spdk.sock 00:04:45.493 15:28:36 -- common/autotest_common.sh@829 -- # '[' -z 755587 ']' 00:04:45.493 15:28:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:45.493 15:28:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:45.493 15:28:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:45.493 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:45.493 15:28:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:45.493 15:28:36 -- common/autotest_common.sh@10 -- # set +x 00:04:45.493 [2024-11-26 15:28:36.846641] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:45.493 [2024-11-26 15:28:36.846766] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid755587 ] 00:04:45.493 EAL: No free 2048 kB hugepages reported on node 1 00:04:45.493 [2024-11-26 15:28:36.904701] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:45.754 [2024-11-26 15:28:37.014477] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:45.754 [2024-11-26 15:28:37.014703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:45.754 [2024-11-26 15:28:37.014764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:45.754 [2024-11-26 15:28:37.014767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.694 15:28:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:46.694 15:28:37 -- common/autotest_common.sh@862 -- # return 0 00:04:46.694 15:28:37 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=755703 00:04:46.694 15:28:37 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 755703 /var/tmp/spdk2.sock 00:04:46.694 15:28:37 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:04:46.694 15:28:37 -- common/autotest_common.sh@650 -- # local es=0 00:04:46.694 15:28:37 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 755703 /var/tmp/spdk2.sock 00:04:46.694 15:28:37 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:46.694 15:28:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:46.694 15:28:37 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:46.694 15:28:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:46.694 15:28:37 -- common/autotest_common.sh@653 -- # waitforlisten 755703 /var/tmp/spdk2.sock 00:04:46.694 15:28:37 -- common/autotest_common.sh@829 -- # '[' -z 755703 ']' 00:04:46.694 15:28:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:46.694 15:28:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:46.694 15:28:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:46.694 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:46.694 15:28:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:46.694 15:28:37 -- common/autotest_common.sh@10 -- # set +x 00:04:46.694 [2024-11-26 15:28:37.869912] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:46.694 [2024-11-26 15:28:37.870015] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid755703 ] 00:04:46.694 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.694 [2024-11-26 15:28:37.958774] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 755587 has claimed it. 00:04:46.694 [2024-11-26 15:28:37.958825] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:04:47.263 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (755703) - No such process 00:04:47.263 ERROR: process (pid: 755703) is no longer running 00:04:47.263 15:28:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:47.263 15:28:38 -- common/autotest_common.sh@862 -- # return 1 00:04:47.263 15:28:38 -- common/autotest_common.sh@653 -- # es=1 00:04:47.263 15:28:38 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:47.263 15:28:38 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:47.263 15:28:38 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:47.263 15:28:38 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:04:47.263 15:28:38 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:04:47.263 15:28:38 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:04:47.263 15:28:38 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:04:47.263 15:28:38 -- event/cpu_locks.sh@141 -- # killprocess 755587 00:04:47.263 15:28:38 -- common/autotest_common.sh@936 -- # '[' -z 755587 ']' 00:04:47.263 15:28:38 -- common/autotest_common.sh@940 -- # kill -0 755587 00:04:47.263 15:28:38 -- common/autotest_common.sh@941 -- # uname 00:04:47.263 15:28:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:47.263 15:28:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 755587 00:04:47.263 15:28:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:47.263 15:28:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:47.263 15:28:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 755587' 00:04:47.263 killing process with pid 755587 00:04:47.263 15:28:38 -- common/autotest_common.sh@955 -- # kill 755587 00:04:47.263 15:28:38 -- common/autotest_common.sh@960 -- # wait 755587 00:04:47.833 00:04:47.833 real 0m2.255s 00:04:47.833 user 0m6.444s 00:04:47.833 sys 0m0.479s 00:04:47.833 15:28:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:47.833 15:28:39 -- common/autotest_common.sh@10 -- # set +x 00:04:47.833 ************************************ 00:04:47.833 END TEST locking_overlapped_coremask 00:04:47.833 ************************************ 00:04:47.833 15:28:39 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:04:47.833 15:28:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.833 15:28:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.833 15:28:39 -- common/autotest_common.sh@10 -- # set +x 00:04:47.833 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat: trap: line 2: unexpected EOF while looking for matching `)' 00:04:47.833 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat: line 52: unexpected EOF while looking for matching `)' 00:04:47.833 ************************************ 00:04:47.833 START TEST locking_overlapped_coremask_via_rpc 00:04:47.833 ************************************ 00:04:47.833 15:28:39 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:04:47.833 15:28:39 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=755899 00:04:47.833 15:28:39 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:04:47.833 15:28:39 -- event/cpu_locks.sh@149 -- # waitforlisten 755899 /var/tmp/spdk.sock 00:04:47.833 15:28:39 -- common/autotest_common.sh@829 -- # '[' -z 755899 ']' 00:04:47.833 15:28:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:47.833 15:28:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:47.833 15:28:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:47.833 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:47.833 15:28:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:47.833 15:28:39 -- common/autotest_common.sh@10 -- # set +x 00:04:47.833 [2024-11-26 15:28:39.131520] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:47.833 [2024-11-26 15:28:39.131632] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid755899 ] 00:04:47.833 EAL: No free 2048 kB hugepages reported on node 1 00:04:47.833 [2024-11-26 15:28:39.189266] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:47.833 [2024-11-26 15:28:39.189309] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:48.092 [2024-11-26 15:28:39.298595] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:48.092 [2024-11-26 15:28:39.298807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:48.092 [2024-11-26 15:28:39.298865] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:48.092 [2024-11-26 15:28:39.298868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:49.030 15:28:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:49.030 15:28:40 -- common/autotest_common.sh@862 -- # return 0 00:04:49.030 15:28:40 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=756031 00:04:49.030 15:28:40 -- event/cpu_locks.sh@153 -- # waitforlisten 756031 /var/tmp/spdk2.sock 00:04:49.030 15:28:40 -- common/autotest_common.sh@829 -- # '[' -z 756031 ']' 00:04:49.030 15:28:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:49.030 15:28:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:49.030 15:28:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:49.030 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:49.030 15:28:40 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:04:49.030 15:28:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:49.030 15:28:40 -- common/autotest_common.sh@10 -- # set +x 00:04:49.030 [2024-11-26 15:28:40.161532] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:49.030 [2024-11-26 15:28:40.161606] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid756031 ] 00:04:49.030 EAL: No free 2048 kB hugepages reported on node 1 00:04:49.030 [2024-11-26 15:28:40.250942] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:49.030 [2024-11-26 15:28:40.250979] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:49.290 [2024-11-26 15:28:40.480657] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:49.290 [2024-11-26 15:28:40.480897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:49.290 [2024-11-26 15:28:40.480964] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:04:49.290 [2024-11-26 15:28:40.480967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:49.858 15:28:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:49.858 15:28:41 -- common/autotest_common.sh@862 -- # return 0 00:04:49.858 15:28:41 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:04:49.858 15:28:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:49.858 15:28:41 -- common/autotest_common.sh@10 -- # set +x 00:04:49.858 15:28:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:49.858 15:28:41 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:49.858 15:28:41 -- common/autotest_common.sh@650 -- # local es=0 00:04:49.858 15:28:41 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:49.858 15:28:41 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:04:49.858 15:28:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:49.858 15:28:41 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:04:49.858 15:28:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:49.858 15:28:41 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:49.858 15:28:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:49.858 15:28:41 -- common/autotest_common.sh@10 -- # set +x 00:04:49.858 [2024-11-26 15:28:41.125787] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 755899 has claimed it. 00:04:49.858 request: 00:04:49.858 { 00:04:49.858 "method": "framework_enable_cpumask_locks", 00:04:49.858 "req_id": 1 00:04:49.858 } 00:04:49.858 Got JSON-RPC error response 00:04:49.858 response: 00:04:49.858 { 00:04:49.858 "code": -32603, 00:04:49.858 "message": "Failed to claim CPU core: 2" 00:04:49.858 } 00:04:49.858 15:28:41 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:04:49.858 15:28:41 -- common/autotest_common.sh@653 -- # es=1 00:04:49.858 15:28:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:49.858 15:28:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:49.858 15:28:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:49.858 15:28:41 -- event/cpu_locks.sh@158 -- # waitforlisten 755899 /var/tmp/spdk.sock 00:04:49.858 15:28:41 -- common/autotest_common.sh@829 -- # '[' -z 755899 ']' 00:04:49.858 15:28:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:49.858 15:28:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:49.858 15:28:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:49.858 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:49.858 15:28:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:49.858 15:28:41 -- common/autotest_common.sh@10 -- # set +x 00:04:50.117 15:28:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:50.117 15:28:41 -- common/autotest_common.sh@862 -- # return 0 00:04:50.117 15:28:41 -- event/cpu_locks.sh@159 -- # waitforlisten 756031 /var/tmp/spdk2.sock 00:04:50.117 15:28:41 -- common/autotest_common.sh@829 -- # '[' -z 756031 ']' 00:04:50.117 15:28:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:50.117 15:28:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:50.117 15:28:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:50.117 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:50.117 15:28:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:50.117 15:28:41 -- common/autotest_common.sh@10 -- # set +x 00:04:50.377 15:28:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:50.377 15:28:41 -- common/autotest_common.sh@862 -- # return 0 00:04:50.377 15:28:41 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:04:50.377 15:28:41 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:04:50.377 15:28:41 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:04:50.377 15:28:41 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:04:50.377 00:04:50.377 real 0m2.556s 00:04:50.377 user 0m1.305s 00:04:50.377 sys 0m0.191s 00:04:50.377 15:28:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.377 15:28:41 -- common/autotest_common.sh@10 -- # set +x 00:04:50.377 ************************************ 00:04:50.377 END TEST locking_overlapped_coremask_via_rpc 00:04:50.377 ************************************ 00:04:50.377 15:28:41 -- event/cpu_locks.sh@174 -- # cleanup 00:04:50.377 15:28:41 -- event/cpu_locks.sh@15 -- # [[ -z 755899 ]] 00:04:50.377 15:28:41 -- event/cpu_locks.sh@15 -- # killprocess 755899 00:04:50.377 15:28:41 -- common/autotest_common.sh@936 -- # '[' -z 755899 ']' 00:04:50.377 15:28:41 -- common/autotest_common.sh@940 -- # kill -0 755899 00:04:50.377 15:28:41 -- common/autotest_common.sh@941 -- # uname 00:04:50.377 15:28:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:50.377 15:28:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 755899 00:04:50.377 15:28:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:50.377 15:28:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:50.377 15:28:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 755899' 00:04:50.377 killing process with pid 755899 00:04:50.377 15:28:41 -- common/autotest_common.sh@955 -- # kill 755899 00:04:50.377 15:28:41 -- common/autotest_common.sh@960 -- # wait 755899 00:04:50.944 15:28:42 -- event/cpu_locks.sh@16 -- # [[ -z 756031 ]] 00:04:50.944 15:28:42 -- event/cpu_locks.sh@16 -- # killprocess 756031 00:04:50.944 15:28:42 -- common/autotest_common.sh@936 -- # '[' -z 756031 ']' 00:04:50.944 15:28:42 -- common/autotest_common.sh@940 -- # kill -0 756031 00:04:50.944 15:28:42 -- common/autotest_common.sh@941 -- # uname 00:04:50.944 15:28:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:50.944 15:28:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 756031 00:04:50.944 15:28:42 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:50.944 15:28:42 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:50.944 15:28:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 756031' 00:04:50.944 killing process with pid 756031 00:04:50.944 15:28:42 -- common/autotest_common.sh@955 -- # kill 756031 00:04:50.944 15:28:42 -- common/autotest_common.sh@960 -- # wait 756031 00:04:51.202 15:28:42 -- event/cpu_locks.sh@18 -- # rm -f 00:04:51.202 15:28:42 -- event/cpu_locks.sh@1 -- # cleanup 00:04:51.202 15:28:42 -- event/cpu_locks.sh@15 -- # [[ -z 755899 ]] 00:04:51.202 15:28:42 -- event/cpu_locks.sh@15 -- # killprocess 755899 00:04:51.202 15:28:42 -- common/autotest_common.sh@936 -- # '[' -z 755899 ']' 00:04:51.202 15:28:42 -- common/autotest_common.sh@940 -- # kill -0 755899 00:04:51.202 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (755899) - No such process 00:04:51.202 15:28:42 -- common/autotest_common.sh@963 -- # echo 'Process with pid 755899 is not found' 00:04:51.202 Process with pid 755899 is not found 00:04:51.202 15:28:42 -- event/cpu_locks.sh@16 -- # [[ -z 756031 ]] 00:04:51.202 15:28:42 -- event/cpu_locks.sh@16 -- # killprocess 756031 00:04:51.202 15:28:42 -- common/autotest_common.sh@936 -- # '[' -z 756031 ']' 00:04:51.202 15:28:42 -- common/autotest_common.sh@940 -- # kill -0 756031 00:04:51.202 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (756031) - No such process 00:04:51.202 15:28:42 -- common/autotest_common.sh@963 -- # echo 'Process with pid 756031 is not found' 00:04:51.202 Process with pid 756031 is not found 00:04:51.202 15:28:42 -- event/cpu_locks.sh@18 -- # rm -f 00:04:51.202 00:04:51.202 real 0m20.010s 00:04:51.202 user 0m35.917s 00:04:51.202 sys 0m5.419s 00:04:51.202 15:28:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:51.202 15:28:42 -- common/autotest_common.sh@10 -- # set +x 00:04:51.202 ************************************ 00:04:51.202 END TEST cpu_locks 00:04:51.202 ************************************ 00:04:51.463 00:04:51.463 real 0m47.099s 00:04:51.463 user 1m30.743s 00:04:51.463 sys 0m11.236s 00:04:51.463 15:28:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:51.463 15:28:42 -- common/autotest_common.sh@10 -- # set +x 00:04:51.463 ************************************ 00:04:51.463 END TEST event 00:04:51.463 ************************************ 00:04:51.463 15:28:42 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:04:51.463 15:28:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.463 15:28:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.463 15:28:42 -- common/autotest_common.sh@10 -- # set +x 00:04:51.463 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:04:51.463 ************************************ 00:04:51.463 START TEST thread 00:04:51.463 ************************************ 00:04:51.463 15:28:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:04:51.463 * Looking for test storage... 00:04:51.463 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:04:51.463 15:28:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:51.463 15:28:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:51.463 15:28:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:51.463 15:28:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:51.463 15:28:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:51.463 15:28:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:51.463 15:28:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:51.463 15:28:42 -- scripts/common.sh@335 -- # IFS=.-: 00:04:51.463 15:28:42 -- scripts/common.sh@335 -- # read -ra ver1 00:04:51.463 15:28:42 -- scripts/common.sh@336 -- # IFS=.-: 00:04:51.463 15:28:42 -- scripts/common.sh@336 -- # read -ra ver2 00:04:51.463 15:28:42 -- scripts/common.sh@337 -- # local 'op=<' 00:04:51.463 15:28:42 -- scripts/common.sh@339 -- # ver1_l=2 00:04:51.463 15:28:42 -- scripts/common.sh@340 -- # ver2_l=1 00:04:51.463 15:28:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:51.463 15:28:42 -- scripts/common.sh@343 -- # case "$op" in 00:04:51.463 15:28:42 -- scripts/common.sh@344 -- # : 1 00:04:51.463 15:28:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:51.463 15:28:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:51.463 15:28:42 -- scripts/common.sh@364 -- # decimal 1 00:04:51.463 15:28:42 -- scripts/common.sh@352 -- # local d=1 00:04:51.463 15:28:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:51.463 15:28:42 -- scripts/common.sh@354 -- # echo 1 00:04:51.463 15:28:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:51.463 15:28:42 -- scripts/common.sh@365 -- # decimal 2 00:04:51.463 15:28:42 -- scripts/common.sh@352 -- # local d=2 00:04:51.463 15:28:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:51.463 15:28:42 -- scripts/common.sh@354 -- # echo 2 00:04:51.463 15:28:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:51.463 15:28:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:51.463 15:28:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:51.463 15:28:42 -- scripts/common.sh@367 -- # return 0 00:04:51.463 15:28:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:51.463 15:28:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:51.463 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:51.463 --rc genhtml_branch_coverage=1 00:04:51.463 --rc genhtml_function_coverage=1 00:04:51.463 --rc genhtml_legend=1 00:04:51.463 --rc geninfo_all_blocks=1 00:04:51.463 --rc geninfo_unexecuted_blocks=1 00:04:51.463 00:04:51.463 ' 00:04:51.463 15:28:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:51.463 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:51.463 --rc genhtml_branch_coverage=1 00:04:51.463 --rc genhtml_function_coverage=1 00:04:51.463 --rc genhtml_legend=1 00:04:51.463 --rc geninfo_all_blocks=1 00:04:51.463 --rc geninfo_unexecuted_blocks=1 00:04:51.463 00:04:51.463 ' 00:04:51.463 15:28:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:51.463 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:51.463 --rc genhtml_branch_coverage=1 00:04:51.463 --rc genhtml_function_coverage=1 00:04:51.463 --rc genhtml_legend=1 00:04:51.463 --rc geninfo_all_blocks=1 00:04:51.463 --rc geninfo_unexecuted_blocks=1 00:04:51.463 00:04:51.463 ' 00:04:51.463 15:28:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:51.463 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:51.463 --rc genhtml_branch_coverage=1 00:04:51.463 --rc genhtml_function_coverage=1 00:04:51.463 --rc genhtml_legend=1 00:04:51.463 --rc geninfo_all_blocks=1 00:04:51.463 --rc geninfo_unexecuted_blocks=1 00:04:51.463 00:04:51.463 ' 00:04:51.463 15:28:42 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:04:51.463 15:28:42 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:04:51.463 15:28:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.463 15:28:42 -- common/autotest_common.sh@10 -- # set +x 00:04:51.463 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:04:51.463 ************************************ 00:04:51.463 START TEST thread_poller_perf 00:04:51.463 ************************************ 00:04:51.463 15:28:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:04:51.463 [2024-11-26 15:28:42.836752] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:51.463 [2024-11-26 15:28:42.836826] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid756399 ] 00:04:51.463 EAL: No free 2048 kB hugepages reported on node 1 00:04:51.463 [2024-11-26 15:28:42.902310] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:51.724 [2024-11-26 15:28:43.019965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.724 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:04:53.106 [2024-11-26T14:28:44.559Z] ====================================== 00:04:53.106 [2024-11-26T14:28:44.559Z] busy:2718281544 (cyc) 00:04:53.106 [2024-11-26T14:28:44.559Z] total_run_count: 280000 00:04:53.106 [2024-11-26T14:28:44.559Z] tsc_hz: 2700000000 (cyc) 00:04:53.106 [2024-11-26T14:28:44.559Z] ====================================== 00:04:53.106 [2024-11-26T14:28:44.559Z] poller_cost: 9708 (cyc), 3595 (nsec) 00:04:53.106 00:04:53.106 real 0m1.333s 00:04:53.106 user 0m1.241s 00:04:53.106 sys 0m0.083s 00:04:53.106 15:28:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:53.106 15:28:44 -- common/autotest_common.sh@10 -- # set +x 00:04:53.106 ************************************ 00:04:53.106 END TEST thread_poller_perf 00:04:53.106 ************************************ 00:04:53.106 15:28:44 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:04:53.106 15:28:44 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:04:53.106 15:28:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:53.106 15:28:44 -- common/autotest_common.sh@10 -- # set +x 00:04:53.106 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:04:53.106 ************************************ 00:04:53.106 START TEST thread_poller_perf 00:04:53.106 ************************************ 00:04:53.106 15:28:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:04:53.106 [2024-11-26 15:28:44.199446] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:53.106 [2024-11-26 15:28:44.199528] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid756549 ] 00:04:53.106 EAL: No free 2048 kB hugepages reported on node 1 00:04:53.106 [2024-11-26 15:28:44.263341] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:53.106 [2024-11-26 15:28:44.375519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:53.106 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:04:54.106 [2024-11-26T14:28:45.559Z] ====================================== 00:04:54.106 [2024-11-26T14:28:45.559Z] busy:2703807573 (cyc) 00:04:54.106 [2024-11-26T14:28:45.559Z] total_run_count: 3822000 00:04:54.106 [2024-11-26T14:28:45.559Z] tsc_hz: 2700000000 (cyc) 00:04:54.106 [2024-11-26T14:28:45.559Z] ====================================== 00:04:54.106 [2024-11-26T14:28:45.559Z] poller_cost: 707 (cyc), 261 (nsec) 00:04:54.106 00:04:54.106 real 0m1.313s 00:04:54.106 user 0m1.224s 00:04:54.106 sys 0m0.081s 00:04:54.106 15:28:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:54.106 15:28:45 -- common/autotest_common.sh@10 -- # set +x 00:04:54.106 ************************************ 00:04:54.106 END TEST thread_poller_perf 00:04:54.106 ************************************ 00:04:54.106 15:28:45 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:04:54.106 00:04:54.106 real 0m2.838s 00:04:54.106 user 0m2.586s 00:04:54.106 sys 0m0.254s 00:04:54.106 15:28:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:54.106 15:28:45 -- common/autotest_common.sh@10 -- # set +x 00:04:54.106 ************************************ 00:04:54.106 END TEST thread 00:04:54.106 ************************************ 00:04:54.367 15:28:45 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:04:54.367 15:28:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:54.367 15:28:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:54.367 15:28:45 -- common/autotest_common.sh@10 -- # set +x 00:04:54.367 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:04:54.367 ************************************ 00:04:54.367 START TEST accel 00:04:54.367 ************************************ 00:04:54.367 15:28:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:04:54.367 * Looking for test storage... 00:04:54.367 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:04:54.367 15:28:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:54.367 15:28:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:54.367 15:28:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:54.367 15:28:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:54.367 15:28:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:54.367 15:28:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:54.367 15:28:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:54.367 15:28:45 -- scripts/common.sh@335 -- # IFS=.-: 00:04:54.367 15:28:45 -- scripts/common.sh@335 -- # read -ra ver1 00:04:54.367 15:28:45 -- scripts/common.sh@336 -- # IFS=.-: 00:04:54.367 15:28:45 -- scripts/common.sh@336 -- # read -ra ver2 00:04:54.367 15:28:45 -- scripts/common.sh@337 -- # local 'op=<' 00:04:54.367 15:28:45 -- scripts/common.sh@339 -- # ver1_l=2 00:04:54.367 15:28:45 -- scripts/common.sh@340 -- # ver2_l=1 00:04:54.367 15:28:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:54.367 15:28:45 -- scripts/common.sh@343 -- # case "$op" in 00:04:54.367 15:28:45 -- scripts/common.sh@344 -- # : 1 00:04:54.367 15:28:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:54.367 15:28:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:54.367 15:28:45 -- scripts/common.sh@364 -- # decimal 1 00:04:54.367 15:28:45 -- scripts/common.sh@352 -- # local d=1 00:04:54.367 15:28:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:54.367 15:28:45 -- scripts/common.sh@354 -- # echo 1 00:04:54.367 15:28:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:54.367 15:28:45 -- scripts/common.sh@365 -- # decimal 2 00:04:54.367 15:28:45 -- scripts/common.sh@352 -- # local d=2 00:04:54.367 15:28:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:54.367 15:28:45 -- scripts/common.sh@354 -- # echo 2 00:04:54.367 15:28:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:54.367 15:28:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:54.367 15:28:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:54.367 15:28:45 -- scripts/common.sh@367 -- # return 0 00:04:54.367 15:28:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:54.367 15:28:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:54.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.367 --rc genhtml_branch_coverage=1 00:04:54.367 --rc genhtml_function_coverage=1 00:04:54.367 --rc genhtml_legend=1 00:04:54.367 --rc geninfo_all_blocks=1 00:04:54.367 --rc geninfo_unexecuted_blocks=1 00:04:54.367 00:04:54.367 ' 00:04:54.367 15:28:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:54.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.368 --rc genhtml_branch_coverage=1 00:04:54.368 --rc genhtml_function_coverage=1 00:04:54.368 --rc genhtml_legend=1 00:04:54.368 --rc geninfo_all_blocks=1 00:04:54.368 --rc geninfo_unexecuted_blocks=1 00:04:54.368 00:04:54.368 ' 00:04:54.368 15:28:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:54.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.368 --rc genhtml_branch_coverage=1 00:04:54.368 --rc genhtml_function_coverage=1 00:04:54.368 --rc genhtml_legend=1 00:04:54.368 --rc geninfo_all_blocks=1 00:04:54.368 --rc geninfo_unexecuted_blocks=1 00:04:54.368 00:04:54.368 ' 00:04:54.368 15:28:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:54.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.368 --rc genhtml_branch_coverage=1 00:04:54.368 --rc genhtml_function_coverage=1 00:04:54.368 --rc genhtml_legend=1 00:04:54.368 --rc geninfo_all_blocks=1 00:04:54.368 --rc geninfo_unexecuted_blocks=1 00:04:54.368 00:04:54.368 ' 00:04:54.368 15:28:45 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:04:54.368 15:28:45 -- accel/accel.sh@74 -- # get_expected_opcs 00:04:54.368 15:28:45 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:54.368 15:28:45 -- accel/accel.sh@59 -- # spdk_tgt_pid=756834 00:04:54.368 15:28:45 -- accel/accel.sh@60 -- # waitforlisten 756834 00:04:54.368 15:28:45 -- common/autotest_common.sh@829 -- # '[' -z 756834 ']' 00:04:54.368 15:28:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:54.368 15:28:45 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:04:54.368 15:28:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:54.368 15:28:45 -- accel/accel.sh@58 -- # build_accel_config 00:04:54.368 15:28:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:54.368 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:54.368 15:28:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:54.368 15:28:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:54.368 15:28:45 -- common/autotest_common.sh@10 -- # set +x 00:04:54.368 15:28:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:54.368 15:28:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:54.368 15:28:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:54.368 15:28:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:54.368 15:28:45 -- accel/accel.sh@41 -- # local IFS=, 00:04:54.368 15:28:45 -- accel/accel.sh@42 -- # jq -r . 00:04:54.368 [2024-11-26 15:28:45.729033] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:54.368 [2024-11-26 15:28:45.729145] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid756834 ] 00:04:54.368 EAL: No free 2048 kB hugepages reported on node 1 00:04:54.368 [2024-11-26 15:28:45.788024] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:54.628 [2024-11-26 15:28:45.898375] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:54.628 [2024-11-26 15:28:45.898562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:55.564 15:28:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:55.564 15:28:46 -- common/autotest_common.sh@862 -- # return 0 00:04:55.564 15:28:46 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:04:55.564 15:28:46 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:04:55.564 15:28:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.565 15:28:46 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:04:55.565 15:28:46 -- common/autotest_common.sh@10 -- # set +x 00:04:55.565 15:28:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.565 15:28:46 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # IFS== 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # read -r opc module 00:04:55.565 15:28:46 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:55.565 15:28:46 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # IFS== 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # read -r opc module 00:04:55.565 15:28:46 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:55.565 15:28:46 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # IFS== 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # read -r opc module 00:04:55.565 15:28:46 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:55.565 15:28:46 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # IFS== 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # read -r opc module 00:04:55.565 15:28:46 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:55.565 15:28:46 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # IFS== 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # read -r opc module 00:04:55.565 15:28:46 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:55.565 15:28:46 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # IFS== 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # read -r opc module 00:04:55.565 15:28:46 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:55.565 15:28:46 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # IFS== 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # read -r opc module 00:04:55.565 15:28:46 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:55.565 15:28:46 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # IFS== 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # read -r opc module 00:04:55.565 15:28:46 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:55.565 15:28:46 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # IFS== 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # read -r opc module 00:04:55.565 15:28:46 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:55.565 15:28:46 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # IFS== 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # read -r opc module 00:04:55.565 15:28:46 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:55.565 15:28:46 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # IFS== 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # read -r opc module 00:04:55.565 15:28:46 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:55.565 15:28:46 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # IFS== 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # read -r opc module 00:04:55.565 15:28:46 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:55.565 15:28:46 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # IFS== 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # read -r opc module 00:04:55.565 15:28:46 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:55.565 15:28:46 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # IFS== 00:04:55.565 15:28:46 -- accel/accel.sh@64 -- # read -r opc module 00:04:55.565 15:28:46 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:55.565 15:28:46 -- accel/accel.sh@67 -- # killprocess 756834 00:04:55.565 15:28:46 -- common/autotest_common.sh@936 -- # '[' -z 756834 ']' 00:04:55.565 15:28:46 -- common/autotest_common.sh@940 -- # kill -0 756834 00:04:55.565 15:28:46 -- common/autotest_common.sh@941 -- # uname 00:04:55.565 15:28:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:55.565 15:28:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 756834 00:04:55.565 15:28:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:55.565 15:28:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:55.565 15:28:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 756834' 00:04:55.565 killing process with pid 756834 00:04:55.565 15:28:46 -- common/autotest_common.sh@955 -- # kill 756834 00:04:55.565 15:28:46 -- common/autotest_common.sh@960 -- # wait 756834 00:04:55.823 15:28:47 -- accel/accel.sh@68 -- # trap - ERR 00:04:55.823 15:28:47 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:04:55.823 15:28:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:04:55.823 15:28:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.823 15:28:47 -- common/autotest_common.sh@10 -- # set +x 00:04:55.823 15:28:47 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:04:55.823 15:28:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:04:55.823 15:28:47 -- accel/accel.sh@12 -- # build_accel_config 00:04:55.823 15:28:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:55.823 15:28:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:55.823 15:28:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:55.823 15:28:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:55.823 15:28:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:55.823 15:28:47 -- accel/accel.sh@41 -- # local IFS=, 00:04:55.823 15:28:47 -- accel/accel.sh@42 -- # jq -r . 00:04:55.823 15:28:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:55.823 15:28:47 -- common/autotest_common.sh@10 -- # set +x 00:04:56.083 15:28:47 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:04:56.083 15:28:47 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:04:56.083 15:28:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:56.083 15:28:47 -- common/autotest_common.sh@10 -- # set +x 00:04:56.083 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:04:56.083 ************************************ 00:04:56.083 START TEST accel_missing_filename 00:04:56.083 ************************************ 00:04:56.083 15:28:47 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:04:56.083 15:28:47 -- common/autotest_common.sh@650 -- # local es=0 00:04:56.083 15:28:47 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:04:56.083 15:28:47 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:56.083 15:28:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:56.083 15:28:47 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:56.083 15:28:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:56.083 15:28:47 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:04:56.083 15:28:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:04:56.083 15:28:47 -- accel/accel.sh@12 -- # build_accel_config 00:04:56.083 15:28:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:56.083 15:28:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:56.083 15:28:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:56.083 15:28:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:56.083 15:28:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:56.083 15:28:47 -- accel/accel.sh@41 -- # local IFS=, 00:04:56.083 15:28:47 -- accel/accel.sh@42 -- # jq -r . 00:04:56.083 [2024-11-26 15:28:47.302020] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:56.083 [2024-11-26 15:28:47.302126] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid757042 ] 00:04:56.083 EAL: No free 2048 kB hugepages reported on node 1 00:04:56.083 [2024-11-26 15:28:47.367657] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:56.083 [2024-11-26 15:28:47.483903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:56.342 [2024-11-26 15:28:47.545712] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:56.342 [2024-11-26 15:28:47.629843] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:04:56.342 A filename is required. 00:04:56.342 15:28:47 -- common/autotest_common.sh@653 -- # es=234 00:04:56.342 15:28:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:56.342 15:28:47 -- common/autotest_common.sh@662 -- # es=106 00:04:56.342 15:28:47 -- common/autotest_common.sh@663 -- # case "$es" in 00:04:56.342 15:28:47 -- common/autotest_common.sh@670 -- # es=1 00:04:56.342 15:28:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:56.342 00:04:56.342 real 0m0.470s 00:04:56.342 user 0m0.363s 00:04:56.342 sys 0m0.143s 00:04:56.342 15:28:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:56.342 15:28:47 -- common/autotest_common.sh@10 -- # set +x 00:04:56.342 ************************************ 00:04:56.342 END TEST accel_missing_filename 00:04:56.342 ************************************ 00:04:56.342 15:28:47 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:56.342 15:28:47 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:04:56.342 15:28:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:56.342 15:28:47 -- common/autotest_common.sh@10 -- # set +x 00:04:56.342 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:04:56.342 ************************************ 00:04:56.342 START TEST accel_compress_verify 00:04:56.342 ************************************ 00:04:56.342 15:28:47 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:56.342 15:28:47 -- common/autotest_common.sh@650 -- # local es=0 00:04:56.342 15:28:47 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:56.342 15:28:47 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:56.342 15:28:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:56.342 15:28:47 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:56.342 15:28:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:56.342 15:28:47 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:56.342 15:28:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:56.342 15:28:47 -- accel/accel.sh@12 -- # build_accel_config 00:04:56.342 15:28:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:56.342 15:28:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:56.342 15:28:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:56.342 15:28:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:56.342 15:28:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:56.342 15:28:47 -- accel/accel.sh@41 -- # local IFS=, 00:04:56.342 15:28:47 -- accel/accel.sh@42 -- # jq -r . 00:04:56.601 [2024-11-26 15:28:47.796115] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:56.601 [2024-11-26 15:28:47.796195] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid757063 ] 00:04:56.601 EAL: No free 2048 kB hugepages reported on node 1 00:04:56.601 [2024-11-26 15:28:47.859131] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:56.601 [2024-11-26 15:28:47.978792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:56.601 [2024-11-26 15:28:48.040182] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:56.859 [2024-11-26 15:28:48.123346] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:04:56.859 00:04:56.859 Compression does not support the verify option, aborting. 00:04:56.859 15:28:48 -- common/autotest_common.sh@653 -- # es=161 00:04:56.859 15:28:48 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:56.859 15:28:48 -- common/autotest_common.sh@662 -- # es=33 00:04:56.859 15:28:48 -- common/autotest_common.sh@663 -- # case "$es" in 00:04:56.859 15:28:48 -- common/autotest_common.sh@670 -- # es=1 00:04:56.859 15:28:48 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:56.859 00:04:56.859 real 0m0.466s 00:04:56.859 user 0m0.359s 00:04:56.859 sys 0m0.141s 00:04:56.859 15:28:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:56.859 15:28:48 -- common/autotest_common.sh@10 -- # set +x 00:04:56.859 ************************************ 00:04:56.859 END TEST accel_compress_verify 00:04:56.859 ************************************ 00:04:56.859 15:28:48 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:04:56.859 15:28:48 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:04:56.859 15:28:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:56.859 15:28:48 -- common/autotest_common.sh@10 -- # set +x 00:04:56.859 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:04:56.859 ************************************ 00:04:56.859 START TEST accel_wrong_workload 00:04:56.859 ************************************ 00:04:56.859 15:28:48 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:04:56.859 15:28:48 -- common/autotest_common.sh@650 -- # local es=0 00:04:56.859 15:28:48 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:04:56.859 15:28:48 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:56.859 15:28:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:56.859 15:28:48 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:56.859 15:28:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:56.859 15:28:48 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:04:56.859 15:28:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:04:56.859 15:28:48 -- accel/accel.sh@12 -- # build_accel_config 00:04:56.859 15:28:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:56.859 15:28:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:56.859 15:28:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:56.859 15:28:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:56.859 15:28:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:56.859 15:28:48 -- accel/accel.sh@41 -- # local IFS=, 00:04:56.859 15:28:48 -- accel/accel.sh@42 -- # jq -r . 00:04:56.859 Unsupported workload type: foobar 00:04:56.859 [2024-11-26 15:28:48.283091] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:04:56.859 accel_perf options: 00:04:56.859 [-h help message] 00:04:56.859 [-q queue depth per core] 00:04:56.859 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:04:56.859 [-T number of threads per core 00:04:56.859 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:04:56.859 [-t time in seconds] 00:04:56.859 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:04:56.859 [ dif_verify, , dif_generate, dif_generate_copy 00:04:56.859 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:04:56.859 [-l for compress/decompress workloads, name of uncompressed input file 00:04:56.859 [-S for crc32c workload, use this seed value (default 0) 00:04:56.859 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:04:56.859 [-f for fill workload, use this BYTE value (default 255) 00:04:56.859 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:04:56.859 [-y verify result if this switch is on] 00:04:56.859 [-a tasks to allocate per core (default: same value as -q)] 00:04:56.859 Can be used to spread operations across a wider range of memory. 00:04:56.859 15:28:48 -- common/autotest_common.sh@653 -- # es=1 00:04:56.859 15:28:48 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:56.859 15:28:48 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:56.859 15:28:48 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:56.859 00:04:56.859 real 0m0.021s 00:04:56.859 user 0m0.012s 00:04:56.859 sys 0m0.008s 00:04:56.859 15:28:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:56.859 15:28:48 -- common/autotest_common.sh@10 -- # set +x 00:04:56.859 ************************************ 00:04:56.859 END TEST accel_wrong_workload 00:04:56.859 ************************************ 00:04:56.859 Error: writing output failed: Broken pipe 00:04:57.120 15:28:48 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:04:57.120 15:28:48 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:04:57.120 15:28:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:57.120 15:28:48 -- common/autotest_common.sh@10 -- # set +x 00:04:57.120 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:04:57.120 ************************************ 00:04:57.120 START TEST accel_negative_buffers 00:04:57.120 ************************************ 00:04:57.120 15:28:48 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:04:57.120 15:28:48 -- common/autotest_common.sh@650 -- # local es=0 00:04:57.120 15:28:48 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:04:57.120 15:28:48 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:57.120 15:28:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:57.120 15:28:48 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:57.120 15:28:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:57.120 15:28:48 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:04:57.120 15:28:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:04:57.120 15:28:48 -- accel/accel.sh@12 -- # build_accel_config 00:04:57.120 15:28:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:57.120 15:28:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:57.120 15:28:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:57.120 15:28:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:57.120 15:28:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:57.120 15:28:48 -- accel/accel.sh@41 -- # local IFS=, 00:04:57.120 15:28:48 -- accel/accel.sh@42 -- # jq -r . 00:04:57.120 -x option must be non-negative. 00:04:57.120 [2024-11-26 15:28:48.332789] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:04:57.120 accel_perf options: 00:04:57.120 [-h help message] 00:04:57.120 [-q queue depth per core] 00:04:57.120 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:04:57.120 [-T number of threads per core 00:04:57.121 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:04:57.121 [-t time in seconds] 00:04:57.121 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:04:57.121 [ dif_verify, , dif_generate, dif_generate_copy 00:04:57.121 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:04:57.121 [-l for compress/decompress workloads, name of uncompressed input file 00:04:57.121 [-S for crc32c workload, use this seed value (default 0) 00:04:57.121 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:04:57.121 [-f for fill workload, use this BYTE value (default 255) 00:04:57.121 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:04:57.121 [-y verify result if this switch is on] 00:04:57.121 [-a tasks to allocate per core (default: same value as -q)] 00:04:57.121 Can be used to spread operations across a wider range of memory. 00:04:57.121 15:28:48 -- common/autotest_common.sh@653 -- # es=1 00:04:57.121 15:28:48 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:57.121 15:28:48 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:57.121 15:28:48 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:57.121 00:04:57.121 real 0m0.024s 00:04:57.121 user 0m0.013s 00:04:57.121 sys 0m0.011s 00:04:57.121 15:28:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:57.121 15:28:48 -- common/autotest_common.sh@10 -- # set +x 00:04:57.121 ************************************ 00:04:57.121 END TEST accel_negative_buffers 00:04:57.121 ************************************ 00:04:57.121 Error: writing output failed: Broken pipe 00:04:57.121 15:28:48 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:04:57.121 15:28:48 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:04:57.121 15:28:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:57.121 15:28:48 -- common/autotest_common.sh@10 -- # set +x 00:04:57.121 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:04:57.121 ************************************ 00:04:57.121 START TEST accel_crc32c 00:04:57.121 ************************************ 00:04:57.121 15:28:48 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:04:57.121 15:28:48 -- accel/accel.sh@16 -- # local accel_opc 00:04:57.121 15:28:48 -- accel/accel.sh@17 -- # local accel_module 00:04:57.121 15:28:48 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:04:57.121 15:28:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:04:57.121 15:28:48 -- accel/accel.sh@12 -- # build_accel_config 00:04:57.121 15:28:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:57.121 15:28:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:57.121 15:28:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:57.121 15:28:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:57.121 15:28:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:57.121 15:28:48 -- accel/accel.sh@41 -- # local IFS=, 00:04:57.121 15:28:48 -- accel/accel.sh@42 -- # jq -r . 00:04:57.121 [2024-11-26 15:28:48.377683] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:57.121 [2024-11-26 15:28:48.377780] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid757243 ] 00:04:57.121 EAL: No free 2048 kB hugepages reported on node 1 00:04:57.121 [2024-11-26 15:28:48.439952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:57.121 [2024-11-26 15:28:48.556295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:58.502 15:28:49 -- accel/accel.sh@18 -- # out=' 00:04:58.502 SPDK Configuration: 00:04:58.502 Core mask: 0x1 00:04:58.502 00:04:58.502 Accel Perf Configuration: 00:04:58.502 Workload Type: crc32c 00:04:58.502 CRC-32C seed: 32 00:04:58.502 Transfer size: 4096 bytes 00:04:58.502 Vector count 1 00:04:58.502 Module: software 00:04:58.502 Queue depth: 32 00:04:58.502 Allocate depth: 32 00:04:58.502 # threads/core: 1 00:04:58.502 Run time: 1 seconds 00:04:58.502 Verify: Yes 00:04:58.502 00:04:58.502 Running for 1 seconds... 00:04:58.502 00:04:58.502 Core,Thread Transfers Bandwidth Failed Miscompares 00:04:58.502 ------------------------------------------------------------------------------------ 00:04:58.502 0,0 406304/s 1587 MiB/s 0 0 00:04:58.502 ==================================================================================== 00:04:58.502 Total 406304/s 1587 MiB/s 0 0' 00:04:58.502 15:28:49 -- accel/accel.sh@20 -- # IFS=: 00:04:58.502 15:28:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:04:58.502 15:28:49 -- accel/accel.sh@20 -- # read -r var val 00:04:58.502 15:28:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:04:58.502 15:28:49 -- accel/accel.sh@12 -- # build_accel_config 00:04:58.502 15:28:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:58.502 15:28:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:58.502 15:28:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:58.502 15:28:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:58.502 15:28:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:58.502 15:28:49 -- accel/accel.sh@41 -- # local IFS=, 00:04:58.502 15:28:49 -- accel/accel.sh@42 -- # jq -r . 00:04:58.502 [2024-11-26 15:28:49.850523] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:58.502 [2024-11-26 15:28:49.850615] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid757375 ] 00:04:58.502 EAL: No free 2048 kB hugepages reported on node 1 00:04:58.502 [2024-11-26 15:28:49.912701] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:58.762 [2024-11-26 15:28:50.032110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:58.762 15:28:50 -- accel/accel.sh@21 -- # val= 00:04:58.762 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.762 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.762 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.762 15:28:50 -- accel/accel.sh@21 -- # val= 00:04:58.762 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.762 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.762 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.762 15:28:50 -- accel/accel.sh@21 -- # val=0x1 00:04:58.762 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.762 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.762 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.762 15:28:50 -- accel/accel.sh@21 -- # val= 00:04:58.762 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.762 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.762 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.762 15:28:50 -- accel/accel.sh@21 -- # val= 00:04:58.762 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.762 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.762 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.762 15:28:50 -- accel/accel.sh@21 -- # val=crc32c 00:04:58.762 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.762 15:28:50 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:04:58.762 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.762 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.762 15:28:50 -- accel/accel.sh@21 -- # val=32 00:04:58.762 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.762 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.763 15:28:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:04:58.763 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.763 15:28:50 -- accel/accel.sh@21 -- # val= 00:04:58.763 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.763 15:28:50 -- accel/accel.sh@21 -- # val=software 00:04:58.763 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.763 15:28:50 -- accel/accel.sh@23 -- # accel_module=software 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.763 15:28:50 -- accel/accel.sh@21 -- # val=32 00:04:58.763 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.763 15:28:50 -- accel/accel.sh@21 -- # val=32 00:04:58.763 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.763 15:28:50 -- accel/accel.sh@21 -- # val=1 00:04:58.763 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.763 15:28:50 -- accel/accel.sh@21 -- # val='1 seconds' 00:04:58.763 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.763 15:28:50 -- accel/accel.sh@21 -- # val=Yes 00:04:58.763 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.763 15:28:50 -- accel/accel.sh@21 -- # val= 00:04:58.763 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:04:58.763 15:28:50 -- accel/accel.sh@21 -- # val= 00:04:58.763 15:28:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # IFS=: 00:04:58.763 15:28:50 -- accel/accel.sh@20 -- # read -r var val 00:05:00.144 15:28:51 -- accel/accel.sh@21 -- # val= 00:05:00.144 15:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.144 15:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:00.144 15:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:00.144 15:28:51 -- accel/accel.sh@21 -- # val= 00:05:00.144 15:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.144 15:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:00.144 15:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:00.144 15:28:51 -- accel/accel.sh@21 -- # val= 00:05:00.144 15:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.144 15:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:00.144 15:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:00.144 15:28:51 -- accel/accel.sh@21 -- # val= 00:05:00.144 15:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.144 15:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:00.144 15:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:00.144 15:28:51 -- accel/accel.sh@21 -- # val= 00:05:00.144 15:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.144 15:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:00.144 15:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:00.144 15:28:51 -- accel/accel.sh@21 -- # val= 00:05:00.144 15:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.144 15:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:00.144 15:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:00.144 15:28:51 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:00.144 15:28:51 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:00.144 15:28:51 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:00.144 00:05:00.144 real 0m2.945s 00:05:00.144 user 0m2.641s 00:05:00.144 sys 0m0.296s 00:05:00.144 15:28:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:00.144 15:28:51 -- common/autotest_common.sh@10 -- # set +x 00:05:00.144 ************************************ 00:05:00.144 END TEST accel_crc32c 00:05:00.144 ************************************ 00:05:00.144 15:28:51 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:00.144 15:28:51 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:00.144 15:28:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:00.144 15:28:51 -- common/autotest_common.sh@10 -- # set +x 00:05:00.144 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:00.144 ************************************ 00:05:00.144 START TEST accel_crc32c_C2 00:05:00.144 ************************************ 00:05:00.144 15:28:51 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:00.144 15:28:51 -- accel/accel.sh@16 -- # local accel_opc 00:05:00.144 15:28:51 -- accel/accel.sh@17 -- # local accel_module 00:05:00.144 15:28:51 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:00.144 15:28:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:00.144 15:28:51 -- accel/accel.sh@12 -- # build_accel_config 00:05:00.144 15:28:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:00.144 15:28:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:00.144 15:28:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:00.144 15:28:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:00.144 15:28:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:00.144 15:28:51 -- accel/accel.sh@41 -- # local IFS=, 00:05:00.144 15:28:51 -- accel/accel.sh@42 -- # jq -r . 00:05:00.144 [2024-11-26 15:28:51.345255] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:00.144 [2024-11-26 15:28:51.345324] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid757637 ] 00:05:00.144 EAL: No free 2048 kB hugepages reported on node 1 00:05:00.144 [2024-11-26 15:28:51.408996] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:00.144 [2024-11-26 15:28:51.525237] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.526 15:28:52 -- accel/accel.sh@18 -- # out=' 00:05:01.526 SPDK Configuration: 00:05:01.526 Core mask: 0x1 00:05:01.526 00:05:01.526 Accel Perf Configuration: 00:05:01.526 Workload Type: crc32c 00:05:01.526 CRC-32C seed: 0 00:05:01.526 Transfer size: 4096 bytes 00:05:01.526 Vector count 2 00:05:01.526 Module: software 00:05:01.526 Queue depth: 32 00:05:01.526 Allocate depth: 32 00:05:01.526 # threads/core: 1 00:05:01.526 Run time: 1 seconds 00:05:01.526 Verify: Yes 00:05:01.526 00:05:01.526 Running for 1 seconds... 00:05:01.526 00:05:01.526 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:01.526 ------------------------------------------------------------------------------------ 00:05:01.526 0,0 316160/s 2470 MiB/s 0 0 00:05:01.526 ==================================================================================== 00:05:01.526 Total 316160/s 1235 MiB/s 0 0' 00:05:01.526 15:28:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.526 15:28:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:01.526 15:28:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.526 15:28:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:01.526 15:28:52 -- accel/accel.sh@12 -- # build_accel_config 00:05:01.526 15:28:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:01.526 15:28:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:01.526 15:28:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:01.526 15:28:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:01.526 15:28:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:01.526 15:28:52 -- accel/accel.sh@41 -- # local IFS=, 00:05:01.526 15:28:52 -- accel/accel.sh@42 -- # jq -r . 00:05:01.526 [2024-11-26 15:28:52.798869] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:01.526 [2024-11-26 15:28:52.798958] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid757786 ] 00:05:01.526 EAL: No free 2048 kB hugepages reported on node 1 00:05:01.526 [2024-11-26 15:28:52.860906] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:01.787 [2024-11-26 15:28:52.976257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val= 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val= 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val=0x1 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val= 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val= 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val=crc32c 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val=0 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val= 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val=software 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@23 -- # accel_module=software 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val=32 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val=32 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val=1 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val=Yes 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val= 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:01.787 15:28:53 -- accel/accel.sh@21 -- # val= 00:05:01.787 15:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:01.787 15:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:03.167 15:28:54 -- accel/accel.sh@21 -- # val= 00:05:03.167 15:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.167 15:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:03.167 15:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:03.167 15:28:54 -- accel/accel.sh@21 -- # val= 00:05:03.167 15:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.167 15:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:03.167 15:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:03.167 15:28:54 -- accel/accel.sh@21 -- # val= 00:05:03.167 15:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.167 15:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:03.167 15:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:03.167 15:28:54 -- accel/accel.sh@21 -- # val= 00:05:03.167 15:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.167 15:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:03.167 15:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:03.167 15:28:54 -- accel/accel.sh@21 -- # val= 00:05:03.167 15:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.167 15:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:03.167 15:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:03.167 15:28:54 -- accel/accel.sh@21 -- # val= 00:05:03.167 15:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.167 15:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:03.167 15:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:03.167 15:28:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:03.167 15:28:54 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:03.167 15:28:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:03.167 00:05:03.167 real 0m2.924s 00:05:03.167 user 0m2.640s 00:05:03.167 sys 0m0.276s 00:05:03.167 15:28:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:03.167 15:28:54 -- common/autotest_common.sh@10 -- # set +x 00:05:03.167 ************************************ 00:05:03.167 END TEST accel_crc32c_C2 00:05:03.167 ************************************ 00:05:03.167 15:28:54 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:03.167 15:28:54 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:03.167 15:28:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:03.167 15:28:54 -- common/autotest_common.sh@10 -- # set +x 00:05:03.167 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:03.167 ************************************ 00:05:03.167 START TEST accel_copy 00:05:03.167 ************************************ 00:05:03.167 15:28:54 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:03.167 15:28:54 -- accel/accel.sh@16 -- # local accel_opc 00:05:03.167 15:28:54 -- accel/accel.sh@17 -- # local accel_module 00:05:03.167 15:28:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:03.167 15:28:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:03.167 15:28:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:03.167 15:28:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:03.167 15:28:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:03.167 15:28:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:03.167 15:28:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:03.167 15:28:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:03.167 15:28:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:03.167 15:28:54 -- accel/accel.sh@42 -- # jq -r . 00:05:03.167 [2024-11-26 15:28:54.299883] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:03.167 [2024-11-26 15:28:54.299967] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid757935 ] 00:05:03.167 EAL: No free 2048 kB hugepages reported on node 1 00:05:03.167 [2024-11-26 15:28:54.361338] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:03.167 [2024-11-26 15:28:54.477113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.548 15:28:55 -- accel/accel.sh@18 -- # out=' 00:05:04.548 SPDK Configuration: 00:05:04.548 Core mask: 0x1 00:05:04.548 00:05:04.548 Accel Perf Configuration: 00:05:04.548 Workload Type: copy 00:05:04.548 Transfer size: 4096 bytes 00:05:04.548 Vector count 1 00:05:04.548 Module: software 00:05:04.548 Queue depth: 32 00:05:04.548 Allocate depth: 32 00:05:04.548 # threads/core: 1 00:05:04.548 Run time: 1 seconds 00:05:04.548 Verify: Yes 00:05:04.548 00:05:04.548 Running for 1 seconds... 00:05:04.548 00:05:04.548 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:04.548 ------------------------------------------------------------------------------------ 00:05:04.548 0,0 277888/s 1085 MiB/s 0 0 00:05:04.548 ==================================================================================== 00:05:04.548 Total 277888/s 1085 MiB/s 0 0' 00:05:04.548 15:28:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.548 15:28:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:04.548 15:28:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.548 15:28:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:04.548 15:28:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:04.548 15:28:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:04.548 15:28:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:04.548 15:28:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:04.548 15:28:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:04.548 15:28:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:04.548 15:28:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:04.548 15:28:55 -- accel/accel.sh@42 -- # jq -r . 00:05:04.548 [2024-11-26 15:28:55.769305] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:04.548 [2024-11-26 15:28:55.769392] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid758085 ] 00:05:04.548 EAL: No free 2048 kB hugepages reported on node 1 00:05:04.548 [2024-11-26 15:28:55.830165] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:04.548 [2024-11-26 15:28:55.944565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val= 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val= 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val=0x1 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val= 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val= 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val=copy 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val= 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val=software 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@23 -- # accel_module=software 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val=32 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val=32 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val=1 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val=Yes 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val= 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:04.808 15:28:56 -- accel/accel.sh@21 -- # val= 00:05:04.808 15:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:04.808 15:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:06.190 15:28:57 -- accel/accel.sh@21 -- # val= 00:05:06.190 15:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.190 15:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:06.190 15:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:06.190 15:28:57 -- accel/accel.sh@21 -- # val= 00:05:06.190 15:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.190 15:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:06.190 15:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:06.190 15:28:57 -- accel/accel.sh@21 -- # val= 00:05:06.190 15:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.190 15:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:06.190 15:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:06.190 15:28:57 -- accel/accel.sh@21 -- # val= 00:05:06.190 15:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.190 15:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:06.190 15:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:06.190 15:28:57 -- accel/accel.sh@21 -- # val= 00:05:06.190 15:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.190 15:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:06.190 15:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:06.190 15:28:57 -- accel/accel.sh@21 -- # val= 00:05:06.190 15:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.190 15:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:06.190 15:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:06.190 15:28:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:06.190 15:28:57 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:06.190 15:28:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:06.190 00:05:06.190 real 0m2.929s 00:05:06.190 user 0m2.630s 00:05:06.190 sys 0m0.290s 00:05:06.190 15:28:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:06.190 15:28:57 -- common/autotest_common.sh@10 -- # set +x 00:05:06.190 ************************************ 00:05:06.190 END TEST accel_copy 00:05:06.190 ************************************ 00:05:06.190 15:28:57 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:06.190 15:28:57 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:06.190 15:28:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:06.190 15:28:57 -- common/autotest_common.sh@10 -- # set +x 00:05:06.190 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:06.190 ************************************ 00:05:06.190 START TEST accel_fill 00:05:06.190 ************************************ 00:05:06.190 15:28:57 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:06.190 15:28:57 -- accel/accel.sh@16 -- # local accel_opc 00:05:06.190 15:28:57 -- accel/accel.sh@17 -- # local accel_module 00:05:06.190 15:28:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:06.190 15:28:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:06.190 15:28:57 -- accel/accel.sh@12 -- # build_accel_config 00:05:06.190 15:28:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:06.190 15:28:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:06.190 15:28:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:06.190 15:28:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:06.190 15:28:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:06.190 15:28:57 -- accel/accel.sh@41 -- # local IFS=, 00:05:06.190 15:28:57 -- accel/accel.sh@42 -- # jq -r . 00:05:06.190 [2024-11-26 15:28:57.254332] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:06.191 [2024-11-26 15:28:57.254407] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid758344 ] 00:05:06.191 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.191 [2024-11-26 15:28:57.317486] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:06.191 [2024-11-26 15:28:57.432479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:07.573 15:28:58 -- accel/accel.sh@18 -- # out=' 00:05:07.573 SPDK Configuration: 00:05:07.573 Core mask: 0x1 00:05:07.573 00:05:07.573 Accel Perf Configuration: 00:05:07.573 Workload Type: fill 00:05:07.573 Fill pattern: 0x80 00:05:07.573 Transfer size: 4096 bytes 00:05:07.573 Vector count 1 00:05:07.573 Module: software 00:05:07.573 Queue depth: 64 00:05:07.573 Allocate depth: 64 00:05:07.573 # threads/core: 1 00:05:07.573 Run time: 1 seconds 00:05:07.573 Verify: Yes 00:05:07.573 00:05:07.573 Running for 1 seconds... 00:05:07.573 00:05:07.573 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:07.573 ------------------------------------------------------------------------------------ 00:05:07.573 0,0 402880/s 1573 MiB/s 0 0 00:05:07.573 ==================================================================================== 00:05:07.573 Total 402880/s 1573 MiB/s 0 0' 00:05:07.573 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.573 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.573 15:28:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:07.573 15:28:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:07.573 15:28:58 -- accel/accel.sh@12 -- # build_accel_config 00:05:07.573 15:28:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:07.573 15:28:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:07.573 15:28:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:07.573 15:28:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:07.573 15:28:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:07.573 15:28:58 -- accel/accel.sh@41 -- # local IFS=, 00:05:07.573 15:28:58 -- accel/accel.sh@42 -- # jq -r . 00:05:07.573 [2024-11-26 15:28:58.736324] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:07.573 [2024-11-26 15:28:58.736420] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid758477 ] 00:05:07.573 EAL: No free 2048 kB hugepages reported on node 1 00:05:07.573 [2024-11-26 15:28:58.798608] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:07.573 [2024-11-26 15:28:58.918064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:07.573 15:28:58 -- accel/accel.sh@21 -- # val= 00:05:07.573 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.573 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.573 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.573 15:28:58 -- accel/accel.sh@21 -- # val= 00:05:07.573 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.573 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.573 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.573 15:28:58 -- accel/accel.sh@21 -- # val=0x1 00:05:07.573 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.573 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.573 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.573 15:28:58 -- accel/accel.sh@21 -- # val= 00:05:07.573 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.573 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.574 15:28:58 -- accel/accel.sh@21 -- # val= 00:05:07.574 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.574 15:28:58 -- accel/accel.sh@21 -- # val=fill 00:05:07.574 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.574 15:28:58 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.574 15:28:58 -- accel/accel.sh@21 -- # val=0x80 00:05:07.574 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.574 15:28:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:07.574 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.574 15:28:58 -- accel/accel.sh@21 -- # val= 00:05:07.574 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.574 15:28:58 -- accel/accel.sh@21 -- # val=software 00:05:07.574 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.574 15:28:58 -- accel/accel.sh@23 -- # accel_module=software 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.574 15:28:58 -- accel/accel.sh@21 -- # val=64 00:05:07.574 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.574 15:28:58 -- accel/accel.sh@21 -- # val=64 00:05:07.574 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.574 15:28:58 -- accel/accel.sh@21 -- # val=1 00:05:07.574 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.574 15:28:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:07.574 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.574 15:28:58 -- accel/accel.sh@21 -- # val=Yes 00:05:07.574 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.574 15:28:58 -- accel/accel.sh@21 -- # val= 00:05:07.574 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.574 15:28:58 -- accel/accel.sh@21 -- # val= 00:05:07.574 15:28:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.574 15:28:58 -- accel/accel.sh@20 -- # read -r var val 00:05:08.953 15:29:00 -- accel/accel.sh@21 -- # val= 00:05:08.953 15:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.953 15:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:08.953 15:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:08.953 15:29:00 -- accel/accel.sh@21 -- # val= 00:05:08.953 15:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.953 15:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:08.953 15:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:08.953 15:29:00 -- accel/accel.sh@21 -- # val= 00:05:08.953 15:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.953 15:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:08.953 15:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:08.953 15:29:00 -- accel/accel.sh@21 -- # val= 00:05:08.953 15:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.953 15:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:08.953 15:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:08.953 15:29:00 -- accel/accel.sh@21 -- # val= 00:05:08.953 15:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.953 15:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:08.953 15:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:08.953 15:29:00 -- accel/accel.sh@21 -- # val= 00:05:08.953 15:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.953 15:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:08.953 15:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:08.953 15:29:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:08.953 15:29:00 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:08.953 15:29:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:08.953 00:05:08.953 real 0m2.970s 00:05:08.953 user 0m2.671s 00:05:08.953 sys 0m0.290s 00:05:08.953 15:29:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:08.953 15:29:00 -- common/autotest_common.sh@10 -- # set +x 00:05:08.953 ************************************ 00:05:08.953 END TEST accel_fill 00:05:08.953 ************************************ 00:05:08.953 15:29:00 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:08.953 15:29:00 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:08.953 15:29:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:08.953 15:29:00 -- common/autotest_common.sh@10 -- # set +x 00:05:08.953 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:08.953 ************************************ 00:05:08.953 START TEST accel_copy_crc32c 00:05:08.953 ************************************ 00:05:08.953 15:29:00 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:08.953 15:29:00 -- accel/accel.sh@16 -- # local accel_opc 00:05:08.953 15:29:00 -- accel/accel.sh@17 -- # local accel_module 00:05:08.953 15:29:00 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:08.953 15:29:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:08.953 15:29:00 -- accel/accel.sh@12 -- # build_accel_config 00:05:08.953 15:29:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:08.953 15:29:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:08.953 15:29:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:08.953 15:29:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:08.953 15:29:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:08.953 15:29:00 -- accel/accel.sh@41 -- # local IFS=, 00:05:08.953 15:29:00 -- accel/accel.sh@42 -- # jq -r . 00:05:08.953 [2024-11-26 15:29:00.256187] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:08.953 [2024-11-26 15:29:00.256270] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid758626 ] 00:05:08.953 EAL: No free 2048 kB hugepages reported on node 1 00:05:08.953 [2024-11-26 15:29:00.319920] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:09.212 [2024-11-26 15:29:00.437438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.593 15:29:01 -- accel/accel.sh@18 -- # out=' 00:05:10.593 SPDK Configuration: 00:05:10.593 Core mask: 0x1 00:05:10.593 00:05:10.593 Accel Perf Configuration: 00:05:10.593 Workload Type: copy_crc32c 00:05:10.593 CRC-32C seed: 0 00:05:10.593 Vector size: 4096 bytes 00:05:10.593 Transfer size: 4096 bytes 00:05:10.593 Vector count 1 00:05:10.593 Module: software 00:05:10.593 Queue depth: 32 00:05:10.593 Allocate depth: 32 00:05:10.593 # threads/core: 1 00:05:10.593 Run time: 1 seconds 00:05:10.593 Verify: Yes 00:05:10.593 00:05:10.593 Running for 1 seconds... 00:05:10.593 00:05:10.593 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:10.593 ------------------------------------------------------------------------------------ 00:05:10.593 0,0 218176/s 852 MiB/s 0 0 00:05:10.593 ==================================================================================== 00:05:10.593 Total 218176/s 852 MiB/s 0 0' 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.593 15:29:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.593 15:29:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:10.593 15:29:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:10.593 15:29:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:10.593 15:29:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:10.593 15:29:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:10.593 15:29:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:10.593 15:29:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:10.593 15:29:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:10.593 15:29:01 -- accel/accel.sh@42 -- # jq -r . 00:05:10.593 [2024-11-26 15:29:01.730763] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:10.593 [2024-11-26 15:29:01.730853] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid758885 ] 00:05:10.593 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.593 [2024-11-26 15:29:01.792219] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:10.593 [2024-11-26 15:29:01.910333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.593 15:29:01 -- accel/accel.sh@21 -- # val= 00:05:10.593 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.593 15:29:01 -- accel/accel.sh@21 -- # val= 00:05:10.593 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.593 15:29:01 -- accel/accel.sh@21 -- # val=0x1 00:05:10.593 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.593 15:29:01 -- accel/accel.sh@21 -- # val= 00:05:10.593 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.593 15:29:01 -- accel/accel.sh@21 -- # val= 00:05:10.593 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.593 15:29:01 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:10.593 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.593 15:29:01 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.593 15:29:01 -- accel/accel.sh@21 -- # val=0 00:05:10.593 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.593 15:29:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:10.593 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.593 15:29:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:10.593 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.593 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.594 15:29:01 -- accel/accel.sh@21 -- # val= 00:05:10.594 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.594 15:29:01 -- accel/accel.sh@21 -- # val=software 00:05:10.594 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.594 15:29:01 -- accel/accel.sh@23 -- # accel_module=software 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.594 15:29:01 -- accel/accel.sh@21 -- # val=32 00:05:10.594 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.594 15:29:01 -- accel/accel.sh@21 -- # val=32 00:05:10.594 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.594 15:29:01 -- accel/accel.sh@21 -- # val=1 00:05:10.594 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.594 15:29:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:10.594 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.594 15:29:01 -- accel/accel.sh@21 -- # val=Yes 00:05:10.594 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.594 15:29:01 -- accel/accel.sh@21 -- # val= 00:05:10.594 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.594 15:29:01 -- accel/accel.sh@21 -- # val= 00:05:10.594 15:29:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.594 15:29:01 -- accel/accel.sh@20 -- # read -r var val 00:05:11.978 15:29:03 -- accel/accel.sh@21 -- # val= 00:05:11.978 15:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.978 15:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:11.978 15:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:11.978 15:29:03 -- accel/accel.sh@21 -- # val= 00:05:11.978 15:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.978 15:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:11.978 15:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:11.978 15:29:03 -- accel/accel.sh@21 -- # val= 00:05:11.978 15:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.978 15:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:11.978 15:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:11.978 15:29:03 -- accel/accel.sh@21 -- # val= 00:05:11.978 15:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.978 15:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:11.978 15:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:11.978 15:29:03 -- accel/accel.sh@21 -- # val= 00:05:11.978 15:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.978 15:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:11.978 15:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:11.978 15:29:03 -- accel/accel.sh@21 -- # val= 00:05:11.978 15:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.978 15:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:11.978 15:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:11.978 15:29:03 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:11.978 15:29:03 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:11.978 15:29:03 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:11.978 00:05:11.978 real 0m2.960s 00:05:11.978 user 0m2.662s 00:05:11.978 sys 0m0.290s 00:05:11.978 15:29:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.978 15:29:03 -- common/autotest_common.sh@10 -- # set +x 00:05:11.978 ************************************ 00:05:11.978 END TEST accel_copy_crc32c 00:05:11.978 ************************************ 00:05:11.978 15:29:03 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:11.978 15:29:03 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:11.978 15:29:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.978 15:29:03 -- common/autotest_common.sh@10 -- # set +x 00:05:11.978 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:11.978 ************************************ 00:05:11.978 START TEST accel_copy_crc32c_C2 00:05:11.978 ************************************ 00:05:11.978 15:29:03 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:11.978 15:29:03 -- accel/accel.sh@16 -- # local accel_opc 00:05:11.978 15:29:03 -- accel/accel.sh@17 -- # local accel_module 00:05:11.978 15:29:03 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:11.978 15:29:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:11.978 15:29:03 -- accel/accel.sh@12 -- # build_accel_config 00:05:11.978 15:29:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:11.978 15:29:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:11.978 15:29:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:11.978 15:29:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:11.978 15:29:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:11.978 15:29:03 -- accel/accel.sh@41 -- # local IFS=, 00:05:11.978 15:29:03 -- accel/accel.sh@42 -- # jq -r . 00:05:11.978 [2024-11-26 15:29:03.244525] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:11.978 [2024-11-26 15:29:03.244605] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid759036 ] 00:05:11.978 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.978 [2024-11-26 15:29:03.307987] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:11.978 [2024-11-26 15:29:03.425510] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.358 15:29:04 -- accel/accel.sh@18 -- # out=' 00:05:13.358 SPDK Configuration: 00:05:13.358 Core mask: 0x1 00:05:13.358 00:05:13.358 Accel Perf Configuration: 00:05:13.358 Workload Type: copy_crc32c 00:05:13.358 CRC-32C seed: 0 00:05:13.358 Vector size: 4096 bytes 00:05:13.358 Transfer size: 8192 bytes 00:05:13.358 Vector count 2 00:05:13.358 Module: software 00:05:13.358 Queue depth: 32 00:05:13.358 Allocate depth: 32 00:05:13.358 # threads/core: 1 00:05:13.358 Run time: 1 seconds 00:05:13.358 Verify: Yes 00:05:13.358 00:05:13.358 Running for 1 seconds... 00:05:13.358 00:05:13.358 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:13.358 ------------------------------------------------------------------------------------ 00:05:13.358 0,0 155232/s 1212 MiB/s 0 0 00:05:13.358 ==================================================================================== 00:05:13.358 Total 155232/s 606 MiB/s 0 0' 00:05:13.358 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.358 15:29:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:13.358 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.358 15:29:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:13.358 15:29:04 -- accel/accel.sh@12 -- # build_accel_config 00:05:13.358 15:29:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:13.358 15:29:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:13.358 15:29:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:13.358 15:29:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:13.358 15:29:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:13.358 15:29:04 -- accel/accel.sh@41 -- # local IFS=, 00:05:13.358 15:29:04 -- accel/accel.sh@42 -- # jq -r . 00:05:13.358 [2024-11-26 15:29:04.729675] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:13.358 [2024-11-26 15:29:04.729781] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid759168 ] 00:05:13.358 EAL: No free 2048 kB hugepages reported on node 1 00:05:13.358 [2024-11-26 15:29:04.791675] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:13.620 [2024-11-26 15:29:04.910800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val= 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val= 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val=0x1 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val= 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val= 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val=0 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val= 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val=software 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@23 -- # accel_module=software 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val=32 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val=32 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val=1 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val=Yes 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val= 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.620 15:29:04 -- accel/accel.sh@21 -- # val= 00:05:13.620 15:29:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.620 15:29:04 -- accel/accel.sh@20 -- # read -r var val 00:05:14.998 15:29:06 -- accel/accel.sh@21 -- # val= 00:05:14.998 15:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.998 15:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:14.998 15:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:14.998 15:29:06 -- accel/accel.sh@21 -- # val= 00:05:14.998 15:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.998 15:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:14.998 15:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:14.998 15:29:06 -- accel/accel.sh@21 -- # val= 00:05:14.998 15:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.998 15:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:14.998 15:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:14.998 15:29:06 -- accel/accel.sh@21 -- # val= 00:05:14.998 15:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.998 15:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:14.998 15:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:14.998 15:29:06 -- accel/accel.sh@21 -- # val= 00:05:14.998 15:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.998 15:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:14.998 15:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:14.998 15:29:06 -- accel/accel.sh@21 -- # val= 00:05:14.998 15:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.998 15:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:14.998 15:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:14.998 15:29:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:14.998 15:29:06 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:14.998 15:29:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:14.998 00:05:14.998 real 0m2.963s 00:05:14.998 user 0m2.677s 00:05:14.998 sys 0m0.278s 00:05:14.998 15:29:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.998 15:29:06 -- common/autotest_common.sh@10 -- # set +x 00:05:14.998 ************************************ 00:05:14.998 END TEST accel_copy_crc32c_C2 00:05:14.998 ************************************ 00:05:14.998 15:29:06 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:14.998 15:29:06 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:14.998 15:29:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.998 15:29:06 -- common/autotest_common.sh@10 -- # set +x 00:05:14.998 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:14.998 ************************************ 00:05:14.998 START TEST accel_dualcast 00:05:14.998 ************************************ 00:05:14.998 15:29:06 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:14.998 15:29:06 -- accel/accel.sh@16 -- # local accel_opc 00:05:14.998 15:29:06 -- accel/accel.sh@17 -- # local accel_module 00:05:14.998 15:29:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:14.998 15:29:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:14.998 15:29:06 -- accel/accel.sh@12 -- # build_accel_config 00:05:14.998 15:29:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:14.998 15:29:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:14.998 15:29:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:14.998 15:29:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:14.998 15:29:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:14.998 15:29:06 -- accel/accel.sh@41 -- # local IFS=, 00:05:14.998 15:29:06 -- accel/accel.sh@42 -- # jq -r . 00:05:14.998 [2024-11-26 15:29:06.229285] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.998 [2024-11-26 15:29:06.229369] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid759438 ] 00:05:14.998 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.998 [2024-11-26 15:29:06.294717] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.998 [2024-11-26 15:29:06.413728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:16.378 15:29:07 -- accel/accel.sh@18 -- # out=' 00:05:16.378 SPDK Configuration: 00:05:16.378 Core mask: 0x1 00:05:16.378 00:05:16.378 Accel Perf Configuration: 00:05:16.378 Workload Type: dualcast 00:05:16.378 Transfer size: 4096 bytes 00:05:16.378 Vector count 1 00:05:16.378 Module: software 00:05:16.378 Queue depth: 32 00:05:16.378 Allocate depth: 32 00:05:16.378 # threads/core: 1 00:05:16.378 Run time: 1 seconds 00:05:16.378 Verify: Yes 00:05:16.378 00:05:16.378 Running for 1 seconds... 00:05:16.378 00:05:16.378 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:16.378 ------------------------------------------------------------------------------------ 00:05:16.378 0,0 297632/s 1162 MiB/s 0 0 00:05:16.378 ==================================================================================== 00:05:16.378 Total 297632/s 1162 MiB/s 0 0' 00:05:16.378 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.378 15:29:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:16.378 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.378 15:29:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:16.378 15:29:07 -- accel/accel.sh@12 -- # build_accel_config 00:05:16.378 15:29:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:16.378 15:29:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:16.378 15:29:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:16.378 15:29:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:16.378 15:29:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:16.378 15:29:07 -- accel/accel.sh@41 -- # local IFS=, 00:05:16.378 15:29:07 -- accel/accel.sh@42 -- # jq -r . 00:05:16.378 [2024-11-26 15:29:07.699516] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:16.378 [2024-11-26 15:29:07.699619] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid759578 ] 00:05:16.378 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.378 [2024-11-26 15:29:07.761224] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:16.638 [2024-11-26 15:29:07.880808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val= 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val= 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val=0x1 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val= 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val= 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val=dualcast 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val= 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val=software 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@23 -- # accel_module=software 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val=32 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val=32 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val=1 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val=Yes 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val= 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.638 15:29:07 -- accel/accel.sh@21 -- # val= 00:05:16.638 15:29:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.638 15:29:07 -- accel/accel.sh@20 -- # read -r var val 00:05:18.018 15:29:09 -- accel/accel.sh@21 -- # val= 00:05:18.018 15:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.018 15:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:18.018 15:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:18.018 15:29:09 -- accel/accel.sh@21 -- # val= 00:05:18.018 15:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.018 15:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:18.018 15:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:18.018 15:29:09 -- accel/accel.sh@21 -- # val= 00:05:18.018 15:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.018 15:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:18.018 15:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:18.018 15:29:09 -- accel/accel.sh@21 -- # val= 00:05:18.018 15:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.018 15:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:18.018 15:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:18.018 15:29:09 -- accel/accel.sh@21 -- # val= 00:05:18.018 15:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.018 15:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:18.018 15:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:18.018 15:29:09 -- accel/accel.sh@21 -- # val= 00:05:18.018 15:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.018 15:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:18.018 15:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:18.018 15:29:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:18.018 15:29:09 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:18.018 15:29:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:18.018 00:05:18.018 real 0m2.954s 00:05:18.018 user 0m2.660s 00:05:18.018 sys 0m0.285s 00:05:18.018 15:29:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:18.018 15:29:09 -- common/autotest_common.sh@10 -- # set +x 00:05:18.018 ************************************ 00:05:18.018 END TEST accel_dualcast 00:05:18.018 ************************************ 00:05:18.018 15:29:09 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:18.018 15:29:09 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:18.018 15:29:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:18.018 15:29:09 -- common/autotest_common.sh@10 -- # set +x 00:05:18.018 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:18.018 ************************************ 00:05:18.018 START TEST accel_compare 00:05:18.018 ************************************ 00:05:18.018 15:29:09 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:18.018 15:29:09 -- accel/accel.sh@16 -- # local accel_opc 00:05:18.018 15:29:09 -- accel/accel.sh@17 -- # local accel_module 00:05:18.018 15:29:09 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:18.018 15:29:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:18.018 15:29:09 -- accel/accel.sh@12 -- # build_accel_config 00:05:18.018 15:29:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:18.018 15:29:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:18.018 15:29:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:18.018 15:29:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:18.018 15:29:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:18.018 15:29:09 -- accel/accel.sh@41 -- # local IFS=, 00:05:18.018 15:29:09 -- accel/accel.sh@42 -- # jq -r . 00:05:18.018 [2024-11-26 15:29:09.211068] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:18.018 [2024-11-26 15:29:09.211159] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid759727 ] 00:05:18.018 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.018 [2024-11-26 15:29:09.272708] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.018 [2024-11-26 15:29:09.392604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.397 15:29:10 -- accel/accel.sh@18 -- # out=' 00:05:19.397 SPDK Configuration: 00:05:19.397 Core mask: 0x1 00:05:19.397 00:05:19.397 Accel Perf Configuration: 00:05:19.397 Workload Type: compare 00:05:19.397 Transfer size: 4096 bytes 00:05:19.397 Vector count 1 00:05:19.397 Module: software 00:05:19.397 Queue depth: 32 00:05:19.397 Allocate depth: 32 00:05:19.397 # threads/core: 1 00:05:19.397 Run time: 1 seconds 00:05:19.397 Verify: Yes 00:05:19.397 00:05:19.397 Running for 1 seconds... 00:05:19.397 00:05:19.397 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:19.397 ------------------------------------------------------------------------------------ 00:05:19.397 0,0 397280/s 1551 MiB/s 0 0 00:05:19.397 ==================================================================================== 00:05:19.397 Total 397280/s 1551 MiB/s 0 0' 00:05:19.397 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.397 15:29:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:19.397 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.397 15:29:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:19.397 15:29:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:19.397 15:29:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:19.397 15:29:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:19.397 15:29:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:19.397 15:29:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:19.397 15:29:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:19.397 15:29:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:19.397 15:29:10 -- accel/accel.sh@42 -- # jq -r . 00:05:19.397 [2024-11-26 15:29:10.688497] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:19.397 [2024-11-26 15:29:10.688590] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid759978 ] 00:05:19.398 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.398 [2024-11-26 15:29:10.750272] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:19.658 [2024-11-26 15:29:10.868681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val= 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val= 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val=0x1 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val= 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val= 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val=compare 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val= 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val=software 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@23 -- # accel_module=software 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val=32 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val=32 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val=1 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val=Yes 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val= 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.658 15:29:10 -- accel/accel.sh@21 -- # val= 00:05:19.658 15:29:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.658 15:29:10 -- accel/accel.sh@20 -- # read -r var val 00:05:21.037 15:29:12 -- accel/accel.sh@21 -- # val= 00:05:21.037 15:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.037 15:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:21.037 15:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:21.037 15:29:12 -- accel/accel.sh@21 -- # val= 00:05:21.037 15:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.037 15:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:21.037 15:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:21.037 15:29:12 -- accel/accel.sh@21 -- # val= 00:05:21.037 15:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.037 15:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:21.037 15:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:21.037 15:29:12 -- accel/accel.sh@21 -- # val= 00:05:21.037 15:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.037 15:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:21.037 15:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:21.038 15:29:12 -- accel/accel.sh@21 -- # val= 00:05:21.038 15:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.038 15:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:21.038 15:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:21.038 15:29:12 -- accel/accel.sh@21 -- # val= 00:05:21.038 15:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.038 15:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:21.038 15:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:21.038 15:29:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:21.038 15:29:12 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:21.038 15:29:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:21.038 00:05:21.038 real 0m2.949s 00:05:21.038 user 0m2.657s 00:05:21.038 sys 0m0.282s 00:05:21.038 15:29:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.038 15:29:12 -- common/autotest_common.sh@10 -- # set +x 00:05:21.038 ************************************ 00:05:21.038 END TEST accel_compare 00:05:21.038 ************************************ 00:05:21.038 15:29:12 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:21.038 15:29:12 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:21.038 15:29:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.038 15:29:12 -- common/autotest_common.sh@10 -- # set +x 00:05:21.038 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:21.038 ************************************ 00:05:21.038 START TEST accel_xor 00:05:21.038 ************************************ 00:05:21.038 15:29:12 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:21.038 15:29:12 -- accel/accel.sh@16 -- # local accel_opc 00:05:21.038 15:29:12 -- accel/accel.sh@17 -- # local accel_module 00:05:21.038 15:29:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:21.038 15:29:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:21.038 15:29:12 -- accel/accel.sh@12 -- # build_accel_config 00:05:21.038 15:29:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:21.038 15:29:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:21.038 15:29:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:21.038 15:29:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:21.038 15:29:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:21.038 15:29:12 -- accel/accel.sh@41 -- # local IFS=, 00:05:21.038 15:29:12 -- accel/accel.sh@42 -- # jq -r . 00:05:21.038 [2024-11-26 15:29:12.184037] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:21.038 [2024-11-26 15:29:12.184123] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid760136 ] 00:05:21.038 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.038 [2024-11-26 15:29:12.247975] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.038 [2024-11-26 15:29:12.368088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.417 15:29:13 -- accel/accel.sh@18 -- # out=' 00:05:22.417 SPDK Configuration: 00:05:22.417 Core mask: 0x1 00:05:22.417 00:05:22.417 Accel Perf Configuration: 00:05:22.417 Workload Type: xor 00:05:22.417 Source buffers: 2 00:05:22.417 Transfer size: 4096 bytes 00:05:22.417 Vector count 1 00:05:22.417 Module: software 00:05:22.417 Queue depth: 32 00:05:22.417 Allocate depth: 32 00:05:22.417 # threads/core: 1 00:05:22.417 Run time: 1 seconds 00:05:22.417 Verify: Yes 00:05:22.417 00:05:22.417 Running for 1 seconds... 00:05:22.417 00:05:22.417 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:22.417 ------------------------------------------------------------------------------------ 00:05:22.417 0,0 190144/s 742 MiB/s 0 0 00:05:22.417 ==================================================================================== 00:05:22.417 Total 190144/s 742 MiB/s 0 0' 00:05:22.417 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.417 15:29:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:22.417 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.417 15:29:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:22.417 15:29:13 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.417 15:29:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.417 15:29:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.417 15:29:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.417 15:29:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.417 15:29:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.417 15:29:13 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.417 15:29:13 -- accel/accel.sh@42 -- # jq -r . 00:05:22.417 [2024-11-26 15:29:13.671577] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.417 [2024-11-26 15:29:13.671671] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid760269 ] 00:05:22.417 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.417 [2024-11-26 15:29:13.733810] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.417 [2024-11-26 15:29:13.853067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val= 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val= 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val=0x1 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val= 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val= 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val=xor 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val=2 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val= 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val=software 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@23 -- # accel_module=software 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val=32 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val=32 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val=1 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val=Yes 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val= 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.677 15:29:13 -- accel/accel.sh@21 -- # val= 00:05:22.677 15:29:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.677 15:29:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.056 15:29:15 -- accel/accel.sh@21 -- # val= 00:05:24.056 15:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.056 15:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:24.056 15:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:24.056 15:29:15 -- accel/accel.sh@21 -- # val= 00:05:24.056 15:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.056 15:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:24.056 15:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:24.056 15:29:15 -- accel/accel.sh@21 -- # val= 00:05:24.056 15:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.056 15:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:24.056 15:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:24.056 15:29:15 -- accel/accel.sh@21 -- # val= 00:05:24.056 15:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.056 15:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:24.056 15:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:24.056 15:29:15 -- accel/accel.sh@21 -- # val= 00:05:24.056 15:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.056 15:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:24.056 15:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:24.056 15:29:15 -- accel/accel.sh@21 -- # val= 00:05:24.056 15:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.056 15:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:24.056 15:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:24.056 15:29:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:24.056 15:29:15 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:24.056 15:29:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:24.056 00:05:24.056 real 0m2.972s 00:05:24.056 user 0m2.680s 00:05:24.056 sys 0m0.284s 00:05:24.056 15:29:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.056 15:29:15 -- common/autotest_common.sh@10 -- # set +x 00:05:24.056 ************************************ 00:05:24.056 END TEST accel_xor 00:05:24.056 ************************************ 00:05:24.056 15:29:15 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:24.056 15:29:15 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:24.056 15:29:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.056 15:29:15 -- common/autotest_common.sh@10 -- # set +x 00:05:24.056 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:24.056 ************************************ 00:05:24.056 START TEST accel_xor 00:05:24.056 ************************************ 00:05:24.056 15:29:15 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:05:24.056 15:29:15 -- accel/accel.sh@16 -- # local accel_opc 00:05:24.056 15:29:15 -- accel/accel.sh@17 -- # local accel_module 00:05:24.056 15:29:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:24.056 15:29:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:24.056 15:29:15 -- accel/accel.sh@12 -- # build_accel_config 00:05:24.056 15:29:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:24.056 15:29:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:24.056 15:29:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:24.056 15:29:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:24.056 15:29:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:24.056 15:29:15 -- accel/accel.sh@41 -- # local IFS=, 00:05:24.056 15:29:15 -- accel/accel.sh@42 -- # jq -r . 00:05:24.056 [2024-11-26 15:29:15.181336] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:24.056 [2024-11-26 15:29:15.181422] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid760494 ] 00:05:24.056 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.056 [2024-11-26 15:29:15.244209] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.056 [2024-11-26 15:29:15.364293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.436 15:29:16 -- accel/accel.sh@18 -- # out=' 00:05:25.436 SPDK Configuration: 00:05:25.436 Core mask: 0x1 00:05:25.436 00:05:25.436 Accel Perf Configuration: 00:05:25.436 Workload Type: xor 00:05:25.436 Source buffers: 3 00:05:25.436 Transfer size: 4096 bytes 00:05:25.436 Vector count 1 00:05:25.436 Module: software 00:05:25.436 Queue depth: 32 00:05:25.436 Allocate depth: 32 00:05:25.436 # threads/core: 1 00:05:25.436 Run time: 1 seconds 00:05:25.436 Verify: Yes 00:05:25.436 00:05:25.436 Running for 1 seconds... 00:05:25.436 00:05:25.436 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:25.436 ------------------------------------------------------------------------------------ 00:05:25.436 0,0 182336/s 712 MiB/s 0 0 00:05:25.436 ==================================================================================== 00:05:25.436 Total 182336/s 712 MiB/s 0 0' 00:05:25.436 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.436 15:29:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:25.436 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.436 15:29:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:25.436 15:29:16 -- accel/accel.sh@12 -- # build_accel_config 00:05:25.436 15:29:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:25.436 15:29:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:25.436 15:29:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:25.436 15:29:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:25.436 15:29:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:25.436 15:29:16 -- accel/accel.sh@41 -- # local IFS=, 00:05:25.436 15:29:16 -- accel/accel.sh@42 -- # jq -r . 00:05:25.436 [2024-11-26 15:29:16.659499] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.436 [2024-11-26 15:29:16.659595] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid760673 ] 00:05:25.436 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.436 [2024-11-26 15:29:16.721111] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.436 [2024-11-26 15:29:16.837566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val= 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val= 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val=0x1 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val= 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val= 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val=xor 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val=3 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val= 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val=software 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@23 -- # accel_module=software 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val=32 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val=32 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val=1 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val=Yes 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val= 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.695 15:29:16 -- accel/accel.sh@21 -- # val= 00:05:25.695 15:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.695 15:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.069 15:29:18 -- accel/accel.sh@21 -- # val= 00:05:27.069 15:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.069 15:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:27.069 15:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:27.069 15:29:18 -- accel/accel.sh@21 -- # val= 00:05:27.069 15:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.069 15:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:27.069 15:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:27.069 15:29:18 -- accel/accel.sh@21 -- # val= 00:05:27.069 15:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.069 15:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:27.069 15:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:27.069 15:29:18 -- accel/accel.sh@21 -- # val= 00:05:27.069 15:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.069 15:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:27.069 15:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:27.069 15:29:18 -- accel/accel.sh@21 -- # val= 00:05:27.069 15:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.069 15:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:27.069 15:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:27.069 15:29:18 -- accel/accel.sh@21 -- # val= 00:05:27.069 15:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.069 15:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:27.069 15:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:27.069 15:29:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:27.069 15:29:18 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:27.069 15:29:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:27.069 00:05:27.069 real 0m2.961s 00:05:27.069 user 0m2.656s 00:05:27.069 sys 0m0.297s 00:05:27.069 15:29:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.069 15:29:18 -- common/autotest_common.sh@10 -- # set +x 00:05:27.069 ************************************ 00:05:27.069 END TEST accel_xor 00:05:27.069 ************************************ 00:05:27.069 15:29:18 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:27.069 15:29:18 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:27.069 15:29:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.069 15:29:18 -- common/autotest_common.sh@10 -- # set +x 00:05:27.069 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:27.069 ************************************ 00:05:27.069 START TEST accel_dif_verify 00:05:27.069 ************************************ 00:05:27.069 15:29:18 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:05:27.069 15:29:18 -- accel/accel.sh@16 -- # local accel_opc 00:05:27.069 15:29:18 -- accel/accel.sh@17 -- # local accel_module 00:05:27.069 15:29:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:27.069 15:29:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:27.070 15:29:18 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.070 15:29:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.070 15:29:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.070 15:29:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.070 15:29:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.070 15:29:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.070 15:29:18 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.070 15:29:18 -- accel/accel.sh@42 -- # jq -r . 00:05:27.070 [2024-11-26 15:29:18.163654] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:27.070 [2024-11-26 15:29:18.163756] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid760828 ] 00:05:27.070 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.070 [2024-11-26 15:29:18.226337] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.070 [2024-11-26 15:29:18.346275] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:28.519 15:29:19 -- accel/accel.sh@18 -- # out=' 00:05:28.519 SPDK Configuration: 00:05:28.519 Core mask: 0x1 00:05:28.519 00:05:28.519 Accel Perf Configuration: 00:05:28.519 Workload Type: dif_verify 00:05:28.519 Vector size: 4096 bytes 00:05:28.519 Transfer size: 4096 bytes 00:05:28.519 Block size: 512 bytes 00:05:28.519 Metadata size: 8 bytes 00:05:28.519 Vector count 1 00:05:28.519 Module: software 00:05:28.519 Queue depth: 32 00:05:28.519 Allocate depth: 32 00:05:28.519 # threads/core: 1 00:05:28.519 Run time: 1 seconds 00:05:28.519 Verify: No 00:05:28.519 00:05:28.519 Running for 1 seconds... 00:05:28.519 00:05:28.519 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:28.519 ------------------------------------------------------------------------------------ 00:05:28.519 0,0 82016/s 325 MiB/s 0 0 00:05:28.519 ==================================================================================== 00:05:28.519 Total 82016/s 320 MiB/s 0 0' 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.519 15:29:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.519 15:29:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:28.519 15:29:19 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.519 15:29:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.519 15:29:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.519 15:29:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.519 15:29:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.519 15:29:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.519 15:29:19 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.519 15:29:19 -- accel/accel.sh@42 -- # jq -r . 00:05:28.519 [2024-11-26 15:29:19.650143] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:28.519 [2024-11-26 15:29:19.650231] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid760963 ] 00:05:28.519 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.519 [2024-11-26 15:29:19.712413] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.519 [2024-11-26 15:29:19.831525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:28.519 15:29:19 -- accel/accel.sh@21 -- # val= 00:05:28.519 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.519 15:29:19 -- accel/accel.sh@21 -- # val= 00:05:28.519 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.519 15:29:19 -- accel/accel.sh@21 -- # val=0x1 00:05:28.519 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.519 15:29:19 -- accel/accel.sh@21 -- # val= 00:05:28.519 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.519 15:29:19 -- accel/accel.sh@21 -- # val= 00:05:28.519 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.519 15:29:19 -- accel/accel.sh@21 -- # val=dif_verify 00:05:28.519 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.519 15:29:19 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.519 15:29:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:28.519 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.519 15:29:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:28.519 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.519 15:29:19 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:28.519 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.519 15:29:19 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:28.519 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.519 15:29:19 -- accel/accel.sh@21 -- # val= 00:05:28.519 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.519 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.520 15:29:19 -- accel/accel.sh@21 -- # val=software 00:05:28.520 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.520 15:29:19 -- accel/accel.sh@23 -- # accel_module=software 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.520 15:29:19 -- accel/accel.sh@21 -- # val=32 00:05:28.520 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.520 15:29:19 -- accel/accel.sh@21 -- # val=32 00:05:28.520 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.520 15:29:19 -- accel/accel.sh@21 -- # val=1 00:05:28.520 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.520 15:29:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:28.520 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.520 15:29:19 -- accel/accel.sh@21 -- # val=No 00:05:28.520 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.520 15:29:19 -- accel/accel.sh@21 -- # val= 00:05:28.520 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.520 15:29:19 -- accel/accel.sh@21 -- # val= 00:05:28.520 15:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.520 15:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:29.943 15:29:21 -- accel/accel.sh@21 -- # val= 00:05:29.944 15:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.944 15:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:29.944 15:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:29.944 15:29:21 -- accel/accel.sh@21 -- # val= 00:05:29.944 15:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.944 15:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:29.944 15:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:29.944 15:29:21 -- accel/accel.sh@21 -- # val= 00:05:29.944 15:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.944 15:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:29.944 15:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:29.944 15:29:21 -- accel/accel.sh@21 -- # val= 00:05:29.944 15:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.944 15:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:29.944 15:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:29.944 15:29:21 -- accel/accel.sh@21 -- # val= 00:05:29.944 15:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.944 15:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:29.944 15:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:29.944 15:29:21 -- accel/accel.sh@21 -- # val= 00:05:29.944 15:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.944 15:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:29.944 15:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:29.944 15:29:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:29.944 15:29:21 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:05:29.944 15:29:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:29.944 00:05:29.944 real 0m2.971s 00:05:29.944 user 0m2.669s 00:05:29.944 sys 0m0.294s 00:05:29.944 15:29:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.944 15:29:21 -- common/autotest_common.sh@10 -- # set +x 00:05:29.944 ************************************ 00:05:29.944 END TEST accel_dif_verify 00:05:29.944 ************************************ 00:05:29.944 15:29:21 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:05:29.944 15:29:21 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:29.944 15:29:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.944 15:29:21 -- common/autotest_common.sh@10 -- # set +x 00:05:29.944 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:29.944 ************************************ 00:05:29.944 START TEST accel_dif_generate 00:05:29.944 ************************************ 00:05:29.944 15:29:21 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:05:29.944 15:29:21 -- accel/accel.sh@16 -- # local accel_opc 00:05:29.944 15:29:21 -- accel/accel.sh@17 -- # local accel_module 00:05:29.944 15:29:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:05:29.944 15:29:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:29.944 15:29:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:29.944 15:29:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:29.944 15:29:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:29.944 15:29:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:29.944 15:29:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:29.944 15:29:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:29.944 15:29:21 -- accel/accel.sh@41 -- # local IFS=, 00:05:29.944 15:29:21 -- accel/accel.sh@42 -- # jq -r . 00:05:29.944 [2024-11-26 15:29:21.161421] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.944 [2024-11-26 15:29:21.161501] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid761234 ] 00:05:29.944 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.944 [2024-11-26 15:29:21.224078] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.944 [2024-11-26 15:29:21.345171] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.323 15:29:22 -- accel/accel.sh@18 -- # out=' 00:05:31.323 SPDK Configuration: 00:05:31.323 Core mask: 0x1 00:05:31.323 00:05:31.323 Accel Perf Configuration: 00:05:31.323 Workload Type: dif_generate 00:05:31.323 Vector size: 4096 bytes 00:05:31.323 Transfer size: 4096 bytes 00:05:31.323 Block size: 512 bytes 00:05:31.323 Metadata size: 8 bytes 00:05:31.323 Vector count 1 00:05:31.323 Module: software 00:05:31.323 Queue depth: 32 00:05:31.323 Allocate depth: 32 00:05:31.323 # threads/core: 1 00:05:31.323 Run time: 1 seconds 00:05:31.323 Verify: No 00:05:31.323 00:05:31.323 Running for 1 seconds... 00:05:31.323 00:05:31.323 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:31.323 ------------------------------------------------------------------------------------ 00:05:31.323 0,0 96160/s 381 MiB/s 0 0 00:05:31.323 ==================================================================================== 00:05:31.323 Total 96160/s 375 MiB/s 0 0' 00:05:31.323 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.323 15:29:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:05:31.323 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.323 15:29:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:31.323 15:29:22 -- accel/accel.sh@12 -- # build_accel_config 00:05:31.323 15:29:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:31.323 15:29:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:31.323 15:29:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:31.323 15:29:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:31.323 15:29:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:31.323 15:29:22 -- accel/accel.sh@41 -- # local IFS=, 00:05:31.323 15:29:22 -- accel/accel.sh@42 -- # jq -r . 00:05:31.323 [2024-11-26 15:29:22.634221] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.323 [2024-11-26 15:29:22.634315] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid761374 ] 00:05:31.323 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.324 [2024-11-26 15:29:22.696026] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.584 [2024-11-26 15:29:22.815518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val= 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val= 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val=0x1 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val= 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val= 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val=dif_generate 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val= 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val=software 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@23 -- # accel_module=software 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val=32 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val=32 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val=1 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val=No 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val= 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.584 15:29:22 -- accel/accel.sh@21 -- # val= 00:05:31.584 15:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.584 15:29:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.965 15:29:24 -- accel/accel.sh@21 -- # val= 00:05:32.965 15:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.965 15:29:24 -- accel/accel.sh@20 -- # IFS=: 00:05:32.965 15:29:24 -- accel/accel.sh@20 -- # read -r var val 00:05:32.965 15:29:24 -- accel/accel.sh@21 -- # val= 00:05:32.965 15:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.965 15:29:24 -- accel/accel.sh@20 -- # IFS=: 00:05:32.965 15:29:24 -- accel/accel.sh@20 -- # read -r var val 00:05:32.965 15:29:24 -- accel/accel.sh@21 -- # val= 00:05:32.965 15:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.965 15:29:24 -- accel/accel.sh@20 -- # IFS=: 00:05:32.966 15:29:24 -- accel/accel.sh@20 -- # read -r var val 00:05:32.966 15:29:24 -- accel/accel.sh@21 -- # val= 00:05:32.966 15:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.966 15:29:24 -- accel/accel.sh@20 -- # IFS=: 00:05:32.966 15:29:24 -- accel/accel.sh@20 -- # read -r var val 00:05:32.966 15:29:24 -- accel/accel.sh@21 -- # val= 00:05:32.966 15:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.966 15:29:24 -- accel/accel.sh@20 -- # IFS=: 00:05:32.966 15:29:24 -- accel/accel.sh@20 -- # read -r var val 00:05:32.966 15:29:24 -- accel/accel.sh@21 -- # val= 00:05:32.966 15:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.966 15:29:24 -- accel/accel.sh@20 -- # IFS=: 00:05:32.966 15:29:24 -- accel/accel.sh@20 -- # read -r var val 00:05:32.966 15:29:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:32.966 15:29:24 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:05:32.966 15:29:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:32.966 00:05:32.966 real 0m2.959s 00:05:32.966 user 0m2.664s 00:05:32.966 sys 0m0.289s 00:05:32.966 15:29:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.966 15:29:24 -- common/autotest_common.sh@10 -- # set +x 00:05:32.966 ************************************ 00:05:32.966 END TEST accel_dif_generate 00:05:32.966 ************************************ 00:05:32.966 15:29:24 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:05:32.966 15:29:24 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:32.966 15:29:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.966 15:29:24 -- common/autotest_common.sh@10 -- # set +x 00:05:32.966 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:32.966 ************************************ 00:05:32.966 START TEST accel_dif_generate_copy 00:05:32.966 ************************************ 00:05:32.966 15:29:24 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:05:32.966 15:29:24 -- accel/accel.sh@16 -- # local accel_opc 00:05:32.966 15:29:24 -- accel/accel.sh@17 -- # local accel_module 00:05:32.966 15:29:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:05:32.966 15:29:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:32.966 15:29:24 -- accel/accel.sh@12 -- # build_accel_config 00:05:32.966 15:29:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:32.966 15:29:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:32.966 15:29:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:32.966 15:29:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:32.966 15:29:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:32.966 15:29:24 -- accel/accel.sh@41 -- # local IFS=, 00:05:32.966 15:29:24 -- accel/accel.sh@42 -- # jq -r . 00:05:32.966 [2024-11-26 15:29:24.143812] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.966 [2024-11-26 15:29:24.143901] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid761523 ] 00:05:32.966 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.966 [2024-11-26 15:29:24.204674] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.966 [2024-11-26 15:29:24.324128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.343 15:29:25 -- accel/accel.sh@18 -- # out=' 00:05:34.343 SPDK Configuration: 00:05:34.343 Core mask: 0x1 00:05:34.343 00:05:34.343 Accel Perf Configuration: 00:05:34.343 Workload Type: dif_generate_copy 00:05:34.343 Vector size: 4096 bytes 00:05:34.343 Transfer size: 4096 bytes 00:05:34.343 Vector count 1 00:05:34.343 Module: software 00:05:34.343 Queue depth: 32 00:05:34.343 Allocate depth: 32 00:05:34.343 # threads/core: 1 00:05:34.343 Run time: 1 seconds 00:05:34.343 Verify: No 00:05:34.343 00:05:34.343 Running for 1 seconds... 00:05:34.343 00:05:34.343 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:34.343 ------------------------------------------------------------------------------------ 00:05:34.343 0,0 76256/s 302 MiB/s 0 0 00:05:34.343 ==================================================================================== 00:05:34.343 Total 76256/s 297 MiB/s 0 0' 00:05:34.343 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.343 15:29:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:05:34.343 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.343 15:29:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:34.343 15:29:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:34.343 15:29:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.343 15:29:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.343 15:29:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.343 15:29:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.343 15:29:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.343 15:29:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.343 15:29:25 -- accel/accel.sh@42 -- # jq -r . 00:05:34.343 [2024-11-26 15:29:25.626699] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:34.343 [2024-11-26 15:29:25.626795] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid761774 ] 00:05:34.343 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.343 [2024-11-26 15:29:25.689401] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.603 [2024-11-26 15:29:25.807929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val= 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val= 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val=0x1 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val= 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val= 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val= 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val=software 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@23 -- # accel_module=software 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val=32 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val=32 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val=1 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val=No 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val= 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.603 15:29:25 -- accel/accel.sh@21 -- # val= 00:05:34.603 15:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.603 15:29:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.986 15:29:27 -- accel/accel.sh@21 -- # val= 00:05:35.986 15:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.986 15:29:27 -- accel/accel.sh@20 -- # IFS=: 00:05:35.986 15:29:27 -- accel/accel.sh@20 -- # read -r var val 00:05:35.986 15:29:27 -- accel/accel.sh@21 -- # val= 00:05:35.986 15:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.986 15:29:27 -- accel/accel.sh@20 -- # IFS=: 00:05:35.986 15:29:27 -- accel/accel.sh@20 -- # read -r var val 00:05:35.986 15:29:27 -- accel/accel.sh@21 -- # val= 00:05:35.986 15:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.986 15:29:27 -- accel/accel.sh@20 -- # IFS=: 00:05:35.986 15:29:27 -- accel/accel.sh@20 -- # read -r var val 00:05:35.986 15:29:27 -- accel/accel.sh@21 -- # val= 00:05:35.986 15:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.986 15:29:27 -- accel/accel.sh@20 -- # IFS=: 00:05:35.986 15:29:27 -- accel/accel.sh@20 -- # read -r var val 00:05:35.986 15:29:27 -- accel/accel.sh@21 -- # val= 00:05:35.986 15:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.986 15:29:27 -- accel/accel.sh@20 -- # IFS=: 00:05:35.986 15:29:27 -- accel/accel.sh@20 -- # read -r var val 00:05:35.986 15:29:27 -- accel/accel.sh@21 -- # val= 00:05:35.986 15:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.986 15:29:27 -- accel/accel.sh@20 -- # IFS=: 00:05:35.986 15:29:27 -- accel/accel.sh@20 -- # read -r var val 00:05:35.986 15:29:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:35.986 15:29:27 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:05:35.986 15:29:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:35.986 00:05:35.986 real 0m2.956s 00:05:35.986 user 0m2.665s 00:05:35.986 sys 0m0.282s 00:05:35.986 15:29:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.986 15:29:27 -- common/autotest_common.sh@10 -- # set +x 00:05:35.986 ************************************ 00:05:35.986 END TEST accel_dif_generate_copy 00:05:35.986 ************************************ 00:05:35.986 15:29:27 -- accel/accel.sh@107 -- # [[ y == y ]] 00:05:35.986 15:29:27 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:35.986 15:29:27 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:35.986 15:29:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.986 15:29:27 -- common/autotest_common.sh@10 -- # set +x 00:05:35.986 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:35.986 ************************************ 00:05:35.986 START TEST accel_comp 00:05:35.986 ************************************ 00:05:35.986 15:29:27 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:35.986 15:29:27 -- accel/accel.sh@16 -- # local accel_opc 00:05:35.986 15:29:27 -- accel/accel.sh@17 -- # local accel_module 00:05:35.986 15:29:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:35.986 15:29:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:35.986 15:29:27 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.986 15:29:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.986 15:29:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.986 15:29:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.986 15:29:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.986 15:29:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.986 15:29:27 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.986 15:29:27 -- accel/accel.sh@42 -- # jq -r . 00:05:35.986 [2024-11-26 15:29:27.122610] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.986 [2024-11-26 15:29:27.122702] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid761932 ] 00:05:35.986 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.986 [2024-11-26 15:29:27.183162] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.986 [2024-11-26 15:29:27.301628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.365 15:29:28 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:37.365 00:05:37.365 SPDK Configuration: 00:05:37.365 Core mask: 0x1 00:05:37.365 00:05:37.365 Accel Perf Configuration: 00:05:37.365 Workload Type: compress 00:05:37.365 Transfer size: 4096 bytes 00:05:37.365 Vector count 1 00:05:37.365 Module: software 00:05:37.365 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:37.365 Queue depth: 32 00:05:37.365 Allocate depth: 32 00:05:37.365 # threads/core: 1 00:05:37.365 Run time: 1 seconds 00:05:37.365 Verify: No 00:05:37.365 00:05:37.365 Running for 1 seconds... 00:05:37.365 00:05:37.365 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:37.365 ------------------------------------------------------------------------------------ 00:05:37.365 0,0 31520/s 131 MiB/s 0 0 00:05:37.365 ==================================================================================== 00:05:37.365 Total 31520/s 123 MiB/s 0 0' 00:05:37.365 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.365 15:29:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:37.365 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.365 15:29:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:37.365 15:29:28 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.365 15:29:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.365 15:29:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.365 15:29:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.365 15:29:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.365 15:29:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.365 15:29:28 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.365 15:29:28 -- accel/accel.sh@42 -- # jq -r . 00:05:37.365 [2024-11-26 15:29:28.609743] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:37.365 [2024-11-26 15:29:28.609841] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid762065 ] 00:05:37.365 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.365 [2024-11-26 15:29:28.671452] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.365 [2024-11-26 15:29:28.790565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.624 15:29:28 -- accel/accel.sh@21 -- # val= 00:05:37.624 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.624 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.624 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.624 15:29:28 -- accel/accel.sh@21 -- # val= 00:05:37.624 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.624 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.624 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.624 15:29:28 -- accel/accel.sh@21 -- # val= 00:05:37.624 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.624 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.624 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.624 15:29:28 -- accel/accel.sh@21 -- # val=0x1 00:05:37.624 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.624 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.624 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.624 15:29:28 -- accel/accel.sh@21 -- # val= 00:05:37.624 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.624 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.624 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.624 15:29:28 -- accel/accel.sh@21 -- # val= 00:05:37.624 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.624 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.624 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.625 15:29:28 -- accel/accel.sh@21 -- # val=compress 00:05:37.625 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.625 15:29:28 -- accel/accel.sh@24 -- # accel_opc=compress 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.625 15:29:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:37.625 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.625 15:29:28 -- accel/accel.sh@21 -- # val= 00:05:37.625 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.625 15:29:28 -- accel/accel.sh@21 -- # val=software 00:05:37.625 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.625 15:29:28 -- accel/accel.sh@23 -- # accel_module=software 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.625 15:29:28 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:37.625 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.625 15:29:28 -- accel/accel.sh@21 -- # val=32 00:05:37.625 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.625 15:29:28 -- accel/accel.sh@21 -- # val=32 00:05:37.625 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.625 15:29:28 -- accel/accel.sh@21 -- # val=1 00:05:37.625 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.625 15:29:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:37.625 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.625 15:29:28 -- accel/accel.sh@21 -- # val=No 00:05:37.625 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.625 15:29:28 -- accel/accel.sh@21 -- # val= 00:05:37.625 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.625 15:29:28 -- accel/accel.sh@21 -- # val= 00:05:37.625 15:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.625 15:29:28 -- accel/accel.sh@20 -- # read -r var val 00:05:39.005 15:29:30 -- accel/accel.sh@21 -- # val= 00:05:39.005 15:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.005 15:29:30 -- accel/accel.sh@20 -- # IFS=: 00:05:39.005 15:29:30 -- accel/accel.sh@20 -- # read -r var val 00:05:39.005 15:29:30 -- accel/accel.sh@21 -- # val= 00:05:39.005 15:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.005 15:29:30 -- accel/accel.sh@20 -- # IFS=: 00:05:39.005 15:29:30 -- accel/accel.sh@20 -- # read -r var val 00:05:39.005 15:29:30 -- accel/accel.sh@21 -- # val= 00:05:39.005 15:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.005 15:29:30 -- accel/accel.sh@20 -- # IFS=: 00:05:39.005 15:29:30 -- accel/accel.sh@20 -- # read -r var val 00:05:39.005 15:29:30 -- accel/accel.sh@21 -- # val= 00:05:39.005 15:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.005 15:29:30 -- accel/accel.sh@20 -- # IFS=: 00:05:39.005 15:29:30 -- accel/accel.sh@20 -- # read -r var val 00:05:39.005 15:29:30 -- accel/accel.sh@21 -- # val= 00:05:39.005 15:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.005 15:29:30 -- accel/accel.sh@20 -- # IFS=: 00:05:39.005 15:29:30 -- accel/accel.sh@20 -- # read -r var val 00:05:39.005 15:29:30 -- accel/accel.sh@21 -- # val= 00:05:39.005 15:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.005 15:29:30 -- accel/accel.sh@20 -- # IFS=: 00:05:39.005 15:29:30 -- accel/accel.sh@20 -- # read -r var val 00:05:39.005 15:29:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:39.005 15:29:30 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:05:39.005 15:29:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:39.005 00:05:39.005 real 0m2.968s 00:05:39.005 user 0m2.681s 00:05:39.005 sys 0m0.279s 00:05:39.005 15:29:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.005 15:29:30 -- common/autotest_common.sh@10 -- # set +x 00:05:39.005 ************************************ 00:05:39.005 END TEST accel_comp 00:05:39.005 ************************************ 00:05:39.005 15:29:30 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:39.005 15:29:30 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:39.005 15:29:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.005 15:29:30 -- common/autotest_common.sh@10 -- # set +x 00:05:39.005 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:39.005 ************************************ 00:05:39.005 START TEST accel_decomp 00:05:39.005 ************************************ 00:05:39.005 15:29:30 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:39.005 15:29:30 -- accel/accel.sh@16 -- # local accel_opc 00:05:39.005 15:29:30 -- accel/accel.sh@17 -- # local accel_module 00:05:39.005 15:29:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:39.005 15:29:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:39.005 15:29:30 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.005 15:29:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.005 15:29:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.005 15:29:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.005 15:29:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.005 15:29:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.005 15:29:30 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.005 15:29:30 -- accel/accel.sh@42 -- # jq -r . 00:05:39.005 [2024-11-26 15:29:30.117265] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.005 [2024-11-26 15:29:30.117346] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid762333 ] 00:05:39.005 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.005 [2024-11-26 15:29:30.180572] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.005 [2024-11-26 15:29:30.299619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.382 15:29:31 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:40.382 00:05:40.382 SPDK Configuration: 00:05:40.382 Core mask: 0x1 00:05:40.382 00:05:40.382 Accel Perf Configuration: 00:05:40.382 Workload Type: decompress 00:05:40.382 Transfer size: 4096 bytes 00:05:40.382 Vector count 1 00:05:40.382 Module: software 00:05:40.382 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:40.382 Queue depth: 32 00:05:40.382 Allocate depth: 32 00:05:40.382 # threads/core: 1 00:05:40.382 Run time: 1 seconds 00:05:40.382 Verify: Yes 00:05:40.382 00:05:40.382 Running for 1 seconds... 00:05:40.382 00:05:40.382 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:40.382 ------------------------------------------------------------------------------------ 00:05:40.382 0,0 55424/s 102 MiB/s 0 0 00:05:40.382 ==================================================================================== 00:05:40.382 Total 55424/s 216 MiB/s 0 0' 00:05:40.382 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.382 15:29:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:40.382 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.382 15:29:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:40.382 15:29:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.382 15:29:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.382 15:29:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.382 15:29:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.382 15:29:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.382 15:29:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.382 15:29:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.382 15:29:31 -- accel/accel.sh@42 -- # jq -r . 00:05:40.382 [2024-11-26 15:29:31.599186] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.382 [2024-11-26 15:29:31.599289] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid762469 ] 00:05:40.382 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.382 [2024-11-26 15:29:31.662072] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.382 [2024-11-26 15:29:31.780886] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val= 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val= 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val= 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val=0x1 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val= 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val= 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val=decompress 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val= 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val=software 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@23 -- # accel_module=software 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val=32 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val=32 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val=1 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val=Yes 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val= 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.642 15:29:31 -- accel/accel.sh@21 -- # val= 00:05:40.642 15:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.642 15:29:31 -- accel/accel.sh@20 -- # read -r var val 00:05:42.020 15:29:33 -- accel/accel.sh@21 -- # val= 00:05:42.020 15:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.020 15:29:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.020 15:29:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.020 15:29:33 -- accel/accel.sh@21 -- # val= 00:05:42.020 15:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.020 15:29:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.020 15:29:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.020 15:29:33 -- accel/accel.sh@21 -- # val= 00:05:42.020 15:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.020 15:29:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.020 15:29:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.020 15:29:33 -- accel/accel.sh@21 -- # val= 00:05:42.020 15:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.020 15:29:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.020 15:29:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.020 15:29:33 -- accel/accel.sh@21 -- # val= 00:05:42.020 15:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.020 15:29:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.020 15:29:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.020 15:29:33 -- accel/accel.sh@21 -- # val= 00:05:42.020 15:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.020 15:29:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.020 15:29:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.020 15:29:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:42.020 15:29:33 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:42.020 15:29:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:42.020 00:05:42.020 real 0m2.957s 00:05:42.020 user 0m2.652s 00:05:42.020 sys 0m0.296s 00:05:42.020 15:29:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.020 15:29:33 -- common/autotest_common.sh@10 -- # set +x 00:05:42.020 ************************************ 00:05:42.020 END TEST accel_decomp 00:05:42.020 ************************************ 00:05:42.020 15:29:33 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:42.020 15:29:33 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:42.020 15:29:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.020 15:29:33 -- common/autotest_common.sh@10 -- # set +x 00:05:42.020 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:42.020 ************************************ 00:05:42.020 START TEST accel_decmop_full 00:05:42.020 ************************************ 00:05:42.020 15:29:33 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:42.020 15:29:33 -- accel/accel.sh@16 -- # local accel_opc 00:05:42.020 15:29:33 -- accel/accel.sh@17 -- # local accel_module 00:05:42.020 15:29:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:42.020 15:29:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:42.020 15:29:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.020 15:29:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.020 15:29:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.020 15:29:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.020 15:29:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.020 15:29:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.020 15:29:33 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.020 15:29:33 -- accel/accel.sh@42 -- # jq -r . 00:05:42.020 [2024-11-26 15:29:33.099391] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.020 [2024-11-26 15:29:33.099482] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid762624 ] 00:05:42.020 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.020 [2024-11-26 15:29:33.166284] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.020 [2024-11-26 15:29:33.286578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.401 15:29:34 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:43.401 00:05:43.401 SPDK Configuration: 00:05:43.401 Core mask: 0x1 00:05:43.401 00:05:43.401 Accel Perf Configuration: 00:05:43.401 Workload Type: decompress 00:05:43.401 Transfer size: 111250 bytes 00:05:43.401 Vector count 1 00:05:43.401 Module: software 00:05:43.401 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:43.401 Queue depth: 32 00:05:43.401 Allocate depth: 32 00:05:43.401 # threads/core: 1 00:05:43.401 Run time: 1 seconds 00:05:43.401 Verify: Yes 00:05:43.401 00:05:43.401 Running for 1 seconds... 00:05:43.401 00:05:43.401 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:43.401 ------------------------------------------------------------------------------------ 00:05:43.401 0,0 3808/s 157 MiB/s 0 0 00:05:43.401 ==================================================================================== 00:05:43.401 Total 3808/s 404 MiB/s 0 0' 00:05:43.401 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.401 15:29:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:43.401 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.401 15:29:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:43.401 15:29:34 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.401 15:29:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.401 15:29:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.401 15:29:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.401 15:29:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.401 15:29:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.401 15:29:34 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.401 15:29:34 -- accel/accel.sh@42 -- # jq -r . 00:05:43.401 [2024-11-26 15:29:34.600968] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:43.401 [2024-11-26 15:29:34.601067] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid762875 ] 00:05:43.401 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.401 [2024-11-26 15:29:34.666809] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.401 [2024-11-26 15:29:34.786459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.661 15:29:34 -- accel/accel.sh@21 -- # val= 00:05:43.661 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.661 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.661 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.661 15:29:34 -- accel/accel.sh@21 -- # val= 00:05:43.661 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.661 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.661 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.661 15:29:34 -- accel/accel.sh@21 -- # val= 00:05:43.661 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.661 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.661 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.661 15:29:34 -- accel/accel.sh@21 -- # val=0x1 00:05:43.661 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.662 15:29:34 -- accel/accel.sh@21 -- # val= 00:05:43.662 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.662 15:29:34 -- accel/accel.sh@21 -- # val= 00:05:43.662 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.662 15:29:34 -- accel/accel.sh@21 -- # val=decompress 00:05:43.662 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.662 15:29:34 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:43.662 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.662 15:29:34 -- accel/accel.sh@21 -- # val= 00:05:43.662 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.662 15:29:34 -- accel/accel.sh@21 -- # val=software 00:05:43.662 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@23 -- # accel_module=software 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.662 15:29:34 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:43.662 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.662 15:29:34 -- accel/accel.sh@21 -- # val=32 00:05:43.662 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.662 15:29:34 -- accel/accel.sh@21 -- # val=32 00:05:43.662 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.662 15:29:34 -- accel/accel.sh@21 -- # val=1 00:05:43.662 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.662 15:29:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:43.662 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.662 15:29:34 -- accel/accel.sh@21 -- # val=Yes 00:05:43.662 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.662 15:29:34 -- accel/accel.sh@21 -- # val= 00:05:43.662 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.662 15:29:34 -- accel/accel.sh@21 -- # val= 00:05:43.662 15:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.662 15:29:34 -- accel/accel.sh@20 -- # read -r var val 00:05:45.042 15:29:36 -- accel/accel.sh@21 -- # val= 00:05:45.042 15:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.042 15:29:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.042 15:29:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.042 15:29:36 -- accel/accel.sh@21 -- # val= 00:05:45.042 15:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.042 15:29:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.042 15:29:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.042 15:29:36 -- accel/accel.sh@21 -- # val= 00:05:45.042 15:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.042 15:29:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.042 15:29:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.042 15:29:36 -- accel/accel.sh@21 -- # val= 00:05:45.042 15:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.042 15:29:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.042 15:29:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.043 15:29:36 -- accel/accel.sh@21 -- # val= 00:05:45.043 15:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.043 15:29:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.043 15:29:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.043 15:29:36 -- accel/accel.sh@21 -- # val= 00:05:45.043 15:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.043 15:29:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.043 15:29:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.043 15:29:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:45.043 15:29:36 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:45.043 15:29:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:45.043 00:05:45.043 real 0m3.009s 00:05:45.043 user 0m2.712s 00:05:45.043 sys 0m0.288s 00:05:45.043 15:29:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.043 15:29:36 -- common/autotest_common.sh@10 -- # set +x 00:05:45.043 ************************************ 00:05:45.043 END TEST accel_decmop_full 00:05:45.043 ************************************ 00:05:45.043 15:29:36 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:45.043 15:29:36 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:45.043 15:29:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.043 15:29:36 -- common/autotest_common.sh@10 -- # set +x 00:05:45.043 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:45.043 ************************************ 00:05:45.043 START TEST accel_decomp_mcore 00:05:45.043 ************************************ 00:05:45.043 15:29:36 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:45.043 15:29:36 -- accel/accel.sh@16 -- # local accel_opc 00:05:45.043 15:29:36 -- accel/accel.sh@17 -- # local accel_module 00:05:45.043 15:29:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:45.043 15:29:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:45.043 15:29:36 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.043 15:29:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.043 15:29:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.043 15:29:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.043 15:29:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.043 15:29:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.043 15:29:36 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.043 15:29:36 -- accel/accel.sh@42 -- # jq -r . 00:05:45.043 [2024-11-26 15:29:36.134008] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.043 [2024-11-26 15:29:36.134098] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid763026 ] 00:05:45.043 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.043 [2024-11-26 15:29:36.199937] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:45.043 [2024-11-26 15:29:36.324225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:45.043 [2024-11-26 15:29:36.324281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:45.043 [2024-11-26 15:29:36.324334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:45.043 [2024-11-26 15:29:36.324337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:46.423 15:29:37 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:46.423 00:05:46.423 SPDK Configuration: 00:05:46.423 Core mask: 0xf 00:05:46.423 00:05:46.423 Accel Perf Configuration: 00:05:46.423 Workload Type: decompress 00:05:46.423 Transfer size: 4096 bytes 00:05:46.423 Vector count 1 00:05:46.423 Module: software 00:05:46.423 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:46.423 Queue depth: 32 00:05:46.423 Allocate depth: 32 00:05:46.423 # threads/core: 1 00:05:46.423 Run time: 1 seconds 00:05:46.423 Verify: Yes 00:05:46.423 00:05:46.423 Running for 1 seconds... 00:05:46.423 00:05:46.423 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:46.423 ------------------------------------------------------------------------------------ 00:05:46.423 0,0 49984/s 92 MiB/s 0 0 00:05:46.423 3,0 50592/s 93 MiB/s 0 0 00:05:46.423 2,0 50464/s 92 MiB/s 0 0 00:05:46.423 1,0 50336/s 92 MiB/s 0 0 00:05:46.423 ==================================================================================== 00:05:46.423 Total 201376/s 786 MiB/s 0 0' 00:05:46.423 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.423 15:29:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:46.423 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.423 15:29:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:46.423 15:29:37 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.423 15:29:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.423 15:29:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.423 15:29:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.423 15:29:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.423 15:29:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.423 15:29:37 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.423 15:29:37 -- accel/accel.sh@42 -- # jq -r . 00:05:46.423 [2024-11-26 15:29:37.637502] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:46.423 [2024-11-26 15:29:37.637591] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid763168 ] 00:05:46.423 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.423 [2024-11-26 15:29:37.699828] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:46.423 [2024-11-26 15:29:37.820378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:46.423 [2024-11-26 15:29:37.820434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:46.423 [2024-11-26 15:29:37.820484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:46.423 [2024-11-26 15:29:37.820487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val= 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val= 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val= 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val=0xf 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val= 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val= 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val=decompress 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val= 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val=software 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@23 -- # accel_module=software 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val=32 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val=32 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val=1 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val=Yes 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val= 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.683 15:29:37 -- accel/accel.sh@21 -- # val= 00:05:46.683 15:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.683 15:29:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.668 15:29:39 -- accel/accel.sh@21 -- # val= 00:05:47.668 15:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:47.668 15:29:39 -- accel/accel.sh@21 -- # val= 00:05:47.668 15:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:47.668 15:29:39 -- accel/accel.sh@21 -- # val= 00:05:47.668 15:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:47.668 15:29:39 -- accel/accel.sh@21 -- # val= 00:05:47.668 15:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:47.668 15:29:39 -- accel/accel.sh@21 -- # val= 00:05:47.668 15:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:47.668 15:29:39 -- accel/accel.sh@21 -- # val= 00:05:47.668 15:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:47.668 15:29:39 -- accel/accel.sh@21 -- # val= 00:05:47.668 15:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:47.668 15:29:39 -- accel/accel.sh@21 -- # val= 00:05:47.668 15:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:47.668 15:29:39 -- accel/accel.sh@21 -- # val= 00:05:47.668 15:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # IFS=: 00:05:47.668 15:29:39 -- accel/accel.sh@20 -- # read -r var val 00:05:47.668 15:29:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:47.668 15:29:39 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:47.668 15:29:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:47.668 00:05:47.668 real 0m2.985s 00:05:47.668 user 0m9.583s 00:05:47.668 sys 0m0.308s 00:05:47.668 15:29:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:47.668 15:29:39 -- common/autotest_common.sh@10 -- # set +x 00:05:47.668 ************************************ 00:05:47.668 END TEST accel_decomp_mcore 00:05:47.668 ************************************ 00:05:47.941 15:29:39 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:47.941 15:29:39 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:47.941 15:29:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:47.941 15:29:39 -- common/autotest_common.sh@10 -- # set +x 00:05:47.941 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:47.941 ************************************ 00:05:47.941 START TEST accel_decomp_full_mcore 00:05:47.941 ************************************ 00:05:47.941 15:29:39 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:47.941 15:29:39 -- accel/accel.sh@16 -- # local accel_opc 00:05:47.941 15:29:39 -- accel/accel.sh@17 -- # local accel_module 00:05:47.941 15:29:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:47.941 15:29:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:47.941 15:29:39 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.941 15:29:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.941 15:29:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.941 15:29:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.941 15:29:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.941 15:29:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.941 15:29:39 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.941 15:29:39 -- accel/accel.sh@42 -- # jq -r . 00:05:47.941 [2024-11-26 15:29:39.146541] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:47.941 [2024-11-26 15:29:39.146631] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid763440 ] 00:05:47.941 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.941 [2024-11-26 15:29:39.214170] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:47.941 [2024-11-26 15:29:39.337641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:47.941 [2024-11-26 15:29:39.337744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.941 [2024-11-26 15:29:39.337740] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:47.942 [2024-11-26 15:29:39.337700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:49.320 15:29:40 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:49.320 00:05:49.320 SPDK Configuration: 00:05:49.320 Core mask: 0xf 00:05:49.320 00:05:49.320 Accel Perf Configuration: 00:05:49.320 Workload Type: decompress 00:05:49.320 Transfer size: 111250 bytes 00:05:49.320 Vector count 1 00:05:49.320 Module: software 00:05:49.320 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:49.320 Queue depth: 32 00:05:49.320 Allocate depth: 32 00:05:49.320 # threads/core: 1 00:05:49.320 Run time: 1 seconds 00:05:49.320 Verify: Yes 00:05:49.320 00:05:49.320 Running for 1 seconds... 00:05:49.320 00:05:49.320 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:49.320 ------------------------------------------------------------------------------------ 00:05:49.320 0,0 3776/s 155 MiB/s 0 0 00:05:49.320 3,0 3776/s 155 MiB/s 0 0 00:05:49.320 2,0 3744/s 154 MiB/s 0 0 00:05:49.320 1,0 3776/s 155 MiB/s 0 0 00:05:49.320 ==================================================================================== 00:05:49.320 Total 15072/s 1599 MiB/s 0 0' 00:05:49.320 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.320 15:29:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:49.320 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.320 15:29:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:49.320 15:29:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.320 15:29:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.320 15:29:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.320 15:29:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.320 15:29:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.320 15:29:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.320 15:29:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.320 15:29:40 -- accel/accel.sh@42 -- # jq -r . 00:05:49.320 [2024-11-26 15:29:40.664543] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:49.320 [2024-11-26 15:29:40.664639] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid763575 ] 00:05:49.320 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.320 [2024-11-26 15:29:40.727723] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:49.581 [2024-11-26 15:29:40.849320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:49.581 [2024-11-26 15:29:40.849428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:49.581 [2024-11-26 15:29:40.849374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:49.581 [2024-11-26 15:29:40.849432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val= 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val= 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val= 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val=0xf 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val= 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val= 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val=decompress 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val= 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val=software 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@23 -- # accel_module=software 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val=32 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val=32 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val=1 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val=Yes 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val= 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.581 15:29:40 -- accel/accel.sh@21 -- # val= 00:05:49.581 15:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.581 15:29:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.959 15:29:42 -- accel/accel.sh@21 -- # val= 00:05:50.959 15:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:50.959 15:29:42 -- accel/accel.sh@21 -- # val= 00:05:50.959 15:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:50.959 15:29:42 -- accel/accel.sh@21 -- # val= 00:05:50.959 15:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:50.959 15:29:42 -- accel/accel.sh@21 -- # val= 00:05:50.959 15:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:50.959 15:29:42 -- accel/accel.sh@21 -- # val= 00:05:50.959 15:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:50.959 15:29:42 -- accel/accel.sh@21 -- # val= 00:05:50.959 15:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:50.959 15:29:42 -- accel/accel.sh@21 -- # val= 00:05:50.959 15:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:50.959 15:29:42 -- accel/accel.sh@21 -- # val= 00:05:50.959 15:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:50.959 15:29:42 -- accel/accel.sh@21 -- # val= 00:05:50.959 15:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # IFS=: 00:05:50.959 15:29:42 -- accel/accel.sh@20 -- # read -r var val 00:05:50.959 15:29:42 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:50.959 15:29:42 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:50.959 15:29:42 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:50.959 00:05:50.959 real 0m3.036s 00:05:50.959 user 0m9.748s 00:05:50.959 sys 0m0.316s 00:05:50.959 15:29:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.959 15:29:42 -- common/autotest_common.sh@10 -- # set +x 00:05:50.959 ************************************ 00:05:50.959 END TEST accel_decomp_full_mcore 00:05:50.959 ************************************ 00:05:50.959 15:29:42 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:50.959 15:29:42 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:50.959 15:29:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.959 15:29:42 -- common/autotest_common.sh@10 -- # set +x 00:05:50.959 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:50.959 ************************************ 00:05:50.959 START TEST accel_decomp_mthread 00:05:50.959 ************************************ 00:05:50.959 15:29:42 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:50.959 15:29:42 -- accel/accel.sh@16 -- # local accel_opc 00:05:50.959 15:29:42 -- accel/accel.sh@17 -- # local accel_module 00:05:50.959 15:29:42 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:50.959 15:29:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:50.959 15:29:42 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.959 15:29:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.959 15:29:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.959 15:29:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.959 15:29:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.959 15:29:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.959 15:29:42 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.959 15:29:42 -- accel/accel.sh@42 -- # jq -r . 00:05:50.959 [2024-11-26 15:29:42.208201] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.959 [2024-11-26 15:29:42.208295] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid763732 ] 00:05:50.959 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.959 [2024-11-26 15:29:42.274660] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.959 [2024-11-26 15:29:42.397356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.342 15:29:43 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:52.342 00:05:52.342 SPDK Configuration: 00:05:52.342 Core mask: 0x1 00:05:52.342 00:05:52.342 Accel Perf Configuration: 00:05:52.342 Workload Type: decompress 00:05:52.342 Transfer size: 4096 bytes 00:05:52.342 Vector count 1 00:05:52.342 Module: software 00:05:52.342 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:52.342 Queue depth: 32 00:05:52.342 Allocate depth: 32 00:05:52.342 # threads/core: 2 00:05:52.342 Run time: 1 seconds 00:05:52.342 Verify: Yes 00:05:52.342 00:05:52.342 Running for 1 seconds... 00:05:52.342 00:05:52.342 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:52.342 ------------------------------------------------------------------------------------ 00:05:52.342 0,1 28032/s 51 MiB/s 0 0 00:05:52.342 0,0 27936/s 51 MiB/s 0 0 00:05:52.342 ==================================================================================== 00:05:52.342 Total 55968/s 218 MiB/s 0 0' 00:05:52.342 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.342 15:29:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:52.342 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.342 15:29:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:52.342 15:29:43 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.342 15:29:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.342 15:29:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.342 15:29:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.342 15:29:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.342 15:29:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.342 15:29:43 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.342 15:29:43 -- accel/accel.sh@42 -- # jq -r . 00:05:52.342 [2024-11-26 15:29:43.689166] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.342 [2024-11-26 15:29:43.689261] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid763987 ] 00:05:52.342 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.342 [2024-11-26 15:29:43.755356] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.602 [2024-11-26 15:29:43.874993] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.602 15:29:43 -- accel/accel.sh@21 -- # val= 00:05:52.602 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.602 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.602 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.602 15:29:43 -- accel/accel.sh@21 -- # val= 00:05:52.602 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.602 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.602 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.602 15:29:43 -- accel/accel.sh@21 -- # val= 00:05:52.602 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.602 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.602 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.602 15:29:43 -- accel/accel.sh@21 -- # val=0x1 00:05:52.602 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.602 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.602 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.602 15:29:43 -- accel/accel.sh@21 -- # val= 00:05:52.602 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.602 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.602 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.602 15:29:43 -- accel/accel.sh@21 -- # val= 00:05:52.602 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.602 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.603 15:29:43 -- accel/accel.sh@21 -- # val=decompress 00:05:52.603 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.603 15:29:43 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.603 15:29:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:52.603 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.603 15:29:43 -- accel/accel.sh@21 -- # val= 00:05:52.603 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.603 15:29:43 -- accel/accel.sh@21 -- # val=software 00:05:52.603 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.603 15:29:43 -- accel/accel.sh@23 -- # accel_module=software 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.603 15:29:43 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:52.603 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.603 15:29:43 -- accel/accel.sh@21 -- # val=32 00:05:52.603 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.603 15:29:43 -- accel/accel.sh@21 -- # val=32 00:05:52.603 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.603 15:29:43 -- accel/accel.sh@21 -- # val=2 00:05:52.603 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.603 15:29:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:52.603 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.603 15:29:43 -- accel/accel.sh@21 -- # val=Yes 00:05:52.603 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.603 15:29:43 -- accel/accel.sh@21 -- # val= 00:05:52.603 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.603 15:29:43 -- accel/accel.sh@21 -- # val= 00:05:52.603 15:29:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.603 15:29:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.986 15:29:45 -- accel/accel.sh@21 -- # val= 00:05:53.986 15:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.986 15:29:45 -- accel/accel.sh@20 -- # IFS=: 00:05:53.986 15:29:45 -- accel/accel.sh@20 -- # read -r var val 00:05:53.986 15:29:45 -- accel/accel.sh@21 -- # val= 00:05:53.986 15:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.986 15:29:45 -- accel/accel.sh@20 -- # IFS=: 00:05:53.986 15:29:45 -- accel/accel.sh@20 -- # read -r var val 00:05:53.986 15:29:45 -- accel/accel.sh@21 -- # val= 00:05:53.986 15:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.986 15:29:45 -- accel/accel.sh@20 -- # IFS=: 00:05:53.986 15:29:45 -- accel/accel.sh@20 -- # read -r var val 00:05:53.986 15:29:45 -- accel/accel.sh@21 -- # val= 00:05:53.986 15:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.986 15:29:45 -- accel/accel.sh@20 -- # IFS=: 00:05:53.986 15:29:45 -- accel/accel.sh@20 -- # read -r var val 00:05:53.986 15:29:45 -- accel/accel.sh@21 -- # val= 00:05:53.986 15:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.986 15:29:45 -- accel/accel.sh@20 -- # IFS=: 00:05:53.986 15:29:45 -- accel/accel.sh@20 -- # read -r var val 00:05:53.986 15:29:45 -- accel/accel.sh@21 -- # val= 00:05:53.986 15:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.986 15:29:45 -- accel/accel.sh@20 -- # IFS=: 00:05:53.986 15:29:45 -- accel/accel.sh@20 -- # read -r var val 00:05:53.986 15:29:45 -- accel/accel.sh@21 -- # val= 00:05:53.986 15:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.986 15:29:45 -- accel/accel.sh@20 -- # IFS=: 00:05:53.986 15:29:45 -- accel/accel.sh@20 -- # read -r var val 00:05:53.986 15:29:45 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:53.986 15:29:45 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:53.986 15:29:45 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:53.986 00:05:53.986 real 0m2.980s 00:05:53.986 user 0m2.678s 00:05:53.986 sys 0m0.294s 00:05:53.986 15:29:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:53.986 15:29:45 -- common/autotest_common.sh@10 -- # set +x 00:05:53.986 ************************************ 00:05:53.986 END TEST accel_decomp_mthread 00:05:53.986 ************************************ 00:05:53.986 15:29:45 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:53.986 15:29:45 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:53.986 15:29:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:53.986 15:29:45 -- common/autotest_common.sh@10 -- # set +x 00:05:53.986 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:53.986 ************************************ 00:05:53.986 START TEST accel_deomp_full_mthread 00:05:53.986 ************************************ 00:05:53.986 15:29:45 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:53.986 15:29:45 -- accel/accel.sh@16 -- # local accel_opc 00:05:53.986 15:29:45 -- accel/accel.sh@17 -- # local accel_module 00:05:53.986 15:29:45 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:53.986 15:29:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:53.986 15:29:45 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.986 15:29:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:53.986 15:29:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.986 15:29:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.986 15:29:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:53.986 15:29:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:53.986 15:29:45 -- accel/accel.sh@41 -- # local IFS=, 00:05:53.986 15:29:45 -- accel/accel.sh@42 -- # jq -r . 00:05:53.986 [2024-11-26 15:29:45.216632] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:53.986 [2024-11-26 15:29:45.216738] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid764137 ] 00:05:53.986 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.986 [2024-11-26 15:29:45.279884] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.986 [2024-11-26 15:29:45.399741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.366 15:29:46 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:55.366 00:05:55.366 SPDK Configuration: 00:05:55.366 Core mask: 0x1 00:05:55.366 00:05:55.366 Accel Perf Configuration: 00:05:55.366 Workload Type: decompress 00:05:55.366 Transfer size: 111250 bytes 00:05:55.366 Vector count 1 00:05:55.366 Module: software 00:05:55.366 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:55.366 Queue depth: 32 00:05:55.366 Allocate depth: 32 00:05:55.366 # threads/core: 2 00:05:55.366 Run time: 1 seconds 00:05:55.366 Verify: Yes 00:05:55.366 00:05:55.366 Running for 1 seconds... 00:05:55.366 00:05:55.366 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:55.366 ------------------------------------------------------------------------------------ 00:05:55.366 0,1 1952/s 80 MiB/s 0 0 00:05:55.366 0,0 1920/s 79 MiB/s 0 0 00:05:55.366 ==================================================================================== 00:05:55.366 Total 3872/s 410 MiB/s 0 0' 00:05:55.366 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.366 15:29:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:55.366 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.366 15:29:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:55.366 15:29:46 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.366 15:29:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.366 15:29:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.366 15:29:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.366 15:29:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.366 15:29:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.366 15:29:46 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.366 15:29:46 -- accel/accel.sh@42 -- # jq -r . 00:05:55.366 [2024-11-26 15:29:46.735176] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:55.366 [2024-11-26 15:29:46.735273] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid764274 ] 00:05:55.366 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.366 [2024-11-26 15:29:46.797303] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.625 [2024-11-26 15:29:46.918492] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val= 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val= 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val= 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val=0x1 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val= 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val= 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val=decompress 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val= 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val=software 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@23 -- # accel_module=software 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val=32 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val=32 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val=2 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val=Yes 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val= 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.625 15:29:46 -- accel/accel.sh@21 -- # val= 00:05:55.625 15:29:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.625 15:29:46 -- accel/accel.sh@20 -- # read -r var val 00:05:57.002 15:29:48 -- accel/accel.sh@21 -- # val= 00:05:57.002 15:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.002 15:29:48 -- accel/accel.sh@20 -- # IFS=: 00:05:57.002 15:29:48 -- accel/accel.sh@20 -- # read -r var val 00:05:57.002 15:29:48 -- accel/accel.sh@21 -- # val= 00:05:57.002 15:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.002 15:29:48 -- accel/accel.sh@20 -- # IFS=: 00:05:57.002 15:29:48 -- accel/accel.sh@20 -- # read -r var val 00:05:57.002 15:29:48 -- accel/accel.sh@21 -- # val= 00:05:57.002 15:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.002 15:29:48 -- accel/accel.sh@20 -- # IFS=: 00:05:57.002 15:29:48 -- accel/accel.sh@20 -- # read -r var val 00:05:57.002 15:29:48 -- accel/accel.sh@21 -- # val= 00:05:57.002 15:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.002 15:29:48 -- accel/accel.sh@20 -- # IFS=: 00:05:57.002 15:29:48 -- accel/accel.sh@20 -- # read -r var val 00:05:57.002 15:29:48 -- accel/accel.sh@21 -- # val= 00:05:57.002 15:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.002 15:29:48 -- accel/accel.sh@20 -- # IFS=: 00:05:57.002 15:29:48 -- accel/accel.sh@20 -- # read -r var val 00:05:57.002 15:29:48 -- accel/accel.sh@21 -- # val= 00:05:57.002 15:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.002 15:29:48 -- accel/accel.sh@20 -- # IFS=: 00:05:57.002 15:29:48 -- accel/accel.sh@20 -- # read -r var val 00:05:57.002 15:29:48 -- accel/accel.sh@21 -- # val= 00:05:57.002 15:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.002 15:29:48 -- accel/accel.sh@20 -- # IFS=: 00:05:57.002 15:29:48 -- accel/accel.sh@20 -- # read -r var val 00:05:57.002 15:29:48 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:57.002 15:29:48 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:57.002 15:29:48 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:57.003 00:05:57.003 real 0m3.038s 00:05:57.003 user 0m2.745s 00:05:57.003 sys 0m0.285s 00:05:57.003 15:29:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:57.003 15:29:48 -- common/autotest_common.sh@10 -- # set +x 00:05:57.003 ************************************ 00:05:57.003 END TEST accel_deomp_full_mthread 00:05:57.003 ************************************ 00:05:57.003 15:29:48 -- accel/accel.sh@116 -- # [[ n == y ]] 00:05:57.003 15:29:48 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:05:57.003 15:29:48 -- accel/accel.sh@129 -- # build_accel_config 00:05:57.003 15:29:48 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:57.003 15:29:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.003 15:29:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.003 15:29:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.003 15:29:48 -- common/autotest_common.sh@10 -- # set +x 00:05:57.003 15:29:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.003 15:29:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.003 15:29:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.003 15:29:48 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.003 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:57.003 15:29:48 -- accel/accel.sh@42 -- # jq -r . 00:05:57.003 ************************************ 00:05:57.003 START TEST accel_dif_functional_tests 00:05:57.003 ************************************ 00:05:57.003 15:29:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:05:57.003 [2024-11-26 15:29:48.299628] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.003 [2024-11-26 15:29:48.299727] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid764547 ] 00:05:57.003 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.003 [2024-11-26 15:29:48.367242] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:57.263 [2024-11-26 15:29:48.488241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:57.263 [2024-11-26 15:29:48.488261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:57.263 [2024-11-26 15:29:48.488264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.263 00:05:57.263 00:05:57.263 CUnit - A unit testing framework for C - Version 2.1-3 00:05:57.263 http://cunit.sourceforge.net/ 00:05:57.263 00:05:57.263 00:05:57.263 Suite: accel_dif 00:05:57.263 Test: verify: DIF generated, GUARD check ...passed 00:05:57.263 Test: verify: DIF generated, APPTAG check ...passed 00:05:57.263 Test: verify: DIF generated, REFTAG check ...passed 00:05:57.263 Test: verify: DIF not generated, GUARD check ...[2024-11-26 15:29:48.590824] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:05:57.263 [2024-11-26 15:29:48.590906] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:05:57.263 passed 00:05:57.263 Test: verify: DIF not generated, APPTAG check ...[2024-11-26 15:29:48.590955] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:05:57.263 [2024-11-26 15:29:48.590998] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:05:57.263 passed 00:05:57.263 Test: verify: DIF not generated, REFTAG check ...[2024-11-26 15:29:48.591035] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:05:57.263 [2024-11-26 15:29:48.591074] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:05:57.263 passed 00:05:57.263 Test: verify: APPTAG correct, APPTAG check ...passed 00:05:57.263 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-26 15:29:48.591149] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:05:57.263 passed 00:05:57.263 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:05:57.263 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:05:57.263 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:05:57.263 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-26 15:29:48.591328] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:05:57.263 passed 00:05:57.263 Test: generate copy: DIF generated, GUARD check ...passed 00:05:57.263 Test: generate copy: DIF generated, APTTAG check ...passed 00:05:57.263 Test: generate copy: DIF generated, REFTAG check ...passed 00:05:57.263 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:05:57.263 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:05:57.263 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:05:57.263 Test: generate copy: iovecs-len validate ...[2024-11-26 15:29:48.591626] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:05:57.263 passed 00:05:57.263 Test: generate copy: buffer alignment validate ...passed 00:05:57.263 00:05:57.263 Run Summary: Type Total Ran Passed Failed Inactive 00:05:57.263 suites 1 1 n/a 0 0 00:05:57.263 tests 20 20 20 0 0 00:05:57.263 asserts 204 204 204 0 n/a 00:05:57.263 00:05:57.263 Elapsed time = 0.005 seconds 00:05:57.522 00:05:57.522 real 0m0.599s 00:05:57.522 user 0m0.918s 00:05:57.522 sys 0m0.183s 00:05:57.522 15:29:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:57.522 15:29:48 -- common/autotest_common.sh@10 -- # set +x 00:05:57.522 ************************************ 00:05:57.522 END TEST accel_dif_functional_tests 00:05:57.522 ************************************ 00:05:57.522 00:05:57.522 real 1m3.337s 00:05:57.522 user 1m11.250s 00:05:57.522 sys 0m7.240s 00:05:57.522 15:29:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:57.522 15:29:48 -- common/autotest_common.sh@10 -- # set +x 00:05:57.522 ************************************ 00:05:57.522 END TEST accel 00:05:57.522 ************************************ 00:05:57.522 15:29:48 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:05:57.522 15:29:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:57.522 15:29:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.522 15:29:48 -- common/autotest_common.sh@10 -- # set +x 00:05:57.522 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:57.522 ************************************ 00:05:57.522 START TEST accel_rpc 00:05:57.522 ************************************ 00:05:57.522 15:29:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:05:57.522 * Looking for test storage... 00:05:57.522 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:57.522 15:29:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:57.522 15:29:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:57.522 15:29:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:57.780 15:29:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:57.780 15:29:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:57.780 15:29:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:57.780 15:29:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:57.780 15:29:49 -- scripts/common.sh@335 -- # IFS=.-: 00:05:57.780 15:29:49 -- scripts/common.sh@335 -- # read -ra ver1 00:05:57.780 15:29:49 -- scripts/common.sh@336 -- # IFS=.-: 00:05:57.780 15:29:49 -- scripts/common.sh@336 -- # read -ra ver2 00:05:57.780 15:29:49 -- scripts/common.sh@337 -- # local 'op=<' 00:05:57.780 15:29:49 -- scripts/common.sh@339 -- # ver1_l=2 00:05:57.780 15:29:49 -- scripts/common.sh@340 -- # ver2_l=1 00:05:57.780 15:29:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:57.780 15:29:49 -- scripts/common.sh@343 -- # case "$op" in 00:05:57.780 15:29:49 -- scripts/common.sh@344 -- # : 1 00:05:57.780 15:29:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:57.780 15:29:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:57.780 15:29:49 -- scripts/common.sh@364 -- # decimal 1 00:05:57.780 15:29:49 -- scripts/common.sh@352 -- # local d=1 00:05:57.780 15:29:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:57.780 15:29:49 -- scripts/common.sh@354 -- # echo 1 00:05:57.780 15:29:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:57.780 15:29:49 -- scripts/common.sh@365 -- # decimal 2 00:05:57.780 15:29:49 -- scripts/common.sh@352 -- # local d=2 00:05:57.780 15:29:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:57.780 15:29:49 -- scripts/common.sh@354 -- # echo 2 00:05:57.780 15:29:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:57.780 15:29:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:57.780 15:29:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:57.780 15:29:49 -- scripts/common.sh@367 -- # return 0 00:05:57.780 15:29:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:57.780 15:29:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:57.780 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.780 --rc genhtml_branch_coverage=1 00:05:57.780 --rc genhtml_function_coverage=1 00:05:57.780 --rc genhtml_legend=1 00:05:57.780 --rc geninfo_all_blocks=1 00:05:57.780 --rc geninfo_unexecuted_blocks=1 00:05:57.780 00:05:57.780 ' 00:05:57.780 15:29:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:57.780 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.780 --rc genhtml_branch_coverage=1 00:05:57.780 --rc genhtml_function_coverage=1 00:05:57.780 --rc genhtml_legend=1 00:05:57.780 --rc geninfo_all_blocks=1 00:05:57.780 --rc geninfo_unexecuted_blocks=1 00:05:57.780 00:05:57.780 ' 00:05:57.780 15:29:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:57.780 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.780 --rc genhtml_branch_coverage=1 00:05:57.780 --rc genhtml_function_coverage=1 00:05:57.780 --rc genhtml_legend=1 00:05:57.780 --rc geninfo_all_blocks=1 00:05:57.780 --rc geninfo_unexecuted_blocks=1 00:05:57.780 00:05:57.780 ' 00:05:57.780 15:29:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:57.780 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.780 --rc genhtml_branch_coverage=1 00:05:57.780 --rc genhtml_function_coverage=1 00:05:57.780 --rc genhtml_legend=1 00:05:57.780 --rc geninfo_all_blocks=1 00:05:57.780 --rc geninfo_unexecuted_blocks=1 00:05:57.780 00:05:57.780 ' 00:05:57.780 15:29:49 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:57.780 15:29:49 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=764619 00:05:57.780 15:29:49 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:05:57.780 15:29:49 -- accel/accel_rpc.sh@15 -- # waitforlisten 764619 00:05:57.780 15:29:49 -- common/autotest_common.sh@829 -- # '[' -z 764619 ']' 00:05:57.781 15:29:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:57.781 15:29:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:57.781 15:29:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:57.781 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:57.781 15:29:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:57.781 15:29:49 -- common/autotest_common.sh@10 -- # set +x 00:05:57.781 [2024-11-26 15:29:49.111127] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.781 [2024-11-26 15:29:49.111204] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid764619 ] 00:05:57.781 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.781 [2024-11-26 15:29:49.169631] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.038 [2024-11-26 15:29:49.282456] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:58.038 [2024-11-26 15:29:49.282642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.038 15:29:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:58.038 15:29:49 -- common/autotest_common.sh@862 -- # return 0 00:05:58.038 15:29:49 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:05:58.038 15:29:49 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:05:58.038 15:29:49 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:05:58.038 15:29:49 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:05:58.038 15:29:49 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:05:58.038 15:29:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:58.038 15:29:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.038 15:29:49 -- common/autotest_common.sh@10 -- # set +x 00:05:58.038 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:58.038 ************************************ 00:05:58.038 START TEST accel_assign_opcode 00:05:58.038 ************************************ 00:05:58.038 15:29:49 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:05:58.038 15:29:49 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:05:58.038 15:29:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.038 15:29:49 -- common/autotest_common.sh@10 -- # set +x 00:05:58.038 [2024-11-26 15:29:49.343218] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:05:58.038 15:29:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.038 15:29:49 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:05:58.038 15:29:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.038 15:29:49 -- common/autotest_common.sh@10 -- # set +x 00:05:58.038 [2024-11-26 15:29:49.351229] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:05:58.038 15:29:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.038 15:29:49 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:05:58.038 15:29:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.038 15:29:49 -- common/autotest_common.sh@10 -- # set +x 00:05:58.298 15:29:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.298 15:29:49 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:05:58.298 15:29:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.298 15:29:49 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:05:58.298 15:29:49 -- common/autotest_common.sh@10 -- # set +x 00:05:58.298 15:29:49 -- accel/accel_rpc.sh@42 -- # grep software 00:05:58.298 15:29:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.298 software 00:05:58.298 00:05:58.298 real 0m0.295s 00:05:58.298 user 0m0.041s 00:05:58.298 sys 0m0.007s 00:05:58.298 15:29:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.298 15:29:49 -- common/autotest_common.sh@10 -- # set +x 00:05:58.298 ************************************ 00:05:58.298 END TEST accel_assign_opcode 00:05:58.298 ************************************ 00:05:58.298 15:29:49 -- accel/accel_rpc.sh@55 -- # killprocess 764619 00:05:58.298 15:29:49 -- common/autotest_common.sh@936 -- # '[' -z 764619 ']' 00:05:58.298 15:29:49 -- common/autotest_common.sh@940 -- # kill -0 764619 00:05:58.298 15:29:49 -- common/autotest_common.sh@941 -- # uname 00:05:58.298 15:29:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:58.298 15:29:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 764619 00:05:58.298 15:29:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:58.298 15:29:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:58.298 15:29:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 764619' 00:05:58.298 killing process with pid 764619 00:05:58.298 15:29:49 -- common/autotest_common.sh@955 -- # kill 764619 00:05:58.298 15:29:49 -- common/autotest_common.sh@960 -- # wait 764619 00:05:58.867 00:05:58.867 real 0m1.260s 00:05:58.867 user 0m1.186s 00:05:58.867 sys 0m0.450s 00:05:58.867 15:29:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.867 15:29:50 -- common/autotest_common.sh@10 -- # set +x 00:05:58.867 ************************************ 00:05:58.867 END TEST accel_rpc 00:05:58.867 ************************************ 00:05:58.867 15:29:50 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:05:58.867 15:29:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:58.867 15:29:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.867 15:29:50 -- common/autotest_common.sh@10 -- # set +x 00:05:58.867 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:05:58.867 ************************************ 00:05:58.867 START TEST app_cmdline 00:05:58.867 ************************************ 00:05:58.867 15:29:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:05:58.867 * Looking for test storage... 00:05:58.867 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:05:58.867 15:29:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:58.867 15:29:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:58.867 15:29:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:59.125 15:29:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:59.125 15:29:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:59.125 15:29:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:59.125 15:29:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:59.125 15:29:50 -- scripts/common.sh@335 -- # IFS=.-: 00:05:59.125 15:29:50 -- scripts/common.sh@335 -- # read -ra ver1 00:05:59.125 15:29:50 -- scripts/common.sh@336 -- # IFS=.-: 00:05:59.125 15:29:50 -- scripts/common.sh@336 -- # read -ra ver2 00:05:59.125 15:29:50 -- scripts/common.sh@337 -- # local 'op=<' 00:05:59.125 15:29:50 -- scripts/common.sh@339 -- # ver1_l=2 00:05:59.125 15:29:50 -- scripts/common.sh@340 -- # ver2_l=1 00:05:59.125 15:29:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:59.125 15:29:50 -- scripts/common.sh@343 -- # case "$op" in 00:05:59.125 15:29:50 -- scripts/common.sh@344 -- # : 1 00:05:59.125 15:29:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:59.125 15:29:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:59.125 15:29:50 -- scripts/common.sh@364 -- # decimal 1 00:05:59.125 15:29:50 -- scripts/common.sh@352 -- # local d=1 00:05:59.125 15:29:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:59.125 15:29:50 -- scripts/common.sh@354 -- # echo 1 00:05:59.125 15:29:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:59.125 15:29:50 -- scripts/common.sh@365 -- # decimal 2 00:05:59.125 15:29:50 -- scripts/common.sh@352 -- # local d=2 00:05:59.125 15:29:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:59.125 15:29:50 -- scripts/common.sh@354 -- # echo 2 00:05:59.125 15:29:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:59.125 15:29:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:59.125 15:29:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:59.125 15:29:50 -- scripts/common.sh@367 -- # return 0 00:05:59.125 15:29:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:59.125 15:29:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:59.125 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.125 --rc genhtml_branch_coverage=1 00:05:59.125 --rc genhtml_function_coverage=1 00:05:59.125 --rc genhtml_legend=1 00:05:59.125 --rc geninfo_all_blocks=1 00:05:59.125 --rc geninfo_unexecuted_blocks=1 00:05:59.125 00:05:59.125 ' 00:05:59.125 15:29:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:59.125 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.125 --rc genhtml_branch_coverage=1 00:05:59.125 --rc genhtml_function_coverage=1 00:05:59.125 --rc genhtml_legend=1 00:05:59.125 --rc geninfo_all_blocks=1 00:05:59.125 --rc geninfo_unexecuted_blocks=1 00:05:59.125 00:05:59.125 ' 00:05:59.125 15:29:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:59.125 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.125 --rc genhtml_branch_coverage=1 00:05:59.125 --rc genhtml_function_coverage=1 00:05:59.125 --rc genhtml_legend=1 00:05:59.125 --rc geninfo_all_blocks=1 00:05:59.125 --rc geninfo_unexecuted_blocks=1 00:05:59.125 00:05:59.125 ' 00:05:59.125 15:29:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:59.125 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.125 --rc genhtml_branch_coverage=1 00:05:59.125 --rc genhtml_function_coverage=1 00:05:59.125 --rc genhtml_legend=1 00:05:59.125 --rc geninfo_all_blocks=1 00:05:59.125 --rc geninfo_unexecuted_blocks=1 00:05:59.125 00:05:59.125 ' 00:05:59.125 15:29:50 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:05:59.125 15:29:50 -- app/cmdline.sh@17 -- # spdk_tgt_pid=764945 00:05:59.125 15:29:50 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:05:59.125 15:29:50 -- app/cmdline.sh@18 -- # waitforlisten 764945 00:05:59.125 15:29:50 -- common/autotest_common.sh@829 -- # '[' -z 764945 ']' 00:05:59.125 15:29:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:59.125 15:29:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:59.125 15:29:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:59.125 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:59.125 15:29:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:59.125 15:29:50 -- common/autotest_common.sh@10 -- # set +x 00:05:59.125 [2024-11-26 15:29:50.396584] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.125 [2024-11-26 15:29:50.396679] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid764945 ] 00:05:59.125 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.125 [2024-11-26 15:29:50.458828] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.385 [2024-11-26 15:29:50.576209] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:59.385 [2024-11-26 15:29:50.576388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.954 15:29:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:59.954 15:29:51 -- common/autotest_common.sh@862 -- # return 0 00:05:59.954 15:29:51 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:00.212 { 00:06:00.212 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:00.212 "fields": { 00:06:00.212 "major": 24, 00:06:00.212 "minor": 1, 00:06:00.212 "patch": 1, 00:06:00.212 "suffix": "-pre", 00:06:00.212 "commit": "c13c99a5e" 00:06:00.212 } 00:06:00.212 } 00:06:00.212 15:29:51 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:00.212 15:29:51 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:00.213 15:29:51 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:00.213 15:29:51 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:00.213 15:29:51 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:00.213 15:29:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:00.213 15:29:51 -- common/autotest_common.sh@10 -- # set +x 00:06:00.213 15:29:51 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:00.213 15:29:51 -- app/cmdline.sh@26 -- # sort 00:06:00.213 15:29:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:00.213 15:29:51 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:00.213 15:29:51 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:00.213 15:29:51 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:00.213 15:29:51 -- common/autotest_common.sh@650 -- # local es=0 00:06:00.213 15:29:51 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:00.213 15:29:51 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:00.213 15:29:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:00.213 15:29:51 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:00.213 15:29:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:00.213 15:29:51 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:00.213 15:29:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:00.213 15:29:51 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:00.213 15:29:51 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:00.213 15:29:51 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:00.471 request: 00:06:00.471 { 00:06:00.471 "method": "env_dpdk_get_mem_stats", 00:06:00.471 "req_id": 1 00:06:00.471 } 00:06:00.471 Got JSON-RPC error response 00:06:00.471 response: 00:06:00.471 { 00:06:00.471 "code": -32601, 00:06:00.471 "message": "Method not found" 00:06:00.471 } 00:06:00.471 15:29:51 -- common/autotest_common.sh@653 -- # es=1 00:06:00.471 15:29:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:00.471 15:29:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:00.471 15:29:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:00.471 15:29:51 -- app/cmdline.sh@1 -- # killprocess 764945 00:06:00.471 15:29:51 -- common/autotest_common.sh@936 -- # '[' -z 764945 ']' 00:06:00.471 15:29:51 -- common/autotest_common.sh@940 -- # kill -0 764945 00:06:00.471 15:29:51 -- common/autotest_common.sh@941 -- # uname 00:06:00.471 15:29:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:00.471 15:29:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 764945 00:06:00.730 15:29:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:00.730 15:29:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:00.730 15:29:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 764945' 00:06:00.730 killing process with pid 764945 00:06:00.730 15:29:51 -- common/autotest_common.sh@955 -- # kill 764945 00:06:00.730 15:29:51 -- common/autotest_common.sh@960 -- # wait 764945 00:06:00.989 00:06:00.989 real 0m2.224s 00:06:00.989 user 0m2.762s 00:06:00.989 sys 0m0.519s 00:06:00.989 15:29:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.989 15:29:52 -- common/autotest_common.sh@10 -- # set +x 00:06:00.989 ************************************ 00:06:00.989 END TEST app_cmdline 00:06:00.989 ************************************ 00:06:01.248 15:29:52 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:01.248 15:29:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:01.248 15:29:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.248 15:29:52 -- common/autotest_common.sh@10 -- # set +x 00:06:01.248 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:06:01.248 ************************************ 00:06:01.248 START TEST version 00:06:01.248 ************************************ 00:06:01.248 15:29:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:01.248 * Looking for test storage... 00:06:01.248 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:01.248 15:29:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:01.248 15:29:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:01.248 15:29:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:01.248 15:29:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:01.248 15:29:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:01.248 15:29:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:01.248 15:29:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:01.248 15:29:52 -- scripts/common.sh@335 -- # IFS=.-: 00:06:01.248 15:29:52 -- scripts/common.sh@335 -- # read -ra ver1 00:06:01.248 15:29:52 -- scripts/common.sh@336 -- # IFS=.-: 00:06:01.248 15:29:52 -- scripts/common.sh@336 -- # read -ra ver2 00:06:01.248 15:29:52 -- scripts/common.sh@337 -- # local 'op=<' 00:06:01.248 15:29:52 -- scripts/common.sh@339 -- # ver1_l=2 00:06:01.248 15:29:52 -- scripts/common.sh@340 -- # ver2_l=1 00:06:01.248 15:29:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:01.248 15:29:52 -- scripts/common.sh@343 -- # case "$op" in 00:06:01.248 15:29:52 -- scripts/common.sh@344 -- # : 1 00:06:01.248 15:29:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:01.248 15:29:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:01.248 15:29:52 -- scripts/common.sh@364 -- # decimal 1 00:06:01.248 15:29:52 -- scripts/common.sh@352 -- # local d=1 00:06:01.248 15:29:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:01.248 15:29:52 -- scripts/common.sh@354 -- # echo 1 00:06:01.248 15:29:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:01.248 15:29:52 -- scripts/common.sh@365 -- # decimal 2 00:06:01.248 15:29:52 -- scripts/common.sh@352 -- # local d=2 00:06:01.248 15:29:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:01.248 15:29:52 -- scripts/common.sh@354 -- # echo 2 00:06:01.248 15:29:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:01.248 15:29:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:01.248 15:29:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:01.248 15:29:52 -- scripts/common.sh@367 -- # return 0 00:06:01.248 15:29:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:01.248 15:29:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:01.248 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.248 --rc genhtml_branch_coverage=1 00:06:01.248 --rc genhtml_function_coverage=1 00:06:01.248 --rc genhtml_legend=1 00:06:01.248 --rc geninfo_all_blocks=1 00:06:01.248 --rc geninfo_unexecuted_blocks=1 00:06:01.248 00:06:01.248 ' 00:06:01.248 15:29:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:01.248 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.248 --rc genhtml_branch_coverage=1 00:06:01.248 --rc genhtml_function_coverage=1 00:06:01.248 --rc genhtml_legend=1 00:06:01.248 --rc geninfo_all_blocks=1 00:06:01.248 --rc geninfo_unexecuted_blocks=1 00:06:01.248 00:06:01.248 ' 00:06:01.248 15:29:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:01.248 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.248 --rc genhtml_branch_coverage=1 00:06:01.248 --rc genhtml_function_coverage=1 00:06:01.248 --rc genhtml_legend=1 00:06:01.248 --rc geninfo_all_blocks=1 00:06:01.248 --rc geninfo_unexecuted_blocks=1 00:06:01.248 00:06:01.248 ' 00:06:01.248 15:29:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:01.248 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.248 --rc genhtml_branch_coverage=1 00:06:01.248 --rc genhtml_function_coverage=1 00:06:01.248 --rc genhtml_legend=1 00:06:01.248 --rc geninfo_all_blocks=1 00:06:01.248 --rc geninfo_unexecuted_blocks=1 00:06:01.248 00:06:01.248 ' 00:06:01.248 15:29:52 -- app/version.sh@17 -- # get_header_version major 00:06:01.248 15:29:52 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:01.248 15:29:52 -- app/version.sh@14 -- # cut -f2 00:06:01.248 15:29:52 -- app/version.sh@14 -- # tr -d '"' 00:06:01.248 15:29:52 -- app/version.sh@17 -- # major=24 00:06:01.248 15:29:52 -- app/version.sh@18 -- # get_header_version minor 00:06:01.248 15:29:52 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:01.248 15:29:52 -- app/version.sh@14 -- # cut -f2 00:06:01.248 15:29:52 -- app/version.sh@14 -- # tr -d '"' 00:06:01.248 15:29:52 -- app/version.sh@18 -- # minor=1 00:06:01.248 15:29:52 -- app/version.sh@19 -- # get_header_version patch 00:06:01.248 15:29:52 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:01.248 15:29:52 -- app/version.sh@14 -- # cut -f2 00:06:01.248 15:29:52 -- app/version.sh@14 -- # tr -d '"' 00:06:01.248 15:29:52 -- app/version.sh@19 -- # patch=1 00:06:01.248 15:29:52 -- app/version.sh@20 -- # get_header_version suffix 00:06:01.248 15:29:52 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:01.248 15:29:52 -- app/version.sh@14 -- # cut -f2 00:06:01.248 15:29:52 -- app/version.sh@14 -- # tr -d '"' 00:06:01.248 15:29:52 -- app/version.sh@20 -- # suffix=-pre 00:06:01.248 15:29:52 -- app/version.sh@22 -- # version=24.1 00:06:01.248 15:29:52 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:01.248 15:29:52 -- app/version.sh@25 -- # version=24.1.1 00:06:01.248 15:29:52 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:01.248 15:29:52 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:01.248 15:29:52 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:01.248 15:29:52 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:01.248 15:29:52 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:01.248 00:06:01.248 real 0m0.196s 00:06:01.248 user 0m0.138s 00:06:01.248 sys 0m0.085s 00:06:01.248 15:29:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:01.248 15:29:52 -- common/autotest_common.sh@10 -- # set +x 00:06:01.248 ************************************ 00:06:01.248 END TEST version 00:06:01.248 ************************************ 00:06:01.248 15:29:52 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:01.248 15:29:52 -- spdk/autotest.sh@191 -- # uname -s 00:06:01.248 15:29:52 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:01.248 15:29:52 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:01.248 15:29:52 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:01.248 15:29:52 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:01.248 15:29:52 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:01.248 15:29:52 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:01.248 15:29:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:01.248 15:29:52 -- common/autotest_common.sh@10 -- # set +x 00:06:01.248 15:29:52 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:01.248 15:29:52 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:01.248 15:29:52 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:01.507 15:29:52 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:01.507 15:29:52 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:01.507 15:29:52 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:01.507 15:29:52 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:01.507 15:29:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:01.507 15:29:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.507 15:29:52 -- common/autotest_common.sh@10 -- # set +x 00:06:01.507 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:06:01.507 ************************************ 00:06:01.507 START TEST nvmf_tcp 00:06:01.507 ************************************ 00:06:01.507 15:29:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:01.507 * Looking for test storage... 00:06:01.507 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:01.507 15:29:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:01.507 15:29:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:01.507 15:29:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:01.507 15:29:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:01.507 15:29:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:01.507 15:29:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:01.507 15:29:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:01.507 15:29:52 -- scripts/common.sh@335 -- # IFS=.-: 00:06:01.507 15:29:52 -- scripts/common.sh@335 -- # read -ra ver1 00:06:01.507 15:29:52 -- scripts/common.sh@336 -- # IFS=.-: 00:06:01.507 15:29:52 -- scripts/common.sh@336 -- # read -ra ver2 00:06:01.507 15:29:52 -- scripts/common.sh@337 -- # local 'op=<' 00:06:01.507 15:29:52 -- scripts/common.sh@339 -- # ver1_l=2 00:06:01.507 15:29:52 -- scripts/common.sh@340 -- # ver2_l=1 00:06:01.507 15:29:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:01.507 15:29:52 -- scripts/common.sh@343 -- # case "$op" in 00:06:01.507 15:29:52 -- scripts/common.sh@344 -- # : 1 00:06:01.507 15:29:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:01.507 15:29:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:01.507 15:29:52 -- scripts/common.sh@364 -- # decimal 1 00:06:01.507 15:29:52 -- scripts/common.sh@352 -- # local d=1 00:06:01.507 15:29:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:01.507 15:29:52 -- scripts/common.sh@354 -- # echo 1 00:06:01.508 15:29:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:01.508 15:29:52 -- scripts/common.sh@365 -- # decimal 2 00:06:01.508 15:29:52 -- scripts/common.sh@352 -- # local d=2 00:06:01.508 15:29:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:01.508 15:29:52 -- scripts/common.sh@354 -- # echo 2 00:06:01.508 15:29:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:01.508 15:29:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:01.508 15:29:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:01.508 15:29:52 -- scripts/common.sh@367 -- # return 0 00:06:01.508 15:29:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:01.508 15:29:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:01.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.508 --rc genhtml_branch_coverage=1 00:06:01.508 --rc genhtml_function_coverage=1 00:06:01.508 --rc genhtml_legend=1 00:06:01.508 --rc geninfo_all_blocks=1 00:06:01.508 --rc geninfo_unexecuted_blocks=1 00:06:01.508 00:06:01.508 ' 00:06:01.508 15:29:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:01.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.508 --rc genhtml_branch_coverage=1 00:06:01.508 --rc genhtml_function_coverage=1 00:06:01.508 --rc genhtml_legend=1 00:06:01.508 --rc geninfo_all_blocks=1 00:06:01.508 --rc geninfo_unexecuted_blocks=1 00:06:01.508 00:06:01.508 ' 00:06:01.508 15:29:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:01.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.508 --rc genhtml_branch_coverage=1 00:06:01.508 --rc genhtml_function_coverage=1 00:06:01.508 --rc genhtml_legend=1 00:06:01.508 --rc geninfo_all_blocks=1 00:06:01.508 --rc geninfo_unexecuted_blocks=1 00:06:01.508 00:06:01.508 ' 00:06:01.508 15:29:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:01.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.508 --rc genhtml_branch_coverage=1 00:06:01.508 --rc genhtml_function_coverage=1 00:06:01.508 --rc genhtml_legend=1 00:06:01.508 --rc geninfo_all_blocks=1 00:06:01.508 --rc geninfo_unexecuted_blocks=1 00:06:01.508 00:06:01.508 ' 00:06:01.508 15:29:52 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:01.508 15:29:52 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:01.508 15:29:52 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:01.508 15:29:52 -- nvmf/common.sh@7 -- # uname -s 00:06:01.508 15:29:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:01.508 15:29:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:01.508 15:29:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:01.508 15:29:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:01.508 15:29:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:01.508 15:29:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:01.508 15:29:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:01.508 15:29:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:01.508 15:29:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:01.508 15:29:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:01.508 15:29:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:01.508 15:29:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:01.508 15:29:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:01.508 15:29:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:01.508 15:29:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:01.508 15:29:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:01.508 15:29:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:01.508 15:29:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:01.508 15:29:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:01.508 15:29:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:01.508 15:29:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:01.508 15:29:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:01.508 15:29:52 -- paths/export.sh@5 -- # export PATH 00:06:01.508 15:29:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:01.508 15:29:52 -- nvmf/common.sh@46 -- # : 0 00:06:01.508 15:29:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:01.508 15:29:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:01.508 15:29:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:01.508 15:29:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:01.508 15:29:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:01.508 15:29:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:01.508 15:29:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:01.508 15:29:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:01.508 15:29:52 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:01.508 15:29:52 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:01.508 15:29:52 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:01.508 15:29:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:01.508 15:29:52 -- common/autotest_common.sh@10 -- # set +x 00:06:01.508 15:29:52 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:01.508 15:29:52 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:01.508 15:29:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:01.508 15:29:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.508 15:29:52 -- common/autotest_common.sh@10 -- # set +x 00:06:01.508 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:06:01.508 ************************************ 00:06:01.508 START TEST nvmf_example 00:06:01.508 ************************************ 00:06:01.508 15:29:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:01.508 * Looking for test storage... 00:06:01.508 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:01.508 15:29:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:01.508 15:29:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:01.508 15:29:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:01.767 15:29:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:01.767 15:29:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:01.767 15:29:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:01.767 15:29:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:01.767 15:29:52 -- scripts/common.sh@335 -- # IFS=.-: 00:06:01.767 15:29:52 -- scripts/common.sh@335 -- # read -ra ver1 00:06:01.767 15:29:53 -- scripts/common.sh@336 -- # IFS=.-: 00:06:01.767 15:29:53 -- scripts/common.sh@336 -- # read -ra ver2 00:06:01.767 15:29:53 -- scripts/common.sh@337 -- # local 'op=<' 00:06:01.767 15:29:53 -- scripts/common.sh@339 -- # ver1_l=2 00:06:01.767 15:29:53 -- scripts/common.sh@340 -- # ver2_l=1 00:06:01.767 15:29:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:01.767 15:29:53 -- scripts/common.sh@343 -- # case "$op" in 00:06:01.767 15:29:53 -- scripts/common.sh@344 -- # : 1 00:06:01.767 15:29:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:01.767 15:29:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:01.767 15:29:53 -- scripts/common.sh@364 -- # decimal 1 00:06:01.767 15:29:53 -- scripts/common.sh@352 -- # local d=1 00:06:01.767 15:29:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:01.767 15:29:53 -- scripts/common.sh@354 -- # echo 1 00:06:01.767 15:29:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:01.767 15:29:53 -- scripts/common.sh@365 -- # decimal 2 00:06:01.767 15:29:53 -- scripts/common.sh@352 -- # local d=2 00:06:01.767 15:29:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:01.767 15:29:53 -- scripts/common.sh@354 -- # echo 2 00:06:01.767 15:29:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:01.767 15:29:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:01.767 15:29:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:01.767 15:29:53 -- scripts/common.sh@367 -- # return 0 00:06:01.767 15:29:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:01.767 15:29:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:01.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.767 --rc genhtml_branch_coverage=1 00:06:01.767 --rc genhtml_function_coverage=1 00:06:01.767 --rc genhtml_legend=1 00:06:01.767 --rc geninfo_all_blocks=1 00:06:01.767 --rc geninfo_unexecuted_blocks=1 00:06:01.767 00:06:01.767 ' 00:06:01.767 15:29:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:01.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.767 --rc genhtml_branch_coverage=1 00:06:01.767 --rc genhtml_function_coverage=1 00:06:01.767 --rc genhtml_legend=1 00:06:01.767 --rc geninfo_all_blocks=1 00:06:01.767 --rc geninfo_unexecuted_blocks=1 00:06:01.767 00:06:01.767 ' 00:06:01.767 15:29:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:01.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.767 --rc genhtml_branch_coverage=1 00:06:01.767 --rc genhtml_function_coverage=1 00:06:01.767 --rc genhtml_legend=1 00:06:01.767 --rc geninfo_all_blocks=1 00:06:01.767 --rc geninfo_unexecuted_blocks=1 00:06:01.767 00:06:01.767 ' 00:06:01.767 15:29:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:01.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.767 --rc genhtml_branch_coverage=1 00:06:01.767 --rc genhtml_function_coverage=1 00:06:01.767 --rc genhtml_legend=1 00:06:01.767 --rc geninfo_all_blocks=1 00:06:01.767 --rc geninfo_unexecuted_blocks=1 00:06:01.767 00:06:01.767 ' 00:06:01.767 15:29:53 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:01.767 15:29:53 -- nvmf/common.sh@7 -- # uname -s 00:06:01.767 15:29:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:01.767 15:29:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:01.767 15:29:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:01.767 15:29:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:01.767 15:29:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:01.767 15:29:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:01.767 15:29:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:01.767 15:29:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:01.767 15:29:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:01.767 15:29:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:01.767 15:29:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:01.767 15:29:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:01.767 15:29:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:01.767 15:29:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:01.767 15:29:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:01.767 15:29:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:01.767 15:29:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:01.767 15:29:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:01.767 15:29:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:01.767 15:29:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:01.767 15:29:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:01.767 15:29:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:01.767 15:29:53 -- paths/export.sh@5 -- # export PATH 00:06:01.767 15:29:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:01.767 15:29:53 -- nvmf/common.sh@46 -- # : 0 00:06:01.767 15:29:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:01.767 15:29:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:01.767 15:29:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:01.768 15:29:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:01.768 15:29:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:01.768 15:29:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:01.768 15:29:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:01.768 15:29:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:01.768 15:29:53 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:01.768 15:29:53 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:01.768 15:29:53 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:01.768 15:29:53 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:01.768 15:29:53 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:01.768 15:29:53 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:01.768 15:29:53 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:01.768 15:29:53 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:01.768 15:29:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:01.768 15:29:53 -- common/autotest_common.sh@10 -- # set +x 00:06:01.768 15:29:53 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:01.768 15:29:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:01.768 15:29:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:01.768 15:29:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:01.768 15:29:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:01.768 15:29:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:01.768 15:29:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:01.768 15:29:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:01.768 15:29:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:01.768 15:29:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:01.768 15:29:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:01.768 15:29:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:01.768 15:29:53 -- common/autotest_common.sh@10 -- # set +x 00:06:03.734 15:29:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:03.734 15:29:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:03.734 15:29:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:03.734 15:29:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:03.734 15:29:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:03.734 15:29:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:03.734 15:29:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:03.734 15:29:55 -- nvmf/common.sh@294 -- # net_devs=() 00:06:03.734 15:29:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:03.734 15:29:55 -- nvmf/common.sh@295 -- # e810=() 00:06:03.734 15:29:55 -- nvmf/common.sh@295 -- # local -ga e810 00:06:03.734 15:29:55 -- nvmf/common.sh@296 -- # x722=() 00:06:03.734 15:29:55 -- nvmf/common.sh@296 -- # local -ga x722 00:06:03.734 15:29:55 -- nvmf/common.sh@297 -- # mlx=() 00:06:03.734 15:29:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:03.734 15:29:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:03.734 15:29:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:03.734 15:29:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:03.734 15:29:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:03.734 15:29:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:03.734 15:29:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:03.734 15:29:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:03.734 15:29:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:03.734 15:29:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:03.734 15:29:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:03.734 15:29:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:03.734 15:29:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:03.734 15:29:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:03.734 15:29:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:03.734 15:29:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:03.734 15:29:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:03.734 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:03.734 15:29:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:03.734 15:29:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:03.734 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:03.734 15:29:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:03.734 15:29:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:03.734 15:29:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:03.734 15:29:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:03.734 15:29:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:03.734 15:29:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:03.734 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:03.734 15:29:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:03.734 15:29:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:03.734 15:29:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:03.734 15:29:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:03.734 15:29:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:03.734 15:29:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:03.734 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:03.734 15:29:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:03.734 15:29:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:03.734 15:29:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:03.734 15:29:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:03.734 15:29:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:03.734 15:29:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:03.734 15:29:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:03.734 15:29:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:03.734 15:29:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:03.734 15:29:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:03.734 15:29:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:03.734 15:29:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:03.734 15:29:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:03.734 15:29:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:03.734 15:29:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:03.734 15:29:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:03.734 15:29:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:03.734 15:29:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:03.734 15:29:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:03.734 15:29:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:03.734 15:29:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:03.734 15:29:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:03.734 15:29:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:03.734 15:29:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:03.994 15:29:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:03.994 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:03.994 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.224 ms 00:06:03.994 00:06:03.994 --- 10.0.0.2 ping statistics --- 00:06:03.994 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:03.994 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:06:03.994 15:29:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:03.994 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:03.994 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:06:03.994 00:06:03.994 --- 10.0.0.1 ping statistics --- 00:06:03.994 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:03.994 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:06:03.994 15:29:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:03.994 15:29:55 -- nvmf/common.sh@410 -- # return 0 00:06:03.994 15:29:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:03.994 15:29:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:03.994 15:29:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:03.994 15:29:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:03.994 15:29:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:03.994 15:29:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:03.994 15:29:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:03.994 15:29:55 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:03.994 15:29:55 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:03.994 15:29:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:03.994 15:29:55 -- common/autotest_common.sh@10 -- # set +x 00:06:03.994 15:29:55 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:03.994 15:29:55 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:03.994 15:29:55 -- target/nvmf_example.sh@34 -- # nvmfpid=766980 00:06:03.994 15:29:55 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:03.994 15:29:55 -- target/nvmf_example.sh@36 -- # waitforlisten 766980 00:06:03.994 15:29:55 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:03.994 15:29:55 -- common/autotest_common.sh@829 -- # '[' -z 766980 ']' 00:06:03.994 15:29:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:03.994 15:29:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:03.994 15:29:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:03.994 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:03.994 15:29:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:03.994 15:29:55 -- common/autotest_common.sh@10 -- # set +x 00:06:03.994 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.932 15:29:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:04.932 15:29:56 -- common/autotest_common.sh@862 -- # return 0 00:06:04.932 15:29:56 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:04.932 15:29:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:04.932 15:29:56 -- common/autotest_common.sh@10 -- # set +x 00:06:04.932 15:29:56 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:04.932 15:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.932 15:29:56 -- common/autotest_common.sh@10 -- # set +x 00:06:04.932 15:29:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.932 15:29:56 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:04.932 15:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.932 15:29:56 -- common/autotest_common.sh@10 -- # set +x 00:06:04.932 15:29:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.932 15:29:56 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:04.932 15:29:56 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:04.932 15:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.932 15:29:56 -- common/autotest_common.sh@10 -- # set +x 00:06:04.932 15:29:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.932 15:29:56 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:04.932 15:29:56 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:04.932 15:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.932 15:29:56 -- common/autotest_common.sh@10 -- # set +x 00:06:04.932 15:29:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.932 15:29:56 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:04.932 15:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.932 15:29:56 -- common/autotest_common.sh@10 -- # set +x 00:06:04.932 15:29:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.932 15:29:56 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:04.932 15:29:56 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:05.190 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.157 Initializing NVMe Controllers 00:06:15.157 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:15.157 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:15.157 Initialization complete. Launching workers. 00:06:15.157 ======================================================== 00:06:15.157 Latency(us) 00:06:15.157 Device Information : IOPS MiB/s Average min max 00:06:15.157 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15538.10 60.70 4118.82 749.36 15376.78 00:06:15.157 ======================================================== 00:06:15.157 Total : 15538.10 60.70 4118.82 749.36 15376.78 00:06:15.157 00:06:15.157 15:30:06 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:15.157 15:30:06 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:15.157 15:30:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:15.157 15:30:06 -- nvmf/common.sh@116 -- # sync 00:06:15.157 15:30:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:15.157 15:30:06 -- nvmf/common.sh@119 -- # set +e 00:06:15.157 15:30:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:15.157 15:30:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:15.157 rmmod nvme_tcp 00:06:15.157 rmmod nvme_fabrics 00:06:15.415 rmmod nvme_keyring 00:06:15.415 15:30:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:15.415 15:30:06 -- nvmf/common.sh@123 -- # set -e 00:06:15.415 15:30:06 -- nvmf/common.sh@124 -- # return 0 00:06:15.415 15:30:06 -- nvmf/common.sh@477 -- # '[' -n 766980 ']' 00:06:15.416 15:30:06 -- nvmf/common.sh@478 -- # killprocess 766980 00:06:15.416 15:30:06 -- common/autotest_common.sh@936 -- # '[' -z 766980 ']' 00:06:15.416 15:30:06 -- common/autotest_common.sh@940 -- # kill -0 766980 00:06:15.416 15:30:06 -- common/autotest_common.sh@941 -- # uname 00:06:15.416 15:30:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:15.416 15:30:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 766980 00:06:15.416 15:30:06 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:15.416 15:30:06 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:15.416 15:30:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 766980' 00:06:15.416 killing process with pid 766980 00:06:15.416 15:30:06 -- common/autotest_common.sh@955 -- # kill 766980 00:06:15.416 15:30:06 -- common/autotest_common.sh@960 -- # wait 766980 00:06:15.676 nvmf threads initialize successfully 00:06:15.676 bdev subsystem init successfully 00:06:15.676 created a nvmf target service 00:06:15.676 create targets's poll groups done 00:06:15.676 all subsystems of target started 00:06:15.676 nvmf target is running 00:06:15.676 all subsystems of target stopped 00:06:15.676 destroy targets's poll groups done 00:06:15.676 destroyed the nvmf target service 00:06:15.676 bdev subsystem finish successfully 00:06:15.676 nvmf threads destroy successfully 00:06:15.676 15:30:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:15.676 15:30:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:15.676 15:30:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:15.676 15:30:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:15.676 15:30:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:15.676 15:30:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:15.676 15:30:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:15.676 15:30:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:17.581 15:30:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:17.581 15:30:08 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:17.581 15:30:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:17.581 15:30:08 -- common/autotest_common.sh@10 -- # set +x 00:06:17.581 00:06:17.581 real 0m16.128s 00:06:17.581 user 0m45.633s 00:06:17.581 sys 0m3.256s 00:06:17.581 15:30:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:17.581 15:30:08 -- common/autotest_common.sh@10 -- # set +x 00:06:17.581 ************************************ 00:06:17.581 END TEST nvmf_example 00:06:17.581 ************************************ 00:06:17.581 15:30:09 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:17.581 15:30:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:17.581 15:30:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:17.581 15:30:09 -- common/autotest_common.sh@10 -- # set +x 00:06:17.581 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:06:17.581 ************************************ 00:06:17.581 START TEST nvmf_filesystem 00:06:17.581 ************************************ 00:06:17.581 15:30:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:17.843 * Looking for test storage... 00:06:17.843 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:17.843 15:30:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:17.843 15:30:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:17.843 15:30:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:17.844 15:30:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:17.844 15:30:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:17.844 15:30:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:17.844 15:30:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:17.844 15:30:09 -- scripts/common.sh@335 -- # IFS=.-: 00:06:17.844 15:30:09 -- scripts/common.sh@335 -- # read -ra ver1 00:06:17.844 15:30:09 -- scripts/common.sh@336 -- # IFS=.-: 00:06:17.844 15:30:09 -- scripts/common.sh@336 -- # read -ra ver2 00:06:17.844 15:30:09 -- scripts/common.sh@337 -- # local 'op=<' 00:06:17.844 15:30:09 -- scripts/common.sh@339 -- # ver1_l=2 00:06:17.844 15:30:09 -- scripts/common.sh@340 -- # ver2_l=1 00:06:17.844 15:30:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:17.844 15:30:09 -- scripts/common.sh@343 -- # case "$op" in 00:06:17.844 15:30:09 -- scripts/common.sh@344 -- # : 1 00:06:17.844 15:30:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:17.844 15:30:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:17.844 15:30:09 -- scripts/common.sh@364 -- # decimal 1 00:06:17.844 15:30:09 -- scripts/common.sh@352 -- # local d=1 00:06:17.844 15:30:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:17.844 15:30:09 -- scripts/common.sh@354 -- # echo 1 00:06:17.844 15:30:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:17.844 15:30:09 -- scripts/common.sh@365 -- # decimal 2 00:06:17.844 15:30:09 -- scripts/common.sh@352 -- # local d=2 00:06:17.844 15:30:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:17.844 15:30:09 -- scripts/common.sh@354 -- # echo 2 00:06:17.844 15:30:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:17.844 15:30:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:17.844 15:30:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:17.844 15:30:09 -- scripts/common.sh@367 -- # return 0 00:06:17.844 15:30:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:17.844 15:30:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:17.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:17.844 --rc genhtml_branch_coverage=1 00:06:17.844 --rc genhtml_function_coverage=1 00:06:17.844 --rc genhtml_legend=1 00:06:17.844 --rc geninfo_all_blocks=1 00:06:17.844 --rc geninfo_unexecuted_blocks=1 00:06:17.844 00:06:17.844 ' 00:06:17.844 15:30:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:17.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:17.844 --rc genhtml_branch_coverage=1 00:06:17.844 --rc genhtml_function_coverage=1 00:06:17.844 --rc genhtml_legend=1 00:06:17.844 --rc geninfo_all_blocks=1 00:06:17.844 --rc geninfo_unexecuted_blocks=1 00:06:17.844 00:06:17.844 ' 00:06:17.844 15:30:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:17.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:17.844 --rc genhtml_branch_coverage=1 00:06:17.844 --rc genhtml_function_coverage=1 00:06:17.844 --rc genhtml_legend=1 00:06:17.844 --rc geninfo_all_blocks=1 00:06:17.844 --rc geninfo_unexecuted_blocks=1 00:06:17.844 00:06:17.844 ' 00:06:17.844 15:30:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:17.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:17.844 --rc genhtml_branch_coverage=1 00:06:17.844 --rc genhtml_function_coverage=1 00:06:17.844 --rc genhtml_legend=1 00:06:17.844 --rc geninfo_all_blocks=1 00:06:17.844 --rc geninfo_unexecuted_blocks=1 00:06:17.844 00:06:17.844 ' 00:06:17.844 15:30:09 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:17.844 15:30:09 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:17.844 15:30:09 -- common/autotest_common.sh@34 -- # set -e 00:06:17.844 15:30:09 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:17.844 15:30:09 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:17.844 15:30:09 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:17.844 15:30:09 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:17.844 15:30:09 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:17.844 15:30:09 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:17.844 15:30:09 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:17.844 15:30:09 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:17.844 15:30:09 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:17.844 15:30:09 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:17.844 15:30:09 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:17.844 15:30:09 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:17.844 15:30:09 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:17.844 15:30:09 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:17.844 15:30:09 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:17.844 15:30:09 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:17.844 15:30:09 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:17.844 15:30:09 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:17.844 15:30:09 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:17.844 15:30:09 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:17.844 15:30:09 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:17.844 15:30:09 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:17.844 15:30:09 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:17.844 15:30:09 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:17.844 15:30:09 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:17.844 15:30:09 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:17.844 15:30:09 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:17.844 15:30:09 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:17.844 15:30:09 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:17.844 15:30:09 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:17.844 15:30:09 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:17.844 15:30:09 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:17.844 15:30:09 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:17.844 15:30:09 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:17.844 15:30:09 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:17.844 15:30:09 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:17.844 15:30:09 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:17.844 15:30:09 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:17.844 15:30:09 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:17.844 15:30:09 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:17.844 15:30:09 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:17.844 15:30:09 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:17.844 15:30:09 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:17.844 15:30:09 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:17.844 15:30:09 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:17.844 15:30:09 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:17.844 15:30:09 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:17.844 15:30:09 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:17.844 15:30:09 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:17.844 15:30:09 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:17.844 15:30:09 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:17.844 15:30:09 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:17.844 15:30:09 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:17.844 15:30:09 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:17.844 15:30:09 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:17.844 15:30:09 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:17.844 15:30:09 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:17.844 15:30:09 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:17.845 15:30:09 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:17.845 15:30:09 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:17.845 15:30:09 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:17.845 15:30:09 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:17.845 15:30:09 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:17.845 15:30:09 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:17.845 15:30:09 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:17.845 15:30:09 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:17.845 15:30:09 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:17.845 15:30:09 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:17.845 15:30:09 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:17.845 15:30:09 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:17.845 15:30:09 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:17.845 15:30:09 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:17.845 15:30:09 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:17.845 15:30:09 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:17.845 15:30:09 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:17.845 15:30:09 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:17.845 15:30:09 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:17.845 15:30:09 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:17.845 15:30:09 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:17.845 15:30:09 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:17.845 15:30:09 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:17.845 15:30:09 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:17.845 15:30:09 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:17.845 15:30:09 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:17.845 15:30:09 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:17.845 15:30:09 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:17.845 15:30:09 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:17.845 15:30:09 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:17.845 15:30:09 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:17.845 15:30:09 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:17.845 15:30:09 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:17.845 15:30:09 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:17.845 15:30:09 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:17.845 15:30:09 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:17.845 15:30:09 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:17.845 15:30:09 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:17.845 15:30:09 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:17.845 15:30:09 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:17.845 15:30:09 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:17.845 #define SPDK_CONFIG_H 00:06:17.845 #define SPDK_CONFIG_APPS 1 00:06:17.845 #define SPDK_CONFIG_ARCH native 00:06:17.845 #undef SPDK_CONFIG_ASAN 00:06:17.845 #undef SPDK_CONFIG_AVAHI 00:06:17.845 #undef SPDK_CONFIG_CET 00:06:17.845 #define SPDK_CONFIG_COVERAGE 1 00:06:17.845 #define SPDK_CONFIG_CROSS_PREFIX 00:06:17.845 #undef SPDK_CONFIG_CRYPTO 00:06:17.845 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:17.845 #undef SPDK_CONFIG_CUSTOMOCF 00:06:17.845 #undef SPDK_CONFIG_DAOS 00:06:17.845 #define SPDK_CONFIG_DAOS_DIR 00:06:17.845 #define SPDK_CONFIG_DEBUG 1 00:06:17.845 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:17.845 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:17.845 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:17.845 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:17.845 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:17.845 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:17.845 #define SPDK_CONFIG_EXAMPLES 1 00:06:17.845 #undef SPDK_CONFIG_FC 00:06:17.845 #define SPDK_CONFIG_FC_PATH 00:06:17.845 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:17.845 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:17.845 #undef SPDK_CONFIG_FUSE 00:06:17.845 #undef SPDK_CONFIG_FUZZER 00:06:17.845 #define SPDK_CONFIG_FUZZER_LIB 00:06:17.845 #undef SPDK_CONFIG_GOLANG 00:06:17.845 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:17.845 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:17.845 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:17.845 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:17.845 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:17.845 #define SPDK_CONFIG_IDXD 1 00:06:17.845 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:17.845 #undef SPDK_CONFIG_IPSEC_MB 00:06:17.845 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:17.845 #define SPDK_CONFIG_ISAL 1 00:06:17.845 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:17.845 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:17.845 #define SPDK_CONFIG_LIBDIR 00:06:17.845 #undef SPDK_CONFIG_LTO 00:06:17.845 #define SPDK_CONFIG_MAX_LCORES 00:06:17.845 #define SPDK_CONFIG_NVME_CUSE 1 00:06:17.845 #undef SPDK_CONFIG_OCF 00:06:17.845 #define SPDK_CONFIG_OCF_PATH 00:06:17.845 #define SPDK_CONFIG_OPENSSL_PATH 00:06:17.845 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:17.845 #undef SPDK_CONFIG_PGO_USE 00:06:17.845 #define SPDK_CONFIG_PREFIX /usr/local 00:06:17.845 #undef SPDK_CONFIG_RAID5F 00:06:17.845 #undef SPDK_CONFIG_RBD 00:06:17.845 #define SPDK_CONFIG_RDMA 1 00:06:17.845 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:17.845 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:17.845 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:17.845 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:17.845 #define SPDK_CONFIG_SHARED 1 00:06:17.845 #undef SPDK_CONFIG_SMA 00:06:17.845 #define SPDK_CONFIG_TESTS 1 00:06:17.845 #undef SPDK_CONFIG_TSAN 00:06:17.845 #define SPDK_CONFIG_UBLK 1 00:06:17.845 #define SPDK_CONFIG_UBSAN 1 00:06:17.845 #undef SPDK_CONFIG_UNIT_TESTS 00:06:17.845 #undef SPDK_CONFIG_URING 00:06:17.845 #define SPDK_CONFIG_URING_PATH 00:06:17.845 #undef SPDK_CONFIG_URING_ZNS 00:06:17.845 #undef SPDK_CONFIG_USDT 00:06:17.845 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:17.845 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:17.845 #undef SPDK_CONFIG_VFIO_USER 00:06:17.845 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:17.845 #define SPDK_CONFIG_VHOST 1 00:06:17.845 #define SPDK_CONFIG_VIRTIO 1 00:06:17.845 #undef SPDK_CONFIG_VTUNE 00:06:17.845 #define SPDK_CONFIG_VTUNE_DIR 00:06:17.845 #define SPDK_CONFIG_WERROR 1 00:06:17.845 #define SPDK_CONFIG_WPDK_DIR 00:06:17.845 #undef SPDK_CONFIG_XNVME 00:06:17.845 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:17.845 15:30:09 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:17.845 15:30:09 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:17.845 15:30:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:17.845 15:30:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:17.845 15:30:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:17.845 15:30:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:17.845 15:30:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:17.845 15:30:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:17.845 15:30:09 -- paths/export.sh@5 -- # export PATH 00:06:17.846 15:30:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:17.846 15:30:09 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:17.846 15:30:09 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:17.846 15:30:09 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:17.846 15:30:09 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:17.846 15:30:09 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:17.846 15:30:09 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:17.846 15:30:09 -- pm/common@16 -- # TEST_TAG=N/A 00:06:17.846 15:30:09 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:17.846 15:30:09 -- common/autotest_common.sh@52 -- # : 1 00:06:17.846 15:30:09 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:17.846 15:30:09 -- common/autotest_common.sh@56 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:17.846 15:30:09 -- common/autotest_common.sh@58 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:17.846 15:30:09 -- common/autotest_common.sh@60 -- # : 1 00:06:17.846 15:30:09 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:17.846 15:30:09 -- common/autotest_common.sh@62 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:17.846 15:30:09 -- common/autotest_common.sh@64 -- # : 00:06:17.846 15:30:09 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:17.846 15:30:09 -- common/autotest_common.sh@66 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:17.846 15:30:09 -- common/autotest_common.sh@68 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:17.846 15:30:09 -- common/autotest_common.sh@70 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:17.846 15:30:09 -- common/autotest_common.sh@72 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:17.846 15:30:09 -- common/autotest_common.sh@74 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:17.846 15:30:09 -- common/autotest_common.sh@76 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:17.846 15:30:09 -- common/autotest_common.sh@78 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:17.846 15:30:09 -- common/autotest_common.sh@80 -- # : 1 00:06:17.846 15:30:09 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:17.846 15:30:09 -- common/autotest_common.sh@82 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:17.846 15:30:09 -- common/autotest_common.sh@84 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:17.846 15:30:09 -- common/autotest_common.sh@86 -- # : 1 00:06:17.846 15:30:09 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:17.846 15:30:09 -- common/autotest_common.sh@88 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:17.846 15:30:09 -- common/autotest_common.sh@90 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:17.846 15:30:09 -- common/autotest_common.sh@92 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:17.846 15:30:09 -- common/autotest_common.sh@94 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:17.846 15:30:09 -- common/autotest_common.sh@96 -- # : tcp 00:06:17.846 15:30:09 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:17.846 15:30:09 -- common/autotest_common.sh@98 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:17.846 15:30:09 -- common/autotest_common.sh@100 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:17.846 15:30:09 -- common/autotest_common.sh@102 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:17.846 15:30:09 -- common/autotest_common.sh@104 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:17.846 15:30:09 -- common/autotest_common.sh@106 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:17.846 15:30:09 -- common/autotest_common.sh@108 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:17.846 15:30:09 -- common/autotest_common.sh@110 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:17.846 15:30:09 -- common/autotest_common.sh@112 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:17.846 15:30:09 -- common/autotest_common.sh@114 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:17.846 15:30:09 -- common/autotest_common.sh@116 -- # : 1 00:06:17.846 15:30:09 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:17.846 15:30:09 -- common/autotest_common.sh@118 -- # : 00:06:17.846 15:30:09 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:17.846 15:30:09 -- common/autotest_common.sh@120 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:17.846 15:30:09 -- common/autotest_common.sh@122 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:17.846 15:30:09 -- common/autotest_common.sh@124 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:17.846 15:30:09 -- common/autotest_common.sh@126 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:17.846 15:30:09 -- common/autotest_common.sh@128 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:17.846 15:30:09 -- common/autotest_common.sh@130 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:17.846 15:30:09 -- common/autotest_common.sh@132 -- # : 00:06:17.846 15:30:09 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:17.846 15:30:09 -- common/autotest_common.sh@134 -- # : true 00:06:17.846 15:30:09 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:17.846 15:30:09 -- common/autotest_common.sh@136 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:17.846 15:30:09 -- common/autotest_common.sh@138 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:17.846 15:30:09 -- common/autotest_common.sh@140 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:17.846 15:30:09 -- common/autotest_common.sh@142 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:17.846 15:30:09 -- common/autotest_common.sh@144 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:17.846 15:30:09 -- common/autotest_common.sh@146 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:17.846 15:30:09 -- common/autotest_common.sh@148 -- # : e810 00:06:17.846 15:30:09 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:17.846 15:30:09 -- common/autotest_common.sh@150 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:17.846 15:30:09 -- common/autotest_common.sh@152 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:17.846 15:30:09 -- common/autotest_common.sh@154 -- # : 0 00:06:17.846 15:30:09 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:17.847 15:30:09 -- common/autotest_common.sh@156 -- # : 0 00:06:17.847 15:30:09 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:17.847 15:30:09 -- common/autotest_common.sh@158 -- # : 0 00:06:17.847 15:30:09 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:17.847 15:30:09 -- common/autotest_common.sh@160 -- # : 0 00:06:17.847 15:30:09 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:17.847 15:30:09 -- common/autotest_common.sh@163 -- # : 00:06:17.847 15:30:09 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:17.847 15:30:09 -- common/autotest_common.sh@165 -- # : 0 00:06:17.847 15:30:09 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:17.847 15:30:09 -- common/autotest_common.sh@167 -- # : 0 00:06:17.847 15:30:09 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:17.847 15:30:09 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:17.847 15:30:09 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:17.847 15:30:09 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:17.847 15:30:09 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:17.847 15:30:09 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:17.847 15:30:09 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:17.847 15:30:09 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:17.847 15:30:09 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:17.847 15:30:09 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:17.847 15:30:09 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:17.847 15:30:09 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:17.847 15:30:09 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:17.847 15:30:09 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:17.847 15:30:09 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:17.847 15:30:09 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:17.847 15:30:09 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:17.847 15:30:09 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:17.847 15:30:09 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:17.847 15:30:09 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:17.847 15:30:09 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:17.847 15:30:09 -- common/autotest_common.sh@196 -- # cat 00:06:17.847 15:30:09 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:17.847 15:30:09 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:17.847 15:30:09 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:17.847 15:30:09 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:17.847 15:30:09 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:17.847 15:30:09 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:17.847 15:30:09 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:17.847 15:30:09 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:17.847 15:30:09 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:17.847 15:30:09 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:17.847 15:30:09 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:17.847 15:30:09 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:17.847 15:30:09 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:17.847 15:30:09 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:17.847 15:30:09 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:17.847 15:30:09 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:17.847 15:30:09 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:17.847 15:30:09 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:17.847 15:30:09 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:17.847 15:30:09 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:17.847 15:30:09 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:17.847 15:30:09 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:17.847 15:30:09 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:17.847 15:30:09 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:17.847 15:30:09 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:17.847 15:30:09 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:17.847 15:30:09 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:17.847 15:30:09 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:17.847 15:30:09 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:17.847 15:30:09 -- common/autotest_common.sh@259 -- # valgrind= 00:06:17.847 15:30:09 -- common/autotest_common.sh@265 -- # uname -s 00:06:17.847 15:30:09 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:17.847 15:30:09 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:17.847 15:30:09 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:17.847 15:30:09 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:17.847 15:30:09 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:17.847 15:30:09 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:17.847 15:30:09 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:17.847 15:30:09 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:17.847 15:30:09 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:17.847 15:30:09 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:17.847 15:30:09 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:17.847 15:30:09 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:17.847 15:30:09 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:17.847 15:30:09 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:17.847 15:30:09 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:17.848 15:30:09 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:17.848 15:30:09 -- common/autotest_common.sh@319 -- # [[ -z 769250 ]] 00:06:17.848 15:30:09 -- common/autotest_common.sh@319 -- # kill -0 769250 00:06:17.848 15:30:09 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:17.848 15:30:09 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:17.848 15:30:09 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:17.848 15:30:09 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:17.848 15:30:09 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:17.848 15:30:09 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:17.848 15:30:09 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:17.848 15:30:09 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:17.848 15:30:09 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.b5htho 00:06:17.848 15:30:09 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:17.848 15:30:09 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:17.848 15:30:09 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:17.848 15:30:09 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.b5htho/tests/target /tmp/spdk.b5htho 00:06:17.848 15:30:09 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:17.848 15:30:09 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.848 15:30:09 -- common/autotest_common.sh@328 -- # df -T 00:06:17.848 15:30:09 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:17.848 15:30:09 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:17.848 15:30:09 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:17.848 15:30:09 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:17.848 15:30:09 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:17.848 15:30:09 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:17.848 15:30:09 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.848 15:30:09 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:17.848 15:30:09 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:17.848 15:30:09 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:17.848 15:30:09 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:17.848 15:30:09 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:17.848 15:30:09 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.848 15:30:09 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:17.848 15:30:09 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:17.848 15:30:09 -- common/autotest_common.sh@363 -- # avails["$mount"]=55326633984 00:06:17.848 15:30:09 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988515840 00:06:17.848 15:30:09 -- common/autotest_common.sh@364 -- # uses["$mount"]=6661881856 00:06:17.848 15:30:09 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.848 15:30:09 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:17.848 15:30:09 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:17.848 15:30:09 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991663104 00:06:17.848 15:30:09 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994255872 00:06:17.848 15:30:09 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:17.848 15:30:09 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.848 15:30:09 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:17.848 15:30:09 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:17.848 15:30:09 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:06:17.848 15:30:09 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:06:17.848 15:30:09 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:17.848 15:30:09 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.848 15:30:09 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:17.848 15:30:09 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:17.848 15:30:09 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993072128 00:06:17.848 15:30:09 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:06:17.848 15:30:09 -- common/autotest_common.sh@364 -- # uses["$mount"]=1187840 00:06:17.848 15:30:09 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.848 15:30:09 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:17.848 15:30:09 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:17.848 15:30:09 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:17.848 15:30:09 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:17.848 15:30:09 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:17.848 15:30:09 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:17.848 15:30:09 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:17.848 * Looking for test storage... 00:06:17.848 15:30:09 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:17.848 15:30:09 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:17.848 15:30:09 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:17.848 15:30:09 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:17.848 15:30:09 -- common/autotest_common.sh@373 -- # mount=/ 00:06:17.848 15:30:09 -- common/autotest_common.sh@375 -- # target_space=55326633984 00:06:17.848 15:30:09 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:17.848 15:30:09 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:17.848 15:30:09 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:17.848 15:30:09 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:17.848 15:30:09 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:17.848 15:30:09 -- common/autotest_common.sh@382 -- # new_size=8876474368 00:06:17.848 15:30:09 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:17.848 15:30:09 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:17.848 15:30:09 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:17.848 15:30:09 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:17.848 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:17.848 15:30:09 -- common/autotest_common.sh@390 -- # return 0 00:06:17.848 15:30:09 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:17.848 15:30:09 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:17.848 15:30:09 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:17.848 15:30:09 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:17.848 15:30:09 -- common/autotest_common.sh@1682 -- # true 00:06:17.848 15:30:09 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:17.848 15:30:09 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:17.848 15:30:09 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:17.848 15:30:09 -- common/autotest_common.sh@27 -- # exec 00:06:17.848 15:30:09 -- common/autotest_common.sh@29 -- # exec 00:06:17.848 15:30:09 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:17.848 15:30:09 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:17.848 15:30:09 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:17.848 15:30:09 -- common/autotest_common.sh@18 -- # set -x 00:06:17.848 15:30:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:17.848 15:30:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:17.848 15:30:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:18.108 15:30:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:18.108 15:30:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:18.108 15:30:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:18.108 15:30:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:18.108 15:30:09 -- scripts/common.sh@335 -- # IFS=.-: 00:06:18.108 15:30:09 -- scripts/common.sh@335 -- # read -ra ver1 00:06:18.108 15:30:09 -- scripts/common.sh@336 -- # IFS=.-: 00:06:18.108 15:30:09 -- scripts/common.sh@336 -- # read -ra ver2 00:06:18.108 15:30:09 -- scripts/common.sh@337 -- # local 'op=<' 00:06:18.108 15:30:09 -- scripts/common.sh@339 -- # ver1_l=2 00:06:18.108 15:30:09 -- scripts/common.sh@340 -- # ver2_l=1 00:06:18.108 15:30:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:18.108 15:30:09 -- scripts/common.sh@343 -- # case "$op" in 00:06:18.108 15:30:09 -- scripts/common.sh@344 -- # : 1 00:06:18.108 15:30:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:18.108 15:30:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:18.108 15:30:09 -- scripts/common.sh@364 -- # decimal 1 00:06:18.108 15:30:09 -- scripts/common.sh@352 -- # local d=1 00:06:18.108 15:30:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:18.108 15:30:09 -- scripts/common.sh@354 -- # echo 1 00:06:18.108 15:30:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:18.108 15:30:09 -- scripts/common.sh@365 -- # decimal 2 00:06:18.108 15:30:09 -- scripts/common.sh@352 -- # local d=2 00:06:18.108 15:30:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:18.108 15:30:09 -- scripts/common.sh@354 -- # echo 2 00:06:18.108 15:30:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:18.108 15:30:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:18.108 15:30:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:18.108 15:30:09 -- scripts/common.sh@367 -- # return 0 00:06:18.108 15:30:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:18.108 15:30:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:18.108 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:18.108 --rc genhtml_branch_coverage=1 00:06:18.108 --rc genhtml_function_coverage=1 00:06:18.108 --rc genhtml_legend=1 00:06:18.108 --rc geninfo_all_blocks=1 00:06:18.108 --rc geninfo_unexecuted_blocks=1 00:06:18.108 00:06:18.108 ' 00:06:18.108 15:30:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:18.108 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:18.109 --rc genhtml_branch_coverage=1 00:06:18.109 --rc genhtml_function_coverage=1 00:06:18.109 --rc genhtml_legend=1 00:06:18.109 --rc geninfo_all_blocks=1 00:06:18.109 --rc geninfo_unexecuted_blocks=1 00:06:18.109 00:06:18.109 ' 00:06:18.109 15:30:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:18.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:18.109 --rc genhtml_branch_coverage=1 00:06:18.109 --rc genhtml_function_coverage=1 00:06:18.109 --rc genhtml_legend=1 00:06:18.109 --rc geninfo_all_blocks=1 00:06:18.109 --rc geninfo_unexecuted_blocks=1 00:06:18.109 00:06:18.109 ' 00:06:18.109 15:30:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:18.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:18.109 --rc genhtml_branch_coverage=1 00:06:18.109 --rc genhtml_function_coverage=1 00:06:18.109 --rc genhtml_legend=1 00:06:18.109 --rc geninfo_all_blocks=1 00:06:18.109 --rc geninfo_unexecuted_blocks=1 00:06:18.109 00:06:18.109 ' 00:06:18.109 15:30:09 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:18.109 15:30:09 -- nvmf/common.sh@7 -- # uname -s 00:06:18.109 15:30:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:18.109 15:30:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:18.109 15:30:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:18.109 15:30:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:18.109 15:30:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:18.109 15:30:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:18.109 15:30:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:18.109 15:30:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:18.109 15:30:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:18.109 15:30:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:18.109 15:30:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:18.109 15:30:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:18.109 15:30:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:18.109 15:30:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:18.109 15:30:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:18.109 15:30:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:18.109 15:30:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:18.109 15:30:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:18.109 15:30:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:18.109 15:30:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:18.109 15:30:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:18.109 15:30:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:18.109 15:30:09 -- paths/export.sh@5 -- # export PATH 00:06:18.109 15:30:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:18.109 15:30:09 -- nvmf/common.sh@46 -- # : 0 00:06:18.109 15:30:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:18.109 15:30:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:18.109 15:30:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:18.109 15:30:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:18.109 15:30:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:18.109 15:30:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:18.109 15:30:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:18.109 15:30:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:18.109 15:30:09 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:18.109 15:30:09 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:18.109 15:30:09 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:18.109 15:30:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:18.109 15:30:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:18.109 15:30:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:18.109 15:30:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:18.109 15:30:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:18.109 15:30:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:18.109 15:30:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:18.109 15:30:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:18.109 15:30:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:18.109 15:30:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:18.109 15:30:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:18.109 15:30:09 -- common/autotest_common.sh@10 -- # set +x 00:06:20.018 15:30:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:20.018 15:30:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:20.018 15:30:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:20.018 15:30:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:20.018 15:30:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:20.018 15:30:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:20.018 15:30:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:20.018 15:30:11 -- nvmf/common.sh@294 -- # net_devs=() 00:06:20.018 15:30:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:20.018 15:30:11 -- nvmf/common.sh@295 -- # e810=() 00:06:20.018 15:30:11 -- nvmf/common.sh@295 -- # local -ga e810 00:06:20.018 15:30:11 -- nvmf/common.sh@296 -- # x722=() 00:06:20.018 15:30:11 -- nvmf/common.sh@296 -- # local -ga x722 00:06:20.018 15:30:11 -- nvmf/common.sh@297 -- # mlx=() 00:06:20.018 15:30:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:20.018 15:30:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:20.018 15:30:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:20.018 15:30:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:20.018 15:30:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:20.018 15:30:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:20.018 15:30:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:20.018 15:30:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:20.018 15:30:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:20.018 15:30:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:20.018 15:30:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:20.018 15:30:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:20.018 15:30:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:20.018 15:30:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:20.018 15:30:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:20.018 15:30:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:20.018 15:30:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:20.018 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:20.018 15:30:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:20.018 15:30:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:20.018 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:20.018 15:30:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:20.018 15:30:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:20.018 15:30:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:20.018 15:30:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:20.018 15:30:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:20.018 15:30:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:20.018 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:20.018 15:30:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:20.018 15:30:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:20.018 15:30:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:20.018 15:30:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:20.018 15:30:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:20.018 15:30:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:20.018 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:20.018 15:30:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:20.018 15:30:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:20.018 15:30:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:20.018 15:30:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:20.018 15:30:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:20.018 15:30:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:20.018 15:30:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:20.018 15:30:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:20.018 15:30:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:20.018 15:30:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:20.018 15:30:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:20.018 15:30:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:20.018 15:30:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:20.018 15:30:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:20.018 15:30:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:20.018 15:30:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:20.018 15:30:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:20.018 15:30:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:20.277 15:30:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:20.277 15:30:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:20.277 15:30:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:20.277 15:30:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:20.277 15:30:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:20.277 15:30:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:20.277 15:30:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:20.277 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:20.277 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:06:20.277 00:06:20.277 --- 10.0.0.2 ping statistics --- 00:06:20.277 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:20.277 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:06:20.277 15:30:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:20.277 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:20.277 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:06:20.278 00:06:20.278 --- 10.0.0.1 ping statistics --- 00:06:20.278 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:20.278 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:06:20.278 15:30:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:20.278 15:30:11 -- nvmf/common.sh@410 -- # return 0 00:06:20.278 15:30:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:20.278 15:30:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:20.278 15:30:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:20.278 15:30:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:20.278 15:30:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:20.278 15:30:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:20.278 15:30:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:20.278 15:30:11 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:20.278 15:30:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:20.278 15:30:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:20.278 15:30:11 -- common/autotest_common.sh@10 -- # set +x 00:06:20.278 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:06:20.278 ************************************ 00:06:20.278 START TEST nvmf_filesystem_no_in_capsule 00:06:20.278 ************************************ 00:06:20.278 15:30:11 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:20.278 15:30:11 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:20.278 15:30:11 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:20.278 15:30:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:20.278 15:30:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:20.278 15:30:11 -- common/autotest_common.sh@10 -- # set +x 00:06:20.278 15:30:11 -- nvmf/common.sh@469 -- # nvmfpid=770904 00:06:20.278 15:30:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:20.278 15:30:11 -- nvmf/common.sh@470 -- # waitforlisten 770904 00:06:20.278 15:30:11 -- common/autotest_common.sh@829 -- # '[' -z 770904 ']' 00:06:20.278 15:30:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:20.278 15:30:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:20.278 15:30:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:20.278 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:20.278 15:30:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:20.278 15:30:11 -- common/autotest_common.sh@10 -- # set +x 00:06:20.278 [2024-11-26 15:30:11.674455] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:20.278 [2024-11-26 15:30:11.674525] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:20.278 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.536 [2024-11-26 15:30:11.746905] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:20.536 [2024-11-26 15:30:11.868119] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:20.536 [2024-11-26 15:30:11.868274] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:20.536 [2024-11-26 15:30:11.868294] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:20.536 [2024-11-26 15:30:11.868307] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:20.536 [2024-11-26 15:30:11.868378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:20.536 [2024-11-26 15:30:11.868447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:20.536 [2024-11-26 15:30:11.868499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:20.536 [2024-11-26 15:30:11.868502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.474 15:30:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:21.474 15:30:12 -- common/autotest_common.sh@862 -- # return 0 00:06:21.474 15:30:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:21.474 15:30:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:21.474 15:30:12 -- common/autotest_common.sh@10 -- # set +x 00:06:21.474 15:30:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:21.474 15:30:12 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:21.474 15:30:12 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:21.474 15:30:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.474 15:30:12 -- common/autotest_common.sh@10 -- # set +x 00:06:21.474 [2024-11-26 15:30:12.710391] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:21.474 15:30:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.474 15:30:12 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:21.474 15:30:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.474 15:30:12 -- common/autotest_common.sh@10 -- # set +x 00:06:21.474 Malloc1 00:06:21.474 15:30:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.474 15:30:12 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:21.474 15:30:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.474 15:30:12 -- common/autotest_common.sh@10 -- # set +x 00:06:21.474 15:30:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.474 15:30:12 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:21.474 15:30:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.474 15:30:12 -- common/autotest_common.sh@10 -- # set +x 00:06:21.474 15:30:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.474 15:30:12 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:21.474 15:30:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.474 15:30:12 -- common/autotest_common.sh@10 -- # set +x 00:06:21.474 [2024-11-26 15:30:12.893533] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:21.474 15:30:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.474 15:30:12 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:21.474 15:30:12 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:21.474 15:30:12 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:21.474 15:30:12 -- common/autotest_common.sh@1369 -- # local bs 00:06:21.474 15:30:12 -- common/autotest_common.sh@1370 -- # local nb 00:06:21.474 15:30:12 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:21.474 15:30:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.474 15:30:12 -- common/autotest_common.sh@10 -- # set +x 00:06:21.474 15:30:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.474 15:30:12 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:21.474 { 00:06:21.474 "name": "Malloc1", 00:06:21.474 "aliases": [ 00:06:21.474 "525172e9-27d1-4c78-90f7-22574f254b1f" 00:06:21.474 ], 00:06:21.474 "product_name": "Malloc disk", 00:06:21.474 "block_size": 512, 00:06:21.474 "num_blocks": 1048576, 00:06:21.474 "uuid": "525172e9-27d1-4c78-90f7-22574f254b1f", 00:06:21.474 "assigned_rate_limits": { 00:06:21.474 "rw_ios_per_sec": 0, 00:06:21.474 "rw_mbytes_per_sec": 0, 00:06:21.474 "r_mbytes_per_sec": 0, 00:06:21.474 "w_mbytes_per_sec": 0 00:06:21.474 }, 00:06:21.474 "claimed": true, 00:06:21.474 "claim_type": "exclusive_write", 00:06:21.474 "zoned": false, 00:06:21.474 "supported_io_types": { 00:06:21.474 "read": true, 00:06:21.474 "write": true, 00:06:21.474 "unmap": true, 00:06:21.474 "write_zeroes": true, 00:06:21.474 "flush": true, 00:06:21.474 "reset": true, 00:06:21.474 "compare": false, 00:06:21.474 "compare_and_write": false, 00:06:21.474 "abort": true, 00:06:21.474 "nvme_admin": false, 00:06:21.474 "nvme_io": false 00:06:21.474 }, 00:06:21.474 "memory_domains": [ 00:06:21.474 { 00:06:21.474 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:21.474 "dma_device_type": 2 00:06:21.474 } 00:06:21.474 ], 00:06:21.474 "driver_specific": {} 00:06:21.474 } 00:06:21.474 ]' 00:06:21.474 15:30:12 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:21.732 15:30:12 -- common/autotest_common.sh@1372 -- # bs=512 00:06:21.732 15:30:12 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:21.732 15:30:12 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:21.732 15:30:12 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:21.732 15:30:12 -- common/autotest_common.sh@1377 -- # echo 512 00:06:21.732 15:30:12 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:21.733 15:30:12 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:22.302 15:30:13 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:22.302 15:30:13 -- common/autotest_common.sh@1187 -- # local i=0 00:06:22.302 15:30:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:22.302 15:30:13 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:22.302 15:30:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:24.208 15:30:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:24.208 15:30:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:24.208 15:30:15 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:24.208 15:30:15 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:24.208 15:30:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:24.208 15:30:15 -- common/autotest_common.sh@1197 -- # return 0 00:06:24.208 15:30:15 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:24.208 15:30:15 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:24.208 15:30:15 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:24.208 15:30:15 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:24.208 15:30:15 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:24.208 15:30:15 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:24.208 15:30:15 -- setup/common.sh@80 -- # echo 536870912 00:06:24.208 15:30:15 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:24.208 15:30:15 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:24.208 15:30:15 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:24.208 15:30:15 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:24.779 15:30:16 -- target/filesystem.sh@69 -- # partprobe 00:06:25.040 15:30:16 -- target/filesystem.sh@70 -- # sleep 1 00:06:25.977 15:30:17 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:25.977 15:30:17 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:25.977 15:30:17 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:25.977 15:30:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.977 15:30:17 -- common/autotest_common.sh@10 -- # set +x 00:06:25.977 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:06:25.977 ************************************ 00:06:25.977 START TEST filesystem_ext4 00:06:25.977 ************************************ 00:06:25.977 15:30:17 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:25.977 15:30:17 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:25.977 15:30:17 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:25.977 15:30:17 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:25.977 15:30:17 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:25.977 15:30:17 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:25.977 15:30:17 -- common/autotest_common.sh@914 -- # local i=0 00:06:25.977 15:30:17 -- common/autotest_common.sh@915 -- # local force 00:06:25.977 15:30:17 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:25.977 15:30:17 -- common/autotest_common.sh@918 -- # force=-F 00:06:25.977 15:30:17 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:25.977 mke2fs 1.47.0 (5-Feb-2023) 00:06:26.237 Discarding device blocks: 0/522240 done 00:06:26.237 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:26.237 Filesystem UUID: 9058e805-1b8c-49c1-a084-8ccfb17a953f 00:06:26.237 Superblock backups stored on blocks: 00:06:26.237 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:26.237 00:06:26.237 Allocating group tables: 0/64 done 00:06:26.237 Writing inode tables: 0/64 done 00:06:26.237 Creating journal (8192 blocks): done 00:06:28.187 Writing superblocks and filesystem accounting information: 0/64 4/64 done 00:06:28.187 00:06:28.187 15:30:19 -- common/autotest_common.sh@931 -- # return 0 00:06:28.187 15:30:19 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:33.464 15:30:24 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:33.464 15:30:24 -- target/filesystem.sh@25 -- # sync 00:06:33.464 15:30:24 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:33.464 15:30:24 -- target/filesystem.sh@27 -- # sync 00:06:33.464 15:30:24 -- target/filesystem.sh@29 -- # i=0 00:06:33.464 15:30:24 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:33.464 15:30:24 -- target/filesystem.sh@37 -- # kill -0 770904 00:06:33.464 15:30:24 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:33.464 15:30:24 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:33.464 15:30:24 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:33.464 15:30:24 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:33.464 00:06:33.464 real 0m7.370s 00:06:33.464 user 0m0.016s 00:06:33.464 sys 0m0.072s 00:06:33.464 15:30:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.464 15:30:24 -- common/autotest_common.sh@10 -- # set +x 00:06:33.464 ************************************ 00:06:33.464 END TEST filesystem_ext4 00:06:33.464 ************************************ 00:06:33.464 15:30:24 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:33.464 15:30:24 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:33.464 15:30:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.464 15:30:24 -- common/autotest_common.sh@10 -- # set +x 00:06:33.464 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:06:33.464 ************************************ 00:06:33.464 START TEST filesystem_btrfs 00:06:33.464 ************************************ 00:06:33.464 15:30:24 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:33.464 15:30:24 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:33.464 15:30:24 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:33.464 15:30:24 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:33.464 15:30:24 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:06:33.464 15:30:24 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:33.464 15:30:24 -- common/autotest_common.sh@914 -- # local i=0 00:06:33.464 15:30:24 -- common/autotest_common.sh@915 -- # local force 00:06:33.464 15:30:24 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:06:33.464 15:30:24 -- common/autotest_common.sh@920 -- # force=-f 00:06:33.464 15:30:24 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:33.722 btrfs-progs v6.8.1 00:06:33.722 See https://btrfs.readthedocs.io for more information. 00:06:33.722 00:06:33.722 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:33.722 NOTE: several default settings have changed in version 5.15, please make sure 00:06:33.722 this does not affect your deployments: 00:06:33.722 - DUP for metadata (-m dup) 00:06:33.722 - enabled no-holes (-O no-holes) 00:06:33.722 - enabled free-space-tree (-R free-space-tree) 00:06:33.722 00:06:33.722 Label: (null) 00:06:33.722 UUID: f0ff7229-2857-460a-98e7-d0e658655c3c 00:06:33.722 Node size: 16384 00:06:33.722 Sector size: 4096 (CPU page size: 4096) 00:06:33.722 Filesystem size: 510.00MiB 00:06:33.722 Block group profiles: 00:06:33.722 Data: single 8.00MiB 00:06:33.722 Metadata: DUP 32.00MiB 00:06:33.722 System: DUP 8.00MiB 00:06:33.722 SSD detected: yes 00:06:33.722 Zoned device: no 00:06:33.722 Features: extref, skinny-metadata, no-holes, free-space-tree 00:06:33.722 Checksum: crc32c 00:06:33.722 Number of devices: 1 00:06:33.722 Devices: 00:06:33.722 ID SIZE PATH 00:06:33.722 1 510.00MiB /dev/nvme0n1p1 00:06:33.722 00:06:33.722 15:30:24 -- common/autotest_common.sh@931 -- # return 0 00:06:33.722 15:30:24 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:34.288 15:30:25 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:34.288 15:30:25 -- target/filesystem.sh@25 -- # sync 00:06:34.547 15:30:25 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:34.547 15:30:25 -- target/filesystem.sh@27 -- # sync 00:06:34.547 15:30:25 -- target/filesystem.sh@29 -- # i=0 00:06:34.547 15:30:25 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:34.547 15:30:25 -- target/filesystem.sh@37 -- # kill -0 770904 00:06:34.547 15:30:25 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:34.547 15:30:25 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:34.547 15:30:25 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:34.547 15:30:25 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:34.547 00:06:34.547 real 0m0.995s 00:06:34.547 user 0m0.018s 00:06:34.547 sys 0m0.103s 00:06:34.547 15:30:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:34.547 15:30:25 -- common/autotest_common.sh@10 -- # set +x 00:06:34.547 ************************************ 00:06:34.547 END TEST filesystem_btrfs 00:06:34.547 ************************************ 00:06:34.547 15:30:25 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:06:34.547 15:30:25 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:34.547 15:30:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.547 15:30:25 -- common/autotest_common.sh@10 -- # set +x 00:06:34.547 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:06:34.547 ************************************ 00:06:34.547 START TEST filesystem_xfs 00:06:34.547 ************************************ 00:06:34.547 15:30:25 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:06:34.547 15:30:25 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:34.547 15:30:25 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:34.547 15:30:25 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:34.547 15:30:25 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:06:34.547 15:30:25 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:34.547 15:30:25 -- common/autotest_common.sh@914 -- # local i=0 00:06:34.547 15:30:25 -- common/autotest_common.sh@915 -- # local force 00:06:34.547 15:30:25 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:06:34.547 15:30:25 -- common/autotest_common.sh@920 -- # force=-f 00:06:34.547 15:30:25 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:34.547 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:34.547 = sectsz=512 attr=2, projid32bit=1 00:06:34.547 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:34.547 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:34.547 data = bsize=4096 blocks=130560, imaxpct=25 00:06:34.547 = sunit=0 swidth=0 blks 00:06:34.547 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:34.547 log =internal log bsize=4096 blocks=16384, version=2 00:06:34.547 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:34.547 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:35.926 Discarding blocks...Done. 00:06:35.926 15:30:26 -- common/autotest_common.sh@931 -- # return 0 00:06:35.926 15:30:26 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:37.318 15:30:28 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:37.576 15:30:28 -- target/filesystem.sh@25 -- # sync 00:06:37.576 15:30:28 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:37.576 15:30:28 -- target/filesystem.sh@27 -- # sync 00:06:37.576 15:30:28 -- target/filesystem.sh@29 -- # i=0 00:06:37.576 15:30:28 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:37.576 15:30:28 -- target/filesystem.sh@37 -- # kill -0 770904 00:06:37.576 15:30:28 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:37.576 15:30:28 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:37.576 15:30:28 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:37.576 15:30:28 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:37.576 00:06:37.576 real 0m3.021s 00:06:37.576 user 0m0.023s 00:06:37.576 sys 0m0.057s 00:06:37.576 15:30:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:37.576 15:30:28 -- common/autotest_common.sh@10 -- # set +x 00:06:37.576 ************************************ 00:06:37.576 END TEST filesystem_xfs 00:06:37.576 ************************************ 00:06:37.576 15:30:28 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:37.576 15:30:28 -- target/filesystem.sh@93 -- # sync 00:06:37.576 15:30:28 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:37.836 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:37.836 15:30:29 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:37.836 15:30:29 -- common/autotest_common.sh@1208 -- # local i=0 00:06:37.836 15:30:29 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:06:37.836 15:30:29 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:37.836 15:30:29 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:06:37.836 15:30:29 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:37.836 15:30:29 -- common/autotest_common.sh@1220 -- # return 0 00:06:37.836 15:30:29 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:37.836 15:30:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:37.836 15:30:29 -- common/autotest_common.sh@10 -- # set +x 00:06:37.836 15:30:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:37.836 15:30:29 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:37.836 15:30:29 -- target/filesystem.sh@101 -- # killprocess 770904 00:06:37.836 15:30:29 -- common/autotest_common.sh@936 -- # '[' -z 770904 ']' 00:06:37.836 15:30:29 -- common/autotest_common.sh@940 -- # kill -0 770904 00:06:37.836 15:30:29 -- common/autotest_common.sh@941 -- # uname 00:06:37.836 15:30:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:37.836 15:30:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 770904 00:06:37.836 15:30:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:37.836 15:30:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:37.836 15:30:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 770904' 00:06:37.836 killing process with pid 770904 00:06:37.836 15:30:29 -- common/autotest_common.sh@955 -- # kill 770904 00:06:37.836 15:30:29 -- common/autotest_common.sh@960 -- # wait 770904 00:06:38.403 15:30:29 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:38.403 00:06:38.403 real 0m18.041s 00:06:38.403 user 1m9.712s 00:06:38.403 sys 0m2.251s 00:06:38.403 15:30:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:38.403 15:30:29 -- common/autotest_common.sh@10 -- # set +x 00:06:38.403 ************************************ 00:06:38.403 END TEST nvmf_filesystem_no_in_capsule 00:06:38.403 ************************************ 00:06:38.403 15:30:29 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:06:38.403 15:30:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:38.403 15:30:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:38.403 15:30:29 -- common/autotest_common.sh@10 -- # set +x 00:06:38.403 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:06:38.403 ************************************ 00:06:38.403 START TEST nvmf_filesystem_in_capsule 00:06:38.403 ************************************ 00:06:38.403 15:30:29 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:06:38.403 15:30:29 -- target/filesystem.sh@47 -- # in_capsule=4096 00:06:38.403 15:30:29 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:38.403 15:30:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:38.403 15:30:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:38.403 15:30:29 -- common/autotest_common.sh@10 -- # set +x 00:06:38.403 15:30:29 -- nvmf/common.sh@469 -- # nvmfpid=773221 00:06:38.403 15:30:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:38.403 15:30:29 -- nvmf/common.sh@470 -- # waitforlisten 773221 00:06:38.403 15:30:29 -- common/autotest_common.sh@829 -- # '[' -z 773221 ']' 00:06:38.404 15:30:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:38.404 15:30:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:38.404 15:30:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:38.404 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:38.404 15:30:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:38.404 15:30:29 -- common/autotest_common.sh@10 -- # set +x 00:06:38.404 [2024-11-26 15:30:29.747467] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:38.404 [2024-11-26 15:30:29.747542] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:38.404 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.404 [2024-11-26 15:30:29.814475] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:38.662 [2024-11-26 15:30:29.935697] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:38.662 [2024-11-26 15:30:29.935855] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:38.662 [2024-11-26 15:30:29.935875] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:38.662 [2024-11-26 15:30:29.935889] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:38.662 [2024-11-26 15:30:29.935972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:38.662 [2024-11-26 15:30:29.936038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:38.662 [2024-11-26 15:30:29.936093] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:38.662 [2024-11-26 15:30:29.936096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.598 15:30:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:39.598 15:30:30 -- common/autotest_common.sh@862 -- # return 0 00:06:39.598 15:30:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:39.598 15:30:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:39.598 15:30:30 -- common/autotest_common.sh@10 -- # set +x 00:06:39.598 15:30:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:39.598 15:30:30 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:39.598 15:30:30 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:06:39.598 15:30:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:39.598 15:30:30 -- common/autotest_common.sh@10 -- # set +x 00:06:39.598 [2024-11-26 15:30:30.757308] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:39.598 15:30:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:39.598 15:30:30 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:39.598 15:30:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:39.598 15:30:30 -- common/autotest_common.sh@10 -- # set +x 00:06:39.598 Malloc1 00:06:39.598 15:30:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:39.598 15:30:30 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:39.598 15:30:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:39.598 15:30:30 -- common/autotest_common.sh@10 -- # set +x 00:06:39.598 15:30:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:39.598 15:30:30 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:39.598 15:30:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:39.598 15:30:30 -- common/autotest_common.sh@10 -- # set +x 00:06:39.598 15:30:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:39.598 15:30:30 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:39.598 15:30:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:39.598 15:30:30 -- common/autotest_common.sh@10 -- # set +x 00:06:39.598 [2024-11-26 15:30:30.944245] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:39.598 15:30:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:39.598 15:30:30 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:39.598 15:30:30 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:39.598 15:30:30 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:39.598 15:30:30 -- common/autotest_common.sh@1369 -- # local bs 00:06:39.598 15:30:30 -- common/autotest_common.sh@1370 -- # local nb 00:06:39.598 15:30:30 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:39.598 15:30:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:39.598 15:30:30 -- common/autotest_common.sh@10 -- # set +x 00:06:39.598 15:30:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:39.598 15:30:30 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:39.598 { 00:06:39.598 "name": "Malloc1", 00:06:39.598 "aliases": [ 00:06:39.598 "0df8a2eb-7898-49b8-ad8d-8e1e9299a220" 00:06:39.598 ], 00:06:39.598 "product_name": "Malloc disk", 00:06:39.598 "block_size": 512, 00:06:39.598 "num_blocks": 1048576, 00:06:39.598 "uuid": "0df8a2eb-7898-49b8-ad8d-8e1e9299a220", 00:06:39.598 "assigned_rate_limits": { 00:06:39.598 "rw_ios_per_sec": 0, 00:06:39.598 "rw_mbytes_per_sec": 0, 00:06:39.598 "r_mbytes_per_sec": 0, 00:06:39.598 "w_mbytes_per_sec": 0 00:06:39.598 }, 00:06:39.598 "claimed": true, 00:06:39.598 "claim_type": "exclusive_write", 00:06:39.598 "zoned": false, 00:06:39.598 "supported_io_types": { 00:06:39.598 "read": true, 00:06:39.598 "write": true, 00:06:39.598 "unmap": true, 00:06:39.598 "write_zeroes": true, 00:06:39.598 "flush": true, 00:06:39.598 "reset": true, 00:06:39.598 "compare": false, 00:06:39.598 "compare_and_write": false, 00:06:39.598 "abort": true, 00:06:39.598 "nvme_admin": false, 00:06:39.598 "nvme_io": false 00:06:39.598 }, 00:06:39.598 "memory_domains": [ 00:06:39.598 { 00:06:39.598 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:39.598 "dma_device_type": 2 00:06:39.598 } 00:06:39.598 ], 00:06:39.598 "driver_specific": {} 00:06:39.598 } 00:06:39.598 ]' 00:06:39.598 15:30:30 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:39.598 15:30:31 -- common/autotest_common.sh@1372 -- # bs=512 00:06:39.598 15:30:31 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:39.598 15:30:31 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:39.598 15:30:31 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:39.598 15:30:31 -- common/autotest_common.sh@1377 -- # echo 512 00:06:39.857 15:30:31 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:39.857 15:30:31 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:40.429 15:30:31 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:40.429 15:30:31 -- common/autotest_common.sh@1187 -- # local i=0 00:06:40.429 15:30:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:40.429 15:30:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:40.429 15:30:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:42.338 15:30:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:42.338 15:30:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:42.338 15:30:33 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:42.338 15:30:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:42.338 15:30:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:42.338 15:30:33 -- common/autotest_common.sh@1197 -- # return 0 00:06:42.338 15:30:33 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:42.339 15:30:33 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:42.339 15:30:33 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:42.339 15:30:33 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:42.339 15:30:33 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:42.339 15:30:33 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:42.339 15:30:33 -- setup/common.sh@80 -- # echo 536870912 00:06:42.339 15:30:33 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:42.339 15:30:33 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:42.339 15:30:33 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:42.339 15:30:33 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:42.598 15:30:33 -- target/filesystem.sh@69 -- # partprobe 00:06:43.167 15:30:34 -- target/filesystem.sh@70 -- # sleep 1 00:06:44.106 15:30:35 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:06:44.106 15:30:35 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:44.106 15:30:35 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:44.106 15:30:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:44.106 15:30:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.106 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:06:44.106 ************************************ 00:06:44.106 START TEST filesystem_in_capsule_ext4 00:06:44.106 ************************************ 00:06:44.106 15:30:35 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:44.106 15:30:35 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:44.106 15:30:35 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:44.106 15:30:35 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:44.106 15:30:35 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:44.106 15:30:35 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:44.106 15:30:35 -- common/autotest_common.sh@914 -- # local i=0 00:06:44.106 15:30:35 -- common/autotest_common.sh@915 -- # local force 00:06:44.106 15:30:35 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:44.106 15:30:35 -- common/autotest_common.sh@918 -- # force=-F 00:06:44.106 15:30:35 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:44.106 mke2fs 1.47.0 (5-Feb-2023) 00:06:44.106 Discarding device blocks: 0/522240 done 00:06:44.106 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:44.106 Filesystem UUID: 83c951f0-66b3-41e9-a250-61ebe3321f21 00:06:44.106 Superblock backups stored on blocks: 00:06:44.106 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:44.106 00:06:44.106 Allocating group tables: 0/64 done 00:06:44.106 Writing inode tables: 0/64 done 00:06:47.478 Creating journal (8192 blocks): done 00:06:47.478 Writing superblocks and filesystem accounting information: 0/64 done 00:06:47.478 00:06:47.478 15:30:38 -- common/autotest_common.sh@931 -- # return 0 00:06:47.478 15:30:38 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:54.041 15:30:44 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:54.041 15:30:44 -- target/filesystem.sh@25 -- # sync 00:06:54.041 15:30:44 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:54.041 15:30:44 -- target/filesystem.sh@27 -- # sync 00:06:54.041 15:30:44 -- target/filesystem.sh@29 -- # i=0 00:06:54.041 15:30:44 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:54.041 15:30:44 -- target/filesystem.sh@37 -- # kill -0 773221 00:06:54.041 15:30:44 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:54.041 15:30:44 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:54.041 15:30:44 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:54.041 15:30:44 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:54.041 00:06:54.041 real 0m9.122s 00:06:54.041 user 0m0.019s 00:06:54.041 sys 0m0.057s 00:06:54.041 15:30:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:54.041 15:30:44 -- common/autotest_common.sh@10 -- # set +x 00:06:54.041 ************************************ 00:06:54.041 END TEST filesystem_in_capsule_ext4 00:06:54.041 ************************************ 00:06:54.041 15:30:44 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:54.041 15:30:44 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:54.041 15:30:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:54.041 15:30:44 -- common/autotest_common.sh@10 -- # set +x 00:06:54.041 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:06:54.041 ************************************ 00:06:54.041 START TEST filesystem_in_capsule_btrfs 00:06:54.041 ************************************ 00:06:54.041 15:30:44 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:54.041 15:30:44 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:54.041 15:30:44 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:54.041 15:30:44 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:54.041 15:30:44 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:06:54.041 15:30:44 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:54.041 15:30:44 -- common/autotest_common.sh@914 -- # local i=0 00:06:54.041 15:30:44 -- common/autotest_common.sh@915 -- # local force 00:06:54.041 15:30:44 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:06:54.041 15:30:44 -- common/autotest_common.sh@920 -- # force=-f 00:06:54.041 15:30:44 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:54.041 btrfs-progs v6.8.1 00:06:54.041 See https://btrfs.readthedocs.io for more information. 00:06:54.041 00:06:54.041 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:54.041 NOTE: several default settings have changed in version 5.15, please make sure 00:06:54.041 this does not affect your deployments: 00:06:54.041 - DUP for metadata (-m dup) 00:06:54.041 - enabled no-holes (-O no-holes) 00:06:54.041 - enabled free-space-tree (-R free-space-tree) 00:06:54.041 00:06:54.041 Label: (null) 00:06:54.041 UUID: b62dbd6f-5863-4973-a445-b361a030df70 00:06:54.041 Node size: 16384 00:06:54.041 Sector size: 4096 (CPU page size: 4096) 00:06:54.041 Filesystem size: 510.00MiB 00:06:54.041 Block group profiles: 00:06:54.041 Data: single 8.00MiB 00:06:54.041 Metadata: DUP 32.00MiB 00:06:54.041 System: DUP 8.00MiB 00:06:54.041 SSD detected: yes 00:06:54.041 Zoned device: no 00:06:54.041 Features: extref, skinny-metadata, no-holes, free-space-tree 00:06:54.041 Checksum: crc32c 00:06:54.042 Number of devices: 1 00:06:54.042 Devices: 00:06:54.042 ID SIZE PATH 00:06:54.042 1 510.00MiB /dev/nvme0n1p1 00:06:54.042 00:06:54.042 15:30:44 -- common/autotest_common.sh@931 -- # return 0 00:06:54.042 15:30:44 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:54.301 15:30:45 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:54.301 15:30:45 -- target/filesystem.sh@25 -- # sync 00:06:54.301 15:30:45 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:54.301 15:30:45 -- target/filesystem.sh@27 -- # sync 00:06:54.301 15:30:45 -- target/filesystem.sh@29 -- # i=0 00:06:54.301 15:30:45 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:54.301 15:30:45 -- target/filesystem.sh@37 -- # kill -0 773221 00:06:54.301 15:30:45 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:54.301 15:30:45 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:54.301 15:30:45 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:54.301 15:30:45 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:54.301 00:06:54.301 real 0m1.034s 00:06:54.301 user 0m0.023s 00:06:54.301 sys 0m0.093s 00:06:54.301 15:30:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:54.301 15:30:45 -- common/autotest_common.sh@10 -- # set +x 00:06:54.301 ************************************ 00:06:54.301 END TEST filesystem_in_capsule_btrfs 00:06:54.301 ************************************ 00:06:54.301 15:30:45 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:06:54.301 15:30:45 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:54.301 15:30:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:54.301 15:30:45 -- common/autotest_common.sh@10 -- # set +x 00:06:54.301 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:06:54.301 ************************************ 00:06:54.301 START TEST filesystem_in_capsule_xfs 00:06:54.301 ************************************ 00:06:54.301 15:30:45 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:06:54.301 15:30:45 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:54.301 15:30:45 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:54.301 15:30:45 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:54.301 15:30:45 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:06:54.301 15:30:45 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:54.301 15:30:45 -- common/autotest_common.sh@914 -- # local i=0 00:06:54.301 15:30:45 -- common/autotest_common.sh@915 -- # local force 00:06:54.301 15:30:45 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:06:54.301 15:30:45 -- common/autotest_common.sh@920 -- # force=-f 00:06:54.301 15:30:45 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:54.301 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:54.301 = sectsz=512 attr=2, projid32bit=1 00:06:54.301 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:54.301 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:54.301 data = bsize=4096 blocks=130560, imaxpct=25 00:06:54.301 = sunit=0 swidth=0 blks 00:06:54.301 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:54.301 log =internal log bsize=4096 blocks=16384, version=2 00:06:54.302 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:54.302 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:55.682 Discarding blocks...Done. 00:06:55.682 15:30:46 -- common/autotest_common.sh@931 -- # return 0 00:06:55.682 15:30:46 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:58.224 15:30:49 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:58.224 15:30:49 -- target/filesystem.sh@25 -- # sync 00:06:58.224 15:30:49 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:58.224 15:30:49 -- target/filesystem.sh@27 -- # sync 00:06:58.224 15:30:49 -- target/filesystem.sh@29 -- # i=0 00:06:58.224 15:30:49 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:58.224 15:30:49 -- target/filesystem.sh@37 -- # kill -0 773221 00:06:58.224 15:30:49 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:58.224 15:30:49 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:58.224 15:30:49 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:58.224 15:30:49 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:58.224 00:06:58.224 real 0m3.526s 00:06:58.224 user 0m0.019s 00:06:58.224 sys 0m0.059s 00:06:58.224 15:30:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:58.224 15:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:58.224 ************************************ 00:06:58.224 END TEST filesystem_in_capsule_xfs 00:06:58.224 ************************************ 00:06:58.224 15:30:49 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:58.224 15:30:49 -- target/filesystem.sh@93 -- # sync 00:06:58.224 15:30:49 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:58.224 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:58.224 15:30:49 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:58.224 15:30:49 -- common/autotest_common.sh@1208 -- # local i=0 00:06:58.224 15:30:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:06:58.224 15:30:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:58.224 15:30:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:06:58.224 15:30:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:58.224 15:30:49 -- common/autotest_common.sh@1220 -- # return 0 00:06:58.224 15:30:49 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:58.224 15:30:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.224 15:30:49 -- common/autotest_common.sh@10 -- # set +x 00:06:58.224 15:30:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.224 15:30:49 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:58.224 15:30:49 -- target/filesystem.sh@101 -- # killprocess 773221 00:06:58.224 15:30:49 -- common/autotest_common.sh@936 -- # '[' -z 773221 ']' 00:06:58.224 15:30:49 -- common/autotest_common.sh@940 -- # kill -0 773221 00:06:58.224 15:30:49 -- common/autotest_common.sh@941 -- # uname 00:06:58.224 15:30:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:58.224 15:30:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 773221 00:06:58.224 15:30:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:58.224 15:30:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:58.224 15:30:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 773221' 00:06:58.224 killing process with pid 773221 00:06:58.224 15:30:49 -- common/autotest_common.sh@955 -- # kill 773221 00:06:58.224 15:30:49 -- common/autotest_common.sh@960 -- # wait 773221 00:06:58.793 15:30:50 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:58.793 00:06:58.793 real 0m20.349s 00:06:58.793 user 1m18.807s 00:06:58.793 sys 0m2.344s 00:06:58.793 15:30:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:58.793 15:30:50 -- common/autotest_common.sh@10 -- # set +x 00:06:58.793 ************************************ 00:06:58.793 END TEST nvmf_filesystem_in_capsule 00:06:58.793 ************************************ 00:06:58.793 15:30:50 -- target/filesystem.sh@108 -- # nvmftestfini 00:06:58.793 15:30:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:58.793 15:30:50 -- nvmf/common.sh@116 -- # sync 00:06:58.793 15:30:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:58.793 15:30:50 -- nvmf/common.sh@119 -- # set +e 00:06:58.793 15:30:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:58.793 15:30:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:58.793 rmmod nvme_tcp 00:06:58.793 rmmod nvme_fabrics 00:06:58.793 rmmod nvme_keyring 00:06:58.793 15:30:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:58.793 15:30:50 -- nvmf/common.sh@123 -- # set -e 00:06:58.793 15:30:50 -- nvmf/common.sh@124 -- # return 0 00:06:58.793 15:30:50 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:06:58.793 15:30:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:58.793 15:30:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:58.793 15:30:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:58.793 15:30:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:58.793 15:30:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:58.793 15:30:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:58.793 15:30:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:58.793 15:30:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:01.332 15:30:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:01.333 00:07:01.333 real 0m43.144s 00:07:01.333 user 2m29.602s 00:07:01.333 sys 0m6.225s 00:07:01.333 15:30:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:01.333 15:30:52 -- common/autotest_common.sh@10 -- # set +x 00:07:01.333 ************************************ 00:07:01.333 END TEST nvmf_filesystem 00:07:01.333 ************************************ 00:07:01.333 15:30:52 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:01.333 15:30:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:01.333 15:30:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.333 15:30:52 -- common/autotest_common.sh@10 -- # set +x 00:07:01.333 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:07:01.333 ************************************ 00:07:01.333 START TEST nvmf_discovery 00:07:01.333 ************************************ 00:07:01.333 15:30:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:01.333 * Looking for test storage... 00:07:01.333 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:01.333 15:30:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:01.333 15:30:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:01.333 15:30:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:01.333 15:30:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:01.333 15:30:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:01.333 15:30:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:01.333 15:30:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:01.333 15:30:52 -- scripts/common.sh@335 -- # IFS=.-: 00:07:01.333 15:30:52 -- scripts/common.sh@335 -- # read -ra ver1 00:07:01.333 15:30:52 -- scripts/common.sh@336 -- # IFS=.-: 00:07:01.333 15:30:52 -- scripts/common.sh@336 -- # read -ra ver2 00:07:01.333 15:30:52 -- scripts/common.sh@337 -- # local 'op=<' 00:07:01.333 15:30:52 -- scripts/common.sh@339 -- # ver1_l=2 00:07:01.333 15:30:52 -- scripts/common.sh@340 -- # ver2_l=1 00:07:01.333 15:30:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:01.333 15:30:52 -- scripts/common.sh@343 -- # case "$op" in 00:07:01.333 15:30:52 -- scripts/common.sh@344 -- # : 1 00:07:01.333 15:30:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:01.333 15:30:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:01.333 15:30:52 -- scripts/common.sh@364 -- # decimal 1 00:07:01.333 15:30:52 -- scripts/common.sh@352 -- # local d=1 00:07:01.333 15:30:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:01.333 15:30:52 -- scripts/common.sh@354 -- # echo 1 00:07:01.333 15:30:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:01.333 15:30:52 -- scripts/common.sh@365 -- # decimal 2 00:07:01.333 15:30:52 -- scripts/common.sh@352 -- # local d=2 00:07:01.333 15:30:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:01.333 15:30:52 -- scripts/common.sh@354 -- # echo 2 00:07:01.333 15:30:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:01.333 15:30:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:01.333 15:30:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:01.333 15:30:52 -- scripts/common.sh@367 -- # return 0 00:07:01.333 15:30:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:01.333 15:30:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:01.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:01.333 --rc genhtml_branch_coverage=1 00:07:01.333 --rc genhtml_function_coverage=1 00:07:01.333 --rc genhtml_legend=1 00:07:01.333 --rc geninfo_all_blocks=1 00:07:01.333 --rc geninfo_unexecuted_blocks=1 00:07:01.333 00:07:01.333 ' 00:07:01.333 15:30:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:01.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:01.333 --rc genhtml_branch_coverage=1 00:07:01.333 --rc genhtml_function_coverage=1 00:07:01.333 --rc genhtml_legend=1 00:07:01.333 --rc geninfo_all_blocks=1 00:07:01.333 --rc geninfo_unexecuted_blocks=1 00:07:01.333 00:07:01.333 ' 00:07:01.333 15:30:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:01.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:01.333 --rc genhtml_branch_coverage=1 00:07:01.333 --rc genhtml_function_coverage=1 00:07:01.333 --rc genhtml_legend=1 00:07:01.333 --rc geninfo_all_blocks=1 00:07:01.333 --rc geninfo_unexecuted_blocks=1 00:07:01.333 00:07:01.333 ' 00:07:01.333 15:30:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:01.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:01.333 --rc genhtml_branch_coverage=1 00:07:01.333 --rc genhtml_function_coverage=1 00:07:01.333 --rc genhtml_legend=1 00:07:01.333 --rc geninfo_all_blocks=1 00:07:01.333 --rc geninfo_unexecuted_blocks=1 00:07:01.333 00:07:01.333 ' 00:07:01.333 15:30:52 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:01.333 15:30:52 -- nvmf/common.sh@7 -- # uname -s 00:07:01.333 15:30:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:01.333 15:30:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:01.333 15:30:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:01.333 15:30:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:01.333 15:30:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:01.333 15:30:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:01.333 15:30:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:01.333 15:30:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:01.333 15:30:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:01.333 15:30:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:01.333 15:30:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:01.333 15:30:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:01.333 15:30:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:01.333 15:30:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:01.333 15:30:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:01.333 15:30:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:01.333 15:30:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:01.333 15:30:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:01.333 15:30:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:01.333 15:30:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:01.333 15:30:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:01.333 15:30:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:01.333 15:30:52 -- paths/export.sh@5 -- # export PATH 00:07:01.333 15:30:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:01.333 15:30:52 -- nvmf/common.sh@46 -- # : 0 00:07:01.333 15:30:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:01.333 15:30:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:01.333 15:30:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:01.333 15:30:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:01.333 15:30:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:01.333 15:30:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:01.333 15:30:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:01.333 15:30:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:01.333 15:30:52 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:01.333 15:30:52 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:01.333 15:30:52 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:01.333 15:30:52 -- target/discovery.sh@15 -- # hash nvme 00:07:01.333 15:30:52 -- target/discovery.sh@20 -- # nvmftestinit 00:07:01.333 15:30:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:01.333 15:30:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:01.333 15:30:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:01.333 15:30:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:01.333 15:30:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:01.333 15:30:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:01.333 15:30:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:01.333 15:30:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:01.333 15:30:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:01.333 15:30:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:01.333 15:30:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:01.333 15:30:52 -- common/autotest_common.sh@10 -- # set +x 00:07:03.240 15:30:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:03.240 15:30:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:03.240 15:30:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:03.240 15:30:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:03.240 15:30:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:03.240 15:30:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:03.240 15:30:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:03.240 15:30:54 -- nvmf/common.sh@294 -- # net_devs=() 00:07:03.240 15:30:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:03.240 15:30:54 -- nvmf/common.sh@295 -- # e810=() 00:07:03.240 15:30:54 -- nvmf/common.sh@295 -- # local -ga e810 00:07:03.240 15:30:54 -- nvmf/common.sh@296 -- # x722=() 00:07:03.240 15:30:54 -- nvmf/common.sh@296 -- # local -ga x722 00:07:03.240 15:30:54 -- nvmf/common.sh@297 -- # mlx=() 00:07:03.240 15:30:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:03.240 15:30:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:03.240 15:30:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:03.240 15:30:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:03.240 15:30:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:03.240 15:30:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:03.240 15:30:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:03.240 15:30:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:03.240 15:30:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:03.240 15:30:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:03.240 15:30:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:03.240 15:30:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:03.240 15:30:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:03.240 15:30:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:03.240 15:30:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:03.240 15:30:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:03.240 15:30:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:03.240 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:03.240 15:30:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:03.240 15:30:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:03.240 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:03.240 15:30:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:03.240 15:30:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:03.240 15:30:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:03.240 15:30:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:03.240 15:30:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:03.240 15:30:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:03.240 15:30:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:03.240 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:03.240 15:30:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:03.240 15:30:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:03.240 15:30:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:03.240 15:30:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:03.240 15:30:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:03.241 15:30:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:03.241 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:03.241 15:30:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:03.241 15:30:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:03.241 15:30:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:03.241 15:30:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:03.241 15:30:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:03.241 15:30:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:03.241 15:30:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:03.241 15:30:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:03.241 15:30:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:03.241 15:30:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:03.241 15:30:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:03.241 15:30:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:03.241 15:30:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:03.241 15:30:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:03.241 15:30:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:03.241 15:30:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:03.241 15:30:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:03.241 15:30:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:03.241 15:30:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:03.241 15:30:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:03.241 15:30:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:03.241 15:30:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:03.241 15:30:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:03.241 15:30:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:03.241 15:30:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:03.241 15:30:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:03.241 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:03.241 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.248 ms 00:07:03.241 00:07:03.241 --- 10.0.0.2 ping statistics --- 00:07:03.241 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:03.241 rtt min/avg/max/mdev = 0.248/0.248/0.248/0.000 ms 00:07:03.241 15:30:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:03.241 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:03.241 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.175 ms 00:07:03.241 00:07:03.241 --- 10.0.0.1 ping statistics --- 00:07:03.241 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:03.241 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:07:03.241 15:30:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:03.241 15:30:54 -- nvmf/common.sh@410 -- # return 0 00:07:03.241 15:30:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:03.241 15:30:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:03.241 15:30:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:03.241 15:30:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:03.241 15:30:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:03.241 15:30:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:03.241 15:30:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:03.241 15:30:54 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:03.241 15:30:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:03.241 15:30:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:03.241 15:30:54 -- common/autotest_common.sh@10 -- # set +x 00:07:03.241 15:30:54 -- nvmf/common.sh@469 -- # nvmfpid=777716 00:07:03.241 15:30:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:03.241 15:30:54 -- nvmf/common.sh@470 -- # waitforlisten 777716 00:07:03.241 15:30:54 -- common/autotest_common.sh@829 -- # '[' -z 777716 ']' 00:07:03.241 15:30:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:03.241 15:30:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:03.241 15:30:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:03.241 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:03.241 15:30:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:03.241 15:30:54 -- common/autotest_common.sh@10 -- # set +x 00:07:03.241 [2024-11-26 15:30:54.659436] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:03.241 [2024-11-26 15:30:54.659505] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:03.501 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.501 [2024-11-26 15:30:54.732183] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:03.501 [2024-11-26 15:30:54.850936] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:03.501 [2024-11-26 15:30:54.851103] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:03.501 [2024-11-26 15:30:54.851132] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:03.501 [2024-11-26 15:30:54.851147] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:03.501 [2024-11-26 15:30:54.851217] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:03.501 [2024-11-26 15:30:54.851274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:03.501 [2024-11-26 15:30:54.851326] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:03.501 [2024-11-26 15:30:54.851329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.437 15:30:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:04.437 15:30:55 -- common/autotest_common.sh@862 -- # return 0 00:07:04.437 15:30:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:04.437 15:30:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:04.437 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.437 15:30:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:04.437 15:30:55 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:04.437 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.437 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.437 [2024-11-26 15:30:55.658264] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:04.437 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.437 15:30:55 -- target/discovery.sh@26 -- # seq 1 4 00:07:04.437 15:30:55 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:04.437 15:30:55 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:04.437 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.437 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.437 Null1 00:07:04.437 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.437 15:30:55 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:04.437 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.437 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.437 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.437 15:30:55 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:04.437 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.437 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.437 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.437 15:30:55 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:04.437 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.437 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.437 [2024-11-26 15:30:55.698553] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:04.437 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.437 15:30:55 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:04.437 15:30:55 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:04.437 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.437 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.437 Null2 00:07:04.437 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.437 15:30:55 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:04.437 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.437 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.437 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.437 15:30:55 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:04.437 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.437 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.437 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.437 15:30:55 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:04.437 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.437 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.437 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.437 15:30:55 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:04.437 15:30:55 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:04.437 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.437 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.437 Null3 00:07:04.437 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.437 15:30:55 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:04.437 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.437 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.438 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.438 15:30:55 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:04.438 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.438 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.438 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.438 15:30:55 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:04.438 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.438 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.438 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.438 15:30:55 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:04.438 15:30:55 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:04.438 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.438 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.438 Null4 00:07:04.438 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.438 15:30:55 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:04.438 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.438 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.438 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.438 15:30:55 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:04.438 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.438 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.438 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.438 15:30:55 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:04.438 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.438 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.438 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.438 15:30:55 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:04.438 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.438 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.438 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.438 15:30:55 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:04.438 15:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.438 15:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:04.438 15:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.438 15:30:55 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:04.696 00:07:04.696 Discovery Log Number of Records 6, Generation counter 6 00:07:04.696 =====Discovery Log Entry 0====== 00:07:04.696 trtype: tcp 00:07:04.696 adrfam: ipv4 00:07:04.696 subtype: current discovery subsystem 00:07:04.696 treq: not required 00:07:04.696 portid: 0 00:07:04.696 trsvcid: 4420 00:07:04.696 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:04.696 traddr: 10.0.0.2 00:07:04.696 eflags: explicit discovery connections, duplicate discovery information 00:07:04.696 sectype: none 00:07:04.696 =====Discovery Log Entry 1====== 00:07:04.696 trtype: tcp 00:07:04.696 adrfam: ipv4 00:07:04.696 subtype: nvme subsystem 00:07:04.696 treq: not required 00:07:04.696 portid: 0 00:07:04.696 trsvcid: 4420 00:07:04.696 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:04.696 traddr: 10.0.0.2 00:07:04.696 eflags: none 00:07:04.696 sectype: none 00:07:04.696 =====Discovery Log Entry 2====== 00:07:04.696 trtype: tcp 00:07:04.696 adrfam: ipv4 00:07:04.696 subtype: nvme subsystem 00:07:04.696 treq: not required 00:07:04.696 portid: 0 00:07:04.696 trsvcid: 4420 00:07:04.696 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:04.696 traddr: 10.0.0.2 00:07:04.696 eflags: none 00:07:04.696 sectype: none 00:07:04.696 =====Discovery Log Entry 3====== 00:07:04.696 trtype: tcp 00:07:04.696 adrfam: ipv4 00:07:04.696 subtype: nvme subsystem 00:07:04.696 treq: not required 00:07:04.696 portid: 0 00:07:04.696 trsvcid: 4420 00:07:04.696 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:04.696 traddr: 10.0.0.2 00:07:04.696 eflags: none 00:07:04.696 sectype: none 00:07:04.697 =====Discovery Log Entry 4====== 00:07:04.697 trtype: tcp 00:07:04.697 adrfam: ipv4 00:07:04.697 subtype: nvme subsystem 00:07:04.697 treq: not required 00:07:04.697 portid: 0 00:07:04.697 trsvcid: 4420 00:07:04.697 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:04.697 traddr: 10.0.0.2 00:07:04.697 eflags: none 00:07:04.697 sectype: none 00:07:04.697 =====Discovery Log Entry 5====== 00:07:04.697 trtype: tcp 00:07:04.697 adrfam: ipv4 00:07:04.697 subtype: discovery subsystem referral 00:07:04.697 treq: not required 00:07:04.697 portid: 0 00:07:04.697 trsvcid: 4430 00:07:04.697 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:04.697 traddr: 10.0.0.2 00:07:04.697 eflags: none 00:07:04.697 sectype: none 00:07:04.697 15:30:56 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:04.697 Perform nvmf subsystem discovery via RPC 00:07:04.697 15:30:56 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:04.697 15:30:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.697 15:30:56 -- common/autotest_common.sh@10 -- # set +x 00:07:04.697 [2024-11-26 15:30:56.043497] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:04.697 [ 00:07:04.697 { 00:07:04.697 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:04.697 "subtype": "Discovery", 00:07:04.697 "listen_addresses": [ 00:07:04.697 { 00:07:04.697 "transport": "TCP", 00:07:04.697 "trtype": "TCP", 00:07:04.697 "adrfam": "IPv4", 00:07:04.697 "traddr": "10.0.0.2", 00:07:04.697 "trsvcid": "4420" 00:07:04.697 } 00:07:04.697 ], 00:07:04.697 "allow_any_host": true, 00:07:04.697 "hosts": [] 00:07:04.697 }, 00:07:04.697 { 00:07:04.697 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:04.697 "subtype": "NVMe", 00:07:04.697 "listen_addresses": [ 00:07:04.697 { 00:07:04.697 "transport": "TCP", 00:07:04.697 "trtype": "TCP", 00:07:04.697 "adrfam": "IPv4", 00:07:04.697 "traddr": "10.0.0.2", 00:07:04.697 "trsvcid": "4420" 00:07:04.697 } 00:07:04.697 ], 00:07:04.697 "allow_any_host": true, 00:07:04.697 "hosts": [], 00:07:04.697 "serial_number": "SPDK00000000000001", 00:07:04.697 "model_number": "SPDK bdev Controller", 00:07:04.697 "max_namespaces": 32, 00:07:04.697 "min_cntlid": 1, 00:07:04.697 "max_cntlid": 65519, 00:07:04.697 "namespaces": [ 00:07:04.697 { 00:07:04.697 "nsid": 1, 00:07:04.697 "bdev_name": "Null1", 00:07:04.697 "name": "Null1", 00:07:04.697 "nguid": "08D2F337D9AB443CB15F642E2C443796", 00:07:04.697 "uuid": "08d2f337-d9ab-443c-b15f-642e2c443796" 00:07:04.697 } 00:07:04.697 ] 00:07:04.697 }, 00:07:04.697 { 00:07:04.697 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:04.697 "subtype": "NVMe", 00:07:04.697 "listen_addresses": [ 00:07:04.697 { 00:07:04.697 "transport": "TCP", 00:07:04.697 "trtype": "TCP", 00:07:04.697 "adrfam": "IPv4", 00:07:04.697 "traddr": "10.0.0.2", 00:07:04.697 "trsvcid": "4420" 00:07:04.697 } 00:07:04.697 ], 00:07:04.697 "allow_any_host": true, 00:07:04.697 "hosts": [], 00:07:04.697 "serial_number": "SPDK00000000000002", 00:07:04.697 "model_number": "SPDK bdev Controller", 00:07:04.697 "max_namespaces": 32, 00:07:04.697 "min_cntlid": 1, 00:07:04.697 "max_cntlid": 65519, 00:07:04.697 "namespaces": [ 00:07:04.697 { 00:07:04.697 "nsid": 1, 00:07:04.697 "bdev_name": "Null2", 00:07:04.697 "name": "Null2", 00:07:04.697 "nguid": "ED78ACF70A674C76A8EBB91FC78E6E29", 00:07:04.697 "uuid": "ed78acf7-0a67-4c76-a8eb-b91fc78e6e29" 00:07:04.697 } 00:07:04.697 ] 00:07:04.697 }, 00:07:04.697 { 00:07:04.697 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:04.697 "subtype": "NVMe", 00:07:04.697 "listen_addresses": [ 00:07:04.697 { 00:07:04.697 "transport": "TCP", 00:07:04.697 "trtype": "TCP", 00:07:04.697 "adrfam": "IPv4", 00:07:04.697 "traddr": "10.0.0.2", 00:07:04.697 "trsvcid": "4420" 00:07:04.697 } 00:07:04.697 ], 00:07:04.697 "allow_any_host": true, 00:07:04.697 "hosts": [], 00:07:04.697 "serial_number": "SPDK00000000000003", 00:07:04.697 "model_number": "SPDK bdev Controller", 00:07:04.697 "max_namespaces": 32, 00:07:04.697 "min_cntlid": 1, 00:07:04.697 "max_cntlid": 65519, 00:07:04.697 "namespaces": [ 00:07:04.697 { 00:07:04.697 "nsid": 1, 00:07:04.697 "bdev_name": "Null3", 00:07:04.697 "name": "Null3", 00:07:04.697 "nguid": "992AEBE17B134AC5AB79551066B447B9", 00:07:04.697 "uuid": "992aebe1-7b13-4ac5-ab79-551066b447b9" 00:07:04.697 } 00:07:04.697 ] 00:07:04.697 }, 00:07:04.697 { 00:07:04.697 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:04.697 "subtype": "NVMe", 00:07:04.697 "listen_addresses": [ 00:07:04.697 { 00:07:04.697 "transport": "TCP", 00:07:04.697 "trtype": "TCP", 00:07:04.697 "adrfam": "IPv4", 00:07:04.697 "traddr": "10.0.0.2", 00:07:04.697 "trsvcid": "4420" 00:07:04.697 } 00:07:04.697 ], 00:07:04.697 "allow_any_host": true, 00:07:04.697 "hosts": [], 00:07:04.697 "serial_number": "SPDK00000000000004", 00:07:04.697 "model_number": "SPDK bdev Controller", 00:07:04.697 "max_namespaces": 32, 00:07:04.697 "min_cntlid": 1, 00:07:04.697 "max_cntlid": 65519, 00:07:04.697 "namespaces": [ 00:07:04.697 { 00:07:04.697 "nsid": 1, 00:07:04.697 "bdev_name": "Null4", 00:07:04.697 "name": "Null4", 00:07:04.697 "nguid": "022C0A6CBBA34E7EBB79F0165EA4006C", 00:07:04.697 "uuid": "022c0a6c-bba3-4e7e-bb79-f0165ea4006c" 00:07:04.697 } 00:07:04.697 ] 00:07:04.697 } 00:07:04.697 ] 00:07:04.697 15:30:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.697 15:30:56 -- target/discovery.sh@42 -- # seq 1 4 00:07:04.697 15:30:56 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:04.697 15:30:56 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:04.697 15:30:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.697 15:30:56 -- common/autotest_common.sh@10 -- # set +x 00:07:04.697 15:30:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.697 15:30:56 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:04.697 15:30:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.697 15:30:56 -- common/autotest_common.sh@10 -- # set +x 00:07:04.697 15:30:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.697 15:30:56 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:04.697 15:30:56 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:04.697 15:30:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.697 15:30:56 -- common/autotest_common.sh@10 -- # set +x 00:07:04.697 15:30:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.697 15:30:56 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:04.697 15:30:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.697 15:30:56 -- common/autotest_common.sh@10 -- # set +x 00:07:04.697 15:30:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.697 15:30:56 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:04.697 15:30:56 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:04.697 15:30:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.697 15:30:56 -- common/autotest_common.sh@10 -- # set +x 00:07:04.697 15:30:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.697 15:30:56 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:04.697 15:30:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.697 15:30:56 -- common/autotest_common.sh@10 -- # set +x 00:07:04.697 15:30:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.697 15:30:56 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:04.697 15:30:56 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:04.697 15:30:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.697 15:30:56 -- common/autotest_common.sh@10 -- # set +x 00:07:04.697 15:30:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.697 15:30:56 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:04.697 15:30:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.697 15:30:56 -- common/autotest_common.sh@10 -- # set +x 00:07:04.697 15:30:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.697 15:30:56 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:04.697 15:30:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.697 15:30:56 -- common/autotest_common.sh@10 -- # set +x 00:07:04.697 15:30:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.697 15:30:56 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:04.697 15:30:56 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:04.697 15:30:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.697 15:30:56 -- common/autotest_common.sh@10 -- # set +x 00:07:04.957 15:30:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.957 15:30:56 -- target/discovery.sh@49 -- # check_bdevs= 00:07:04.957 15:30:56 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:04.957 15:30:56 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:04.957 15:30:56 -- target/discovery.sh@57 -- # nvmftestfini 00:07:04.957 15:30:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:04.957 15:30:56 -- nvmf/common.sh@116 -- # sync 00:07:04.957 15:30:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:04.957 15:30:56 -- nvmf/common.sh@119 -- # set +e 00:07:04.957 15:30:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:04.957 15:30:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:04.957 rmmod nvme_tcp 00:07:04.957 rmmod nvme_fabrics 00:07:04.957 rmmod nvme_keyring 00:07:04.957 15:30:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:04.957 15:30:56 -- nvmf/common.sh@123 -- # set -e 00:07:04.957 15:30:56 -- nvmf/common.sh@124 -- # return 0 00:07:04.957 15:30:56 -- nvmf/common.sh@477 -- # '[' -n 777716 ']' 00:07:04.957 15:30:56 -- nvmf/common.sh@478 -- # killprocess 777716 00:07:04.957 15:30:56 -- common/autotest_common.sh@936 -- # '[' -z 777716 ']' 00:07:04.957 15:30:56 -- common/autotest_common.sh@940 -- # kill -0 777716 00:07:04.957 15:30:56 -- common/autotest_common.sh@941 -- # uname 00:07:04.957 15:30:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:04.957 15:30:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 777716 00:07:04.957 15:30:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:04.957 15:30:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:04.957 15:30:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 777716' 00:07:04.957 killing process with pid 777716 00:07:04.957 15:30:56 -- common/autotest_common.sh@955 -- # kill 777716 00:07:04.957 [2024-11-26 15:30:56.267521] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:04.957 15:30:56 -- common/autotest_common.sh@960 -- # wait 777716 00:07:05.217 15:30:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:05.217 15:30:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:05.217 15:30:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:05.217 15:30:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:05.217 15:30:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:05.217 15:30:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:05.217 15:30:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:05.217 15:30:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:07.131 15:30:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:07.131 00:07:07.131 real 0m6.377s 00:07:07.131 user 0m7.672s 00:07:07.131 sys 0m1.933s 00:07:07.131 15:30:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.131 15:30:58 -- common/autotest_common.sh@10 -- # set +x 00:07:07.131 ************************************ 00:07:07.131 END TEST nvmf_discovery 00:07:07.131 ************************************ 00:07:07.390 15:30:58 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:07.390 15:30:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:07.390 15:30:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.390 15:30:58 -- common/autotest_common.sh@10 -- # set +x 00:07:07.390 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:07:07.390 ************************************ 00:07:07.390 START TEST nvmf_referrals 00:07:07.390 ************************************ 00:07:07.390 15:30:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:07.390 * Looking for test storage... 00:07:07.390 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:07.390 15:30:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:07.390 15:30:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:07.390 15:30:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:07.390 15:30:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:07.390 15:30:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:07.390 15:30:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:07.390 15:30:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:07.390 15:30:58 -- scripts/common.sh@335 -- # IFS=.-: 00:07:07.390 15:30:58 -- scripts/common.sh@335 -- # read -ra ver1 00:07:07.390 15:30:58 -- scripts/common.sh@336 -- # IFS=.-: 00:07:07.390 15:30:58 -- scripts/common.sh@336 -- # read -ra ver2 00:07:07.390 15:30:58 -- scripts/common.sh@337 -- # local 'op=<' 00:07:07.390 15:30:58 -- scripts/common.sh@339 -- # ver1_l=2 00:07:07.390 15:30:58 -- scripts/common.sh@340 -- # ver2_l=1 00:07:07.390 15:30:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:07.390 15:30:58 -- scripts/common.sh@343 -- # case "$op" in 00:07:07.390 15:30:58 -- scripts/common.sh@344 -- # : 1 00:07:07.390 15:30:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:07.390 15:30:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:07.390 15:30:58 -- scripts/common.sh@364 -- # decimal 1 00:07:07.390 15:30:58 -- scripts/common.sh@352 -- # local d=1 00:07:07.390 15:30:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:07.390 15:30:58 -- scripts/common.sh@354 -- # echo 1 00:07:07.390 15:30:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:07.390 15:30:58 -- scripts/common.sh@365 -- # decimal 2 00:07:07.390 15:30:58 -- scripts/common.sh@352 -- # local d=2 00:07:07.390 15:30:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:07.390 15:30:58 -- scripts/common.sh@354 -- # echo 2 00:07:07.390 15:30:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:07.390 15:30:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:07.390 15:30:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:07.390 15:30:58 -- scripts/common.sh@367 -- # return 0 00:07:07.390 15:30:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:07.390 15:30:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:07.390 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:07.390 --rc genhtml_branch_coverage=1 00:07:07.390 --rc genhtml_function_coverage=1 00:07:07.390 --rc genhtml_legend=1 00:07:07.390 --rc geninfo_all_blocks=1 00:07:07.390 --rc geninfo_unexecuted_blocks=1 00:07:07.390 00:07:07.390 ' 00:07:07.390 15:30:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:07.390 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:07.390 --rc genhtml_branch_coverage=1 00:07:07.390 --rc genhtml_function_coverage=1 00:07:07.390 --rc genhtml_legend=1 00:07:07.390 --rc geninfo_all_blocks=1 00:07:07.390 --rc geninfo_unexecuted_blocks=1 00:07:07.390 00:07:07.390 ' 00:07:07.390 15:30:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:07.390 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:07.390 --rc genhtml_branch_coverage=1 00:07:07.390 --rc genhtml_function_coverage=1 00:07:07.390 --rc genhtml_legend=1 00:07:07.390 --rc geninfo_all_blocks=1 00:07:07.390 --rc geninfo_unexecuted_blocks=1 00:07:07.390 00:07:07.390 ' 00:07:07.390 15:30:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:07.390 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:07.390 --rc genhtml_branch_coverage=1 00:07:07.390 --rc genhtml_function_coverage=1 00:07:07.390 --rc genhtml_legend=1 00:07:07.390 --rc geninfo_all_blocks=1 00:07:07.390 --rc geninfo_unexecuted_blocks=1 00:07:07.390 00:07:07.390 ' 00:07:07.390 15:30:58 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:07.390 15:30:58 -- nvmf/common.sh@7 -- # uname -s 00:07:07.390 15:30:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:07.390 15:30:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:07.390 15:30:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:07.390 15:30:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:07.390 15:30:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:07.390 15:30:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:07.390 15:30:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:07.390 15:30:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:07.390 15:30:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:07.390 15:30:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:07.390 15:30:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:07.390 15:30:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:07.390 15:30:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:07.390 15:30:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:07.390 15:30:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:07.390 15:30:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:07.390 15:30:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:07.390 15:30:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:07.390 15:30:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:07.390 15:30:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:07.390 15:30:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:07.390 15:30:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:07.390 15:30:58 -- paths/export.sh@5 -- # export PATH 00:07:07.390 15:30:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:07.390 15:30:58 -- nvmf/common.sh@46 -- # : 0 00:07:07.390 15:30:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:07.390 15:30:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:07.390 15:30:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:07.390 15:30:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:07.390 15:30:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:07.390 15:30:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:07.390 15:30:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:07.390 15:30:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:07.390 15:30:58 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:07.390 15:30:58 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:07.390 15:30:58 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:07.390 15:30:58 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:07.390 15:30:58 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:07.390 15:30:58 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:07.390 15:30:58 -- target/referrals.sh@37 -- # nvmftestinit 00:07:07.390 15:30:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:07.390 15:30:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:07.390 15:30:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:07.390 15:30:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:07.390 15:30:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:07.390 15:30:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:07.390 15:30:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:07.390 15:30:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:07.391 15:30:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:07.391 15:30:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:07.391 15:30:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:07.391 15:30:58 -- common/autotest_common.sh@10 -- # set +x 00:07:09.922 15:31:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:09.922 15:31:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:09.922 15:31:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:09.923 15:31:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:09.923 15:31:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:09.923 15:31:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:09.923 15:31:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:09.923 15:31:00 -- nvmf/common.sh@294 -- # net_devs=() 00:07:09.923 15:31:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:09.923 15:31:00 -- nvmf/common.sh@295 -- # e810=() 00:07:09.923 15:31:00 -- nvmf/common.sh@295 -- # local -ga e810 00:07:09.923 15:31:00 -- nvmf/common.sh@296 -- # x722=() 00:07:09.923 15:31:00 -- nvmf/common.sh@296 -- # local -ga x722 00:07:09.923 15:31:00 -- nvmf/common.sh@297 -- # mlx=() 00:07:09.923 15:31:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:09.923 15:31:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:09.923 15:31:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:09.923 15:31:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:09.923 15:31:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:09.923 15:31:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:09.923 15:31:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:09.923 15:31:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:09.923 15:31:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:09.923 15:31:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:09.923 15:31:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:09.923 15:31:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:09.923 15:31:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:09.923 15:31:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:09.923 15:31:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:09.923 15:31:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:09.923 15:31:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:09.923 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:09.923 15:31:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:09.923 15:31:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:09.923 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:09.923 15:31:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:09.923 15:31:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:09.923 15:31:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:09.923 15:31:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:09.923 15:31:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:09.923 15:31:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:09.923 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:09.923 15:31:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:09.923 15:31:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:09.923 15:31:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:09.923 15:31:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:09.923 15:31:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:09.923 15:31:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:09.923 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:09.923 15:31:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:09.923 15:31:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:09.923 15:31:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:09.923 15:31:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:09.923 15:31:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:09.923 15:31:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:09.923 15:31:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:09.923 15:31:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:09.923 15:31:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:09.923 15:31:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:09.923 15:31:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:09.923 15:31:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:09.923 15:31:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:09.923 15:31:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:09.923 15:31:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:09.923 15:31:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:09.923 15:31:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:09.923 15:31:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:09.923 15:31:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:09.923 15:31:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:09.923 15:31:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:09.923 15:31:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:09.923 15:31:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:09.923 15:31:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:09.923 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:09.923 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.187 ms 00:07:09.923 00:07:09.923 --- 10.0.0.2 ping statistics --- 00:07:09.923 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:09.923 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:07:09.923 15:31:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:09.923 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:09.923 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:07:09.923 00:07:09.923 --- 10.0.0.1 ping statistics --- 00:07:09.923 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:09.923 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:07:09.923 15:31:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:09.923 15:31:00 -- nvmf/common.sh@410 -- # return 0 00:07:09.923 15:31:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:09.923 15:31:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:09.923 15:31:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:09.923 15:31:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:09.923 15:31:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:09.923 15:31:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:09.923 15:31:00 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:09.923 15:31:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:09.923 15:31:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:09.923 15:31:00 -- common/autotest_common.sh@10 -- # set +x 00:07:09.923 15:31:00 -- nvmf/common.sh@469 -- # nvmfpid=779908 00:07:09.923 15:31:00 -- nvmf/common.sh@470 -- # waitforlisten 779908 00:07:09.923 15:31:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:09.923 15:31:00 -- common/autotest_common.sh@829 -- # '[' -z 779908 ']' 00:07:09.923 15:31:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:09.923 15:31:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:09.923 15:31:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:09.923 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:09.923 15:31:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:09.923 15:31:00 -- common/autotest_common.sh@10 -- # set +x 00:07:09.923 [2024-11-26 15:31:01.012911] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:09.923 [2024-11-26 15:31:01.013000] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:09.923 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.923 [2024-11-26 15:31:01.083959] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:09.923 [2024-11-26 15:31:01.193554] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:09.923 [2024-11-26 15:31:01.193724] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:09.923 [2024-11-26 15:31:01.193742] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:09.923 [2024-11-26 15:31:01.193754] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:09.923 [2024-11-26 15:31:01.193827] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:09.923 [2024-11-26 15:31:01.193897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:09.923 [2024-11-26 15:31:01.193963] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:09.923 [2024-11-26 15:31:01.193965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.861 15:31:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:10.861 15:31:02 -- common/autotest_common.sh@862 -- # return 0 00:07:10.861 15:31:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:10.861 15:31:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:10.861 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:10.861 15:31:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:10.861 15:31:02 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:10.861 15:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.861 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:10.861 [2024-11-26 15:31:02.051474] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:10.861 15:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.861 15:31:02 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:10.861 15:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.861 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:10.861 [2024-11-26 15:31:02.063683] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:10.861 15:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.861 15:31:02 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:10.861 15:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.861 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:10.861 15:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.861 15:31:02 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:10.861 15:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.861 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:10.861 15:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.861 15:31:02 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:10.861 15:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.861 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:10.861 15:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.861 15:31:02 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:10.861 15:31:02 -- target/referrals.sh@48 -- # jq length 00:07:10.861 15:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.861 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:10.861 15:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.861 15:31:02 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:10.861 15:31:02 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:10.861 15:31:02 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:10.861 15:31:02 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:10.861 15:31:02 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:10.861 15:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.861 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:10.861 15:31:02 -- target/referrals.sh@21 -- # sort 00:07:10.861 15:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.861 15:31:02 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:10.861 15:31:02 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:10.861 15:31:02 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:10.861 15:31:02 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:10.861 15:31:02 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:10.861 15:31:02 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:10.861 15:31:02 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:10.861 15:31:02 -- target/referrals.sh@26 -- # sort 00:07:11.121 15:31:02 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:11.121 15:31:02 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:11.121 15:31:02 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:11.121 15:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:11.121 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:11.121 15:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:11.121 15:31:02 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:11.121 15:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:11.121 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:11.121 15:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:11.121 15:31:02 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:11.121 15:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:11.121 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:11.121 15:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:11.121 15:31:02 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:11.121 15:31:02 -- target/referrals.sh@56 -- # jq length 00:07:11.121 15:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:11.121 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:11.121 15:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:11.121 15:31:02 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:11.121 15:31:02 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:11.121 15:31:02 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:11.121 15:31:02 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:11.121 15:31:02 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:11.121 15:31:02 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:11.121 15:31:02 -- target/referrals.sh@26 -- # sort 00:07:11.381 15:31:02 -- target/referrals.sh@26 -- # echo 00:07:11.381 15:31:02 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:11.381 15:31:02 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:11.381 15:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:11.381 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:11.381 15:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:11.381 15:31:02 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:11.381 15:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:11.381 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:11.381 15:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:11.381 15:31:02 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:11.381 15:31:02 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:11.381 15:31:02 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:11.381 15:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:11.381 15:31:02 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:11.381 15:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:11.381 15:31:02 -- target/referrals.sh@21 -- # sort 00:07:11.381 15:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:11.381 15:31:02 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:11.381 15:31:02 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:11.381 15:31:02 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:11.381 15:31:02 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:11.381 15:31:02 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:11.381 15:31:02 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:11.381 15:31:02 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:11.381 15:31:02 -- target/referrals.sh@26 -- # sort 00:07:11.642 15:31:02 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:11.642 15:31:02 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:11.642 15:31:02 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:11.642 15:31:02 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:11.642 15:31:02 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:11.642 15:31:02 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:11.642 15:31:02 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:11.642 15:31:03 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:11.642 15:31:03 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:11.642 15:31:03 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:11.642 15:31:03 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:11.642 15:31:03 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:11.642 15:31:03 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:11.901 15:31:03 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:11.901 15:31:03 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:11.901 15:31:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:11.901 15:31:03 -- common/autotest_common.sh@10 -- # set +x 00:07:11.901 15:31:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:11.901 15:31:03 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:11.901 15:31:03 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:11.901 15:31:03 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:11.901 15:31:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:11.901 15:31:03 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:11.901 15:31:03 -- common/autotest_common.sh@10 -- # set +x 00:07:11.901 15:31:03 -- target/referrals.sh@21 -- # sort 00:07:11.901 15:31:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:11.901 15:31:03 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:11.901 15:31:03 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:11.901 15:31:03 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:11.901 15:31:03 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:11.901 15:31:03 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:11.901 15:31:03 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:11.901 15:31:03 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:11.902 15:31:03 -- target/referrals.sh@26 -- # sort 00:07:12.161 15:31:03 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:12.161 15:31:03 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:12.161 15:31:03 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:12.161 15:31:03 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:12.161 15:31:03 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:12.161 15:31:03 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:12.161 15:31:03 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:12.161 15:31:03 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:12.161 15:31:03 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:12.161 15:31:03 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:12.161 15:31:03 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:12.161 15:31:03 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:12.161 15:31:03 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:12.419 15:31:03 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:12.419 15:31:03 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:12.419 15:31:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:12.419 15:31:03 -- common/autotest_common.sh@10 -- # set +x 00:07:12.419 15:31:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:12.419 15:31:03 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:12.419 15:31:03 -- target/referrals.sh@82 -- # jq length 00:07:12.419 15:31:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:12.419 15:31:03 -- common/autotest_common.sh@10 -- # set +x 00:07:12.419 15:31:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:12.419 15:31:03 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:12.419 15:31:03 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:12.419 15:31:03 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:12.419 15:31:03 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:12.419 15:31:03 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:12.419 15:31:03 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:12.419 15:31:03 -- target/referrals.sh@26 -- # sort 00:07:12.679 15:31:03 -- target/referrals.sh@26 -- # echo 00:07:12.679 15:31:03 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:12.679 15:31:03 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:12.679 15:31:03 -- target/referrals.sh@86 -- # nvmftestfini 00:07:12.679 15:31:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:12.679 15:31:03 -- nvmf/common.sh@116 -- # sync 00:07:12.679 15:31:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:12.679 15:31:03 -- nvmf/common.sh@119 -- # set +e 00:07:12.679 15:31:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:12.679 15:31:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:12.679 rmmod nvme_tcp 00:07:12.679 rmmod nvme_fabrics 00:07:12.679 rmmod nvme_keyring 00:07:12.679 15:31:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:12.679 15:31:03 -- nvmf/common.sh@123 -- # set -e 00:07:12.679 15:31:03 -- nvmf/common.sh@124 -- # return 0 00:07:12.679 15:31:03 -- nvmf/common.sh@477 -- # '[' -n 779908 ']' 00:07:12.679 15:31:03 -- nvmf/common.sh@478 -- # killprocess 779908 00:07:12.679 15:31:03 -- common/autotest_common.sh@936 -- # '[' -z 779908 ']' 00:07:12.679 15:31:03 -- common/autotest_common.sh@940 -- # kill -0 779908 00:07:12.679 15:31:03 -- common/autotest_common.sh@941 -- # uname 00:07:12.679 15:31:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:12.679 15:31:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 779908 00:07:12.679 15:31:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:12.679 15:31:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:12.679 15:31:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 779908' 00:07:12.679 killing process with pid 779908 00:07:12.679 15:31:04 -- common/autotest_common.sh@955 -- # kill 779908 00:07:12.679 15:31:04 -- common/autotest_common.sh@960 -- # wait 779908 00:07:12.938 15:31:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:12.938 15:31:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:12.938 15:31:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:12.938 15:31:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:12.938 15:31:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:12.938 15:31:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:12.938 15:31:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:12.938 15:31:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:15.477 15:31:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:15.477 00:07:15.477 real 0m7.732s 00:07:15.477 user 0m13.954s 00:07:15.477 sys 0m2.227s 00:07:15.477 15:31:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:15.477 15:31:06 -- common/autotest_common.sh@10 -- # set +x 00:07:15.477 ************************************ 00:07:15.477 END TEST nvmf_referrals 00:07:15.477 ************************************ 00:07:15.477 15:31:06 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:15.477 15:31:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:15.477 15:31:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:15.477 15:31:06 -- common/autotest_common.sh@10 -- # set +x 00:07:15.478 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:07:15.478 ************************************ 00:07:15.478 START TEST nvmf_connect_disconnect 00:07:15.478 ************************************ 00:07:15.478 15:31:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:15.478 * Looking for test storage... 00:07:15.478 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:15.478 15:31:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:15.478 15:31:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:15.478 15:31:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:15.478 15:31:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:15.478 15:31:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:15.478 15:31:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:15.478 15:31:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:15.478 15:31:06 -- scripts/common.sh@335 -- # IFS=.-: 00:07:15.478 15:31:06 -- scripts/common.sh@335 -- # read -ra ver1 00:07:15.478 15:31:06 -- scripts/common.sh@336 -- # IFS=.-: 00:07:15.478 15:31:06 -- scripts/common.sh@336 -- # read -ra ver2 00:07:15.478 15:31:06 -- scripts/common.sh@337 -- # local 'op=<' 00:07:15.478 15:31:06 -- scripts/common.sh@339 -- # ver1_l=2 00:07:15.478 15:31:06 -- scripts/common.sh@340 -- # ver2_l=1 00:07:15.478 15:31:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:15.478 15:31:06 -- scripts/common.sh@343 -- # case "$op" in 00:07:15.478 15:31:06 -- scripts/common.sh@344 -- # : 1 00:07:15.478 15:31:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:15.478 15:31:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:15.478 15:31:06 -- scripts/common.sh@364 -- # decimal 1 00:07:15.478 15:31:06 -- scripts/common.sh@352 -- # local d=1 00:07:15.478 15:31:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:15.478 15:31:06 -- scripts/common.sh@354 -- # echo 1 00:07:15.478 15:31:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:15.478 15:31:06 -- scripts/common.sh@365 -- # decimal 2 00:07:15.478 15:31:06 -- scripts/common.sh@352 -- # local d=2 00:07:15.478 15:31:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:15.478 15:31:06 -- scripts/common.sh@354 -- # echo 2 00:07:15.478 15:31:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:15.478 15:31:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:15.478 15:31:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:15.478 15:31:06 -- scripts/common.sh@367 -- # return 0 00:07:15.478 15:31:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:15.478 15:31:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:15.478 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:15.478 --rc genhtml_branch_coverage=1 00:07:15.478 --rc genhtml_function_coverage=1 00:07:15.478 --rc genhtml_legend=1 00:07:15.478 --rc geninfo_all_blocks=1 00:07:15.478 --rc geninfo_unexecuted_blocks=1 00:07:15.478 00:07:15.478 ' 00:07:15.478 15:31:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:15.478 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:15.478 --rc genhtml_branch_coverage=1 00:07:15.478 --rc genhtml_function_coverage=1 00:07:15.478 --rc genhtml_legend=1 00:07:15.478 --rc geninfo_all_blocks=1 00:07:15.478 --rc geninfo_unexecuted_blocks=1 00:07:15.478 00:07:15.478 ' 00:07:15.478 15:31:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:15.478 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:15.478 --rc genhtml_branch_coverage=1 00:07:15.478 --rc genhtml_function_coverage=1 00:07:15.478 --rc genhtml_legend=1 00:07:15.478 --rc geninfo_all_blocks=1 00:07:15.478 --rc geninfo_unexecuted_blocks=1 00:07:15.478 00:07:15.478 ' 00:07:15.478 15:31:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:15.478 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:15.478 --rc genhtml_branch_coverage=1 00:07:15.478 --rc genhtml_function_coverage=1 00:07:15.478 --rc genhtml_legend=1 00:07:15.478 --rc geninfo_all_blocks=1 00:07:15.478 --rc geninfo_unexecuted_blocks=1 00:07:15.478 00:07:15.478 ' 00:07:15.478 15:31:06 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:15.478 15:31:06 -- nvmf/common.sh@7 -- # uname -s 00:07:15.478 15:31:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:15.478 15:31:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:15.478 15:31:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:15.478 15:31:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:15.478 15:31:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:15.478 15:31:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:15.478 15:31:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:15.478 15:31:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:15.478 15:31:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:15.478 15:31:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:15.478 15:31:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:15.478 15:31:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:15.478 15:31:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:15.478 15:31:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:15.478 15:31:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:15.478 15:31:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:15.478 15:31:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:15.478 15:31:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:15.478 15:31:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:15.478 15:31:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:15.478 15:31:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:15.478 15:31:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:15.478 15:31:06 -- paths/export.sh@5 -- # export PATH 00:07:15.478 15:31:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:15.478 15:31:06 -- nvmf/common.sh@46 -- # : 0 00:07:15.478 15:31:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:15.478 15:31:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:15.478 15:31:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:15.478 15:31:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:15.478 15:31:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:15.478 15:31:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:15.478 15:31:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:15.478 15:31:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:15.478 15:31:06 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:15.478 15:31:06 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:15.478 15:31:06 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:15.478 15:31:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:15.478 15:31:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:15.478 15:31:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:15.478 15:31:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:15.478 15:31:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:15.478 15:31:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:15.478 15:31:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:15.478 15:31:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:15.478 15:31:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:15.478 15:31:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:15.478 15:31:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:15.478 15:31:06 -- common/autotest_common.sh@10 -- # set +x 00:07:17.382 15:31:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:17.382 15:31:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:17.382 15:31:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:17.382 15:31:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:17.382 15:31:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:17.382 15:31:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:17.382 15:31:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:17.382 15:31:08 -- nvmf/common.sh@294 -- # net_devs=() 00:07:17.382 15:31:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:17.382 15:31:08 -- nvmf/common.sh@295 -- # e810=() 00:07:17.382 15:31:08 -- nvmf/common.sh@295 -- # local -ga e810 00:07:17.382 15:31:08 -- nvmf/common.sh@296 -- # x722=() 00:07:17.382 15:31:08 -- nvmf/common.sh@296 -- # local -ga x722 00:07:17.382 15:31:08 -- nvmf/common.sh@297 -- # mlx=() 00:07:17.382 15:31:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:17.382 15:31:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:17.382 15:31:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:17.382 15:31:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:17.382 15:31:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:17.382 15:31:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:17.382 15:31:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:17.382 15:31:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:17.382 15:31:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:17.382 15:31:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:17.382 15:31:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:17.382 15:31:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:17.382 15:31:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:17.382 15:31:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:17.382 15:31:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:17.382 15:31:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:17.382 15:31:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:17.382 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:17.382 15:31:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:17.382 15:31:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:17.382 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:17.382 15:31:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:17.382 15:31:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:17.382 15:31:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:17.382 15:31:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:17.382 15:31:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:17.382 15:31:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:17.382 15:31:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:17.382 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:17.382 15:31:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:17.383 15:31:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:17.383 15:31:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:17.383 15:31:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:17.383 15:31:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:17.383 15:31:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:17.383 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:17.383 15:31:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:17.383 15:31:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:17.383 15:31:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:17.383 15:31:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:17.383 15:31:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:17.383 15:31:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:17.383 15:31:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:17.383 15:31:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:17.383 15:31:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:17.383 15:31:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:17.383 15:31:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:17.383 15:31:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:17.383 15:31:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:17.383 15:31:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:17.383 15:31:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:17.383 15:31:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:17.383 15:31:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:17.383 15:31:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:17.383 15:31:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:17.383 15:31:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:17.383 15:31:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:17.383 15:31:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:17.383 15:31:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:17.383 15:31:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:17.383 15:31:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:17.383 15:31:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:17.383 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:17.383 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:07:17.383 00:07:17.383 --- 10.0.0.2 ping statistics --- 00:07:17.383 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:17.383 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:07:17.383 15:31:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:17.383 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:17.383 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:07:17.383 00:07:17.383 --- 10.0.0.1 ping statistics --- 00:07:17.383 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:17.383 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:07:17.383 15:31:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:17.383 15:31:08 -- nvmf/common.sh@410 -- # return 0 00:07:17.383 15:31:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:17.383 15:31:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:17.383 15:31:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:17.383 15:31:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:17.383 15:31:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:17.383 15:31:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:17.383 15:31:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:17.383 15:31:08 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:17.383 15:31:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:17.383 15:31:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:17.383 15:31:08 -- common/autotest_common.sh@10 -- # set +x 00:07:17.383 15:31:08 -- nvmf/common.sh@469 -- # nvmfpid=782212 00:07:17.383 15:31:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:17.383 15:31:08 -- nvmf/common.sh@470 -- # waitforlisten 782212 00:07:17.383 15:31:08 -- common/autotest_common.sh@829 -- # '[' -z 782212 ']' 00:07:17.383 15:31:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:17.383 15:31:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:17.383 15:31:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:17.383 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:17.383 15:31:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:17.383 15:31:08 -- common/autotest_common.sh@10 -- # set +x 00:07:17.383 [2024-11-26 15:31:08.661844] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:17.383 [2024-11-26 15:31:08.661924] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:17.383 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.383 [2024-11-26 15:31:08.731932] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:17.642 [2024-11-26 15:31:08.854887] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:17.642 [2024-11-26 15:31:08.855046] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:17.642 [2024-11-26 15:31:08.855076] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:17.642 [2024-11-26 15:31:08.855089] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:17.642 [2024-11-26 15:31:08.855159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:17.642 [2024-11-26 15:31:08.855199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:17.642 [2024-11-26 15:31:08.855246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:17.642 [2024-11-26 15:31:08.855248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.214 15:31:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:18.214 15:31:09 -- common/autotest_common.sh@862 -- # return 0 00:07:18.214 15:31:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:18.214 15:31:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:18.214 15:31:09 -- common/autotest_common.sh@10 -- # set +x 00:07:18.472 15:31:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:18.472 15:31:09 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:18.472 15:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.472 15:31:09 -- common/autotest_common.sh@10 -- # set +x 00:07:18.472 [2024-11-26 15:31:09.676305] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:18.472 15:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.472 15:31:09 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:18.472 15:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.472 15:31:09 -- common/autotest_common.sh@10 -- # set +x 00:07:18.472 15:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.472 15:31:09 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:18.472 15:31:09 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:18.472 15:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.472 15:31:09 -- common/autotest_common.sh@10 -- # set +x 00:07:18.472 15:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.472 15:31:09 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:18.472 15:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.472 15:31:09 -- common/autotest_common.sh@10 -- # set +x 00:07:18.472 15:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.472 15:31:09 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:18.472 15:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.472 15:31:09 -- common/autotest_common.sh@10 -- # set +x 00:07:18.472 [2024-11-26 15:31:09.737864] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:18.472 15:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.472 15:31:09 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:18.472 15:31:09 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:18.472 15:31:09 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:18.472 15:31:09 -- target/connect_disconnect.sh@34 -- # set +x 00:07:21.008 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:23.543 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:25.449 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:27.990 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:29.962 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:32.503 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:35.043 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:36.948 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:39.487 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:41.395 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:43.935 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:45.841 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:48.384 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:50.923 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:53.465 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:55.374 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:57.912 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:00.447 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:02.445 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.989 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:06.930 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:09.467 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:12.005 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:13.914 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:16.449 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.989 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:20.897 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:23.434 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:27.883 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.421 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:32.957 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:35.494 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.402 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:39.992 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.923 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.457 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.366 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.903 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.433 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.340 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.877 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.413 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.317 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.852 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.390 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.295 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.829 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.736 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.272 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.855 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.758 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.303 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.210 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.750 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.280 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.189 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.729 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.269 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.177 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.715 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.255 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.164 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.702 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.240 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.776 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.800 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.335 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.247 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.783 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.317 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.223 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.759 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.297 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.201 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.736 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.271 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.804 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.706 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.245 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.785 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.697 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.265 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.831 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.734 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.278 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.814 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.725 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.261 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.800 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.706 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.249 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.177 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.716 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.249 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.157 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.699 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.236 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.166 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.703 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.703 15:35:01 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:10.703 15:35:01 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:10.703 15:35:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:10.703 15:35:01 -- nvmf/common.sh@116 -- # sync 00:11:10.703 15:35:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:10.703 15:35:01 -- nvmf/common.sh@119 -- # set +e 00:11:10.703 15:35:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:10.703 15:35:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:10.703 rmmod nvme_tcp 00:11:10.703 rmmod nvme_fabrics 00:11:10.703 rmmod nvme_keyring 00:11:10.703 15:35:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:10.703 15:35:01 -- nvmf/common.sh@123 -- # set -e 00:11:10.703 15:35:01 -- nvmf/common.sh@124 -- # return 0 00:11:10.703 15:35:01 -- nvmf/common.sh@477 -- # '[' -n 782212 ']' 00:11:10.703 15:35:01 -- nvmf/common.sh@478 -- # killprocess 782212 00:11:10.703 15:35:01 -- common/autotest_common.sh@936 -- # '[' -z 782212 ']' 00:11:10.703 15:35:01 -- common/autotest_common.sh@940 -- # kill -0 782212 00:11:10.703 15:35:01 -- common/autotest_common.sh@941 -- # uname 00:11:10.703 15:35:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:10.703 15:35:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 782212 00:11:10.703 15:35:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:10.703 15:35:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:10.703 15:35:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 782212' 00:11:10.703 killing process with pid 782212 00:11:10.703 15:35:01 -- common/autotest_common.sh@955 -- # kill 782212 00:11:10.703 15:35:01 -- common/autotest_common.sh@960 -- # wait 782212 00:11:10.962 15:35:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:10.962 15:35:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:10.962 15:35:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:10.963 15:35:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:10.963 15:35:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:10.963 15:35:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:10.963 15:35:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:10.963 15:35:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:12.872 15:35:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:12.872 00:11:12.872 real 3m57.952s 00:11:12.872 user 15m7.845s 00:11:12.872 sys 0m34.446s 00:11:12.872 15:35:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:12.872 15:35:04 -- common/autotest_common.sh@10 -- # set +x 00:11:12.872 ************************************ 00:11:12.872 END TEST nvmf_connect_disconnect 00:11:12.872 ************************************ 00:11:13.131 15:35:04 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:13.131 15:35:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:13.131 15:35:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:13.131 15:35:04 -- common/autotest_common.sh@10 -- # set +x 00:11:13.131 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:11:13.131 ************************************ 00:11:13.131 START TEST nvmf_multitarget 00:11:13.131 ************************************ 00:11:13.131 15:35:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:13.131 * Looking for test storage... 00:11:13.131 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:13.131 15:35:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:13.131 15:35:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:13.131 15:35:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:13.131 15:35:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:13.131 15:35:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:13.131 15:35:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:13.131 15:35:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:13.131 15:35:04 -- scripts/common.sh@335 -- # IFS=.-: 00:11:13.131 15:35:04 -- scripts/common.sh@335 -- # read -ra ver1 00:11:13.131 15:35:04 -- scripts/common.sh@336 -- # IFS=.-: 00:11:13.131 15:35:04 -- scripts/common.sh@336 -- # read -ra ver2 00:11:13.131 15:35:04 -- scripts/common.sh@337 -- # local 'op=<' 00:11:13.131 15:35:04 -- scripts/common.sh@339 -- # ver1_l=2 00:11:13.131 15:35:04 -- scripts/common.sh@340 -- # ver2_l=1 00:11:13.131 15:35:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:13.131 15:35:04 -- scripts/common.sh@343 -- # case "$op" in 00:11:13.131 15:35:04 -- scripts/common.sh@344 -- # : 1 00:11:13.131 15:35:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:13.131 15:35:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:13.131 15:35:04 -- scripts/common.sh@364 -- # decimal 1 00:11:13.131 15:35:04 -- scripts/common.sh@352 -- # local d=1 00:11:13.131 15:35:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:13.131 15:35:04 -- scripts/common.sh@354 -- # echo 1 00:11:13.131 15:35:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:13.131 15:35:04 -- scripts/common.sh@365 -- # decimal 2 00:11:13.131 15:35:04 -- scripts/common.sh@352 -- # local d=2 00:11:13.131 15:35:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:13.131 15:35:04 -- scripts/common.sh@354 -- # echo 2 00:11:13.131 15:35:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:13.131 15:35:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:13.131 15:35:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:13.131 15:35:04 -- scripts/common.sh@367 -- # return 0 00:11:13.131 15:35:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:13.131 15:35:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:13.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:13.131 --rc genhtml_branch_coverage=1 00:11:13.131 --rc genhtml_function_coverage=1 00:11:13.131 --rc genhtml_legend=1 00:11:13.131 --rc geninfo_all_blocks=1 00:11:13.131 --rc geninfo_unexecuted_blocks=1 00:11:13.131 00:11:13.131 ' 00:11:13.131 15:35:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:13.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:13.131 --rc genhtml_branch_coverage=1 00:11:13.131 --rc genhtml_function_coverage=1 00:11:13.131 --rc genhtml_legend=1 00:11:13.131 --rc geninfo_all_blocks=1 00:11:13.131 --rc geninfo_unexecuted_blocks=1 00:11:13.131 00:11:13.131 ' 00:11:13.131 15:35:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:13.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:13.131 --rc genhtml_branch_coverage=1 00:11:13.131 --rc genhtml_function_coverage=1 00:11:13.131 --rc genhtml_legend=1 00:11:13.131 --rc geninfo_all_blocks=1 00:11:13.131 --rc geninfo_unexecuted_blocks=1 00:11:13.131 00:11:13.131 ' 00:11:13.131 15:35:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:13.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:13.131 --rc genhtml_branch_coverage=1 00:11:13.131 --rc genhtml_function_coverage=1 00:11:13.131 --rc genhtml_legend=1 00:11:13.131 --rc geninfo_all_blocks=1 00:11:13.131 --rc geninfo_unexecuted_blocks=1 00:11:13.131 00:11:13.131 ' 00:11:13.131 15:35:04 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:13.131 15:35:04 -- nvmf/common.sh@7 -- # uname -s 00:11:13.131 15:35:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:13.131 15:35:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:13.131 15:35:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:13.131 15:35:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:13.131 15:35:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:13.131 15:35:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:13.131 15:35:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:13.131 15:35:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:13.131 15:35:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:13.131 15:35:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:13.131 15:35:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:13.131 15:35:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:13.131 15:35:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:13.131 15:35:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:13.131 15:35:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:13.131 15:35:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:13.131 15:35:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:13.131 15:35:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:13.131 15:35:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:13.131 15:35:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:13.131 15:35:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:13.132 15:35:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:13.132 15:35:04 -- paths/export.sh@5 -- # export PATH 00:11:13.132 15:35:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:13.132 15:35:04 -- nvmf/common.sh@46 -- # : 0 00:11:13.132 15:35:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:13.132 15:35:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:13.132 15:35:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:13.132 15:35:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:13.132 15:35:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:13.132 15:35:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:13.132 15:35:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:13.132 15:35:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:13.132 15:35:04 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:13.132 15:35:04 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:13.132 15:35:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:13.132 15:35:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:13.132 15:35:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:13.132 15:35:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:13.132 15:35:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:13.132 15:35:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:13.132 15:35:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:13.132 15:35:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:13.132 15:35:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:13.132 15:35:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:13.132 15:35:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:13.132 15:35:04 -- common/autotest_common.sh@10 -- # set +x 00:11:15.665 15:35:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:15.665 15:35:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:15.665 15:35:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:15.665 15:35:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:15.665 15:35:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:15.665 15:35:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:15.666 15:35:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:15.666 15:35:06 -- nvmf/common.sh@294 -- # net_devs=() 00:11:15.666 15:35:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:15.666 15:35:06 -- nvmf/common.sh@295 -- # e810=() 00:11:15.666 15:35:06 -- nvmf/common.sh@295 -- # local -ga e810 00:11:15.666 15:35:06 -- nvmf/common.sh@296 -- # x722=() 00:11:15.666 15:35:06 -- nvmf/common.sh@296 -- # local -ga x722 00:11:15.666 15:35:06 -- nvmf/common.sh@297 -- # mlx=() 00:11:15.666 15:35:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:15.666 15:35:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:15.666 15:35:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:15.666 15:35:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:15.666 15:35:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:15.666 15:35:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:15.666 15:35:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:15.666 15:35:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:15.666 15:35:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:15.666 15:35:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:15.666 15:35:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:15.666 15:35:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:15.666 15:35:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:15.666 15:35:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:15.666 15:35:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:15.666 15:35:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:15.666 15:35:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:15.666 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:15.666 15:35:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:15.666 15:35:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:15.666 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:15.666 15:35:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:15.666 15:35:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:15.666 15:35:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:15.666 15:35:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:15.666 15:35:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:15.666 15:35:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:15.666 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:15.666 15:35:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:15.666 15:35:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:15.666 15:35:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:15.666 15:35:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:15.666 15:35:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:15.666 15:35:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:15.666 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:15.666 15:35:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:15.666 15:35:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:15.666 15:35:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:15.666 15:35:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:15.666 15:35:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:15.666 15:35:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:15.666 15:35:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:15.666 15:35:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:15.666 15:35:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:15.666 15:35:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:15.666 15:35:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:15.666 15:35:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:15.666 15:35:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:15.666 15:35:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:15.666 15:35:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:15.666 15:35:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:15.666 15:35:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:15.666 15:35:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:15.666 15:35:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:15.666 15:35:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:15.666 15:35:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:15.666 15:35:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:15.666 15:35:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:15.666 15:35:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:15.666 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:15.666 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.285 ms 00:11:15.666 00:11:15.666 --- 10.0.0.2 ping statistics --- 00:11:15.666 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:15.666 rtt min/avg/max/mdev = 0.285/0.285/0.285/0.000 ms 00:11:15.666 15:35:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:15.666 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:15.666 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.141 ms 00:11:15.666 00:11:15.666 --- 10.0.0.1 ping statistics --- 00:11:15.666 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:15.666 rtt min/avg/max/mdev = 0.141/0.141/0.141/0.000 ms 00:11:15.666 15:35:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:15.666 15:35:06 -- nvmf/common.sh@410 -- # return 0 00:11:15.666 15:35:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:15.666 15:35:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:15.666 15:35:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:15.666 15:35:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:15.666 15:35:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:15.666 15:35:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:15.666 15:35:06 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:15.666 15:35:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:15.666 15:35:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:15.666 15:35:06 -- common/autotest_common.sh@10 -- # set +x 00:11:15.666 15:35:06 -- nvmf/common.sh@469 -- # nvmfpid=813069 00:11:15.666 15:35:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:15.666 15:35:06 -- nvmf/common.sh@470 -- # waitforlisten 813069 00:11:15.666 15:35:06 -- common/autotest_common.sh@829 -- # '[' -z 813069 ']' 00:11:15.666 15:35:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:15.666 15:35:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:15.666 15:35:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:15.666 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:15.666 15:35:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:15.666 15:35:06 -- common/autotest_common.sh@10 -- # set +x 00:11:15.666 [2024-11-26 15:35:06.816630] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:15.666 [2024-11-26 15:35:06.816718] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:15.666 EAL: No free 2048 kB hugepages reported on node 1 00:11:15.666 [2024-11-26 15:35:06.878132] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:15.666 [2024-11-26 15:35:06.983480] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:15.666 [2024-11-26 15:35:06.983658] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:15.666 [2024-11-26 15:35:06.983693] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:15.666 [2024-11-26 15:35:06.983714] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:15.666 [2024-11-26 15:35:06.983774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:15.666 [2024-11-26 15:35:06.983836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:15.666 [2024-11-26 15:35:06.983901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:15.666 [2024-11-26 15:35:06.983908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:16.603 15:35:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:16.603 15:35:07 -- common/autotest_common.sh@862 -- # return 0 00:11:16.603 15:35:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:16.603 15:35:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:16.603 15:35:07 -- common/autotest_common.sh@10 -- # set +x 00:11:16.603 15:35:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:16.603 15:35:07 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:16.603 15:35:07 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:16.603 15:35:07 -- target/multitarget.sh@21 -- # jq length 00:11:16.603 15:35:07 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:16.603 15:35:07 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:16.861 "nvmf_tgt_1" 00:11:16.861 15:35:08 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:16.861 "nvmf_tgt_2" 00:11:16.861 15:35:08 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:16.861 15:35:08 -- target/multitarget.sh@28 -- # jq length 00:11:17.119 15:35:08 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:17.119 15:35:08 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:17.119 true 00:11:17.119 15:35:08 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:17.119 true 00:11:17.119 15:35:08 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:17.119 15:35:08 -- target/multitarget.sh@35 -- # jq length 00:11:17.378 15:35:08 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:17.378 15:35:08 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:17.378 15:35:08 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:17.378 15:35:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:17.378 15:35:08 -- nvmf/common.sh@116 -- # sync 00:11:17.378 15:35:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:17.378 15:35:08 -- nvmf/common.sh@119 -- # set +e 00:11:17.378 15:35:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:17.378 15:35:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:17.379 rmmod nvme_tcp 00:11:17.379 rmmod nvme_fabrics 00:11:17.379 rmmod nvme_keyring 00:11:17.379 15:35:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:17.379 15:35:08 -- nvmf/common.sh@123 -- # set -e 00:11:17.379 15:35:08 -- nvmf/common.sh@124 -- # return 0 00:11:17.379 15:35:08 -- nvmf/common.sh@477 -- # '[' -n 813069 ']' 00:11:17.379 15:35:08 -- nvmf/common.sh@478 -- # killprocess 813069 00:11:17.379 15:35:08 -- common/autotest_common.sh@936 -- # '[' -z 813069 ']' 00:11:17.379 15:35:08 -- common/autotest_common.sh@940 -- # kill -0 813069 00:11:17.379 15:35:08 -- common/autotest_common.sh@941 -- # uname 00:11:17.379 15:35:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:17.379 15:35:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 813069 00:11:17.379 15:35:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:17.379 15:35:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:17.379 15:35:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 813069' 00:11:17.379 killing process with pid 813069 00:11:17.379 15:35:08 -- common/autotest_common.sh@955 -- # kill 813069 00:11:17.379 15:35:08 -- common/autotest_common.sh@960 -- # wait 813069 00:11:17.637 15:35:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:17.637 15:35:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:17.637 15:35:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:17.637 15:35:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:17.637 15:35:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:17.637 15:35:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:17.637 15:35:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:17.637 15:35:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:20.174 15:35:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:20.174 00:11:20.174 real 0m6.713s 00:11:20.174 user 0m9.824s 00:11:20.174 sys 0m2.060s 00:11:20.174 15:35:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:20.174 15:35:11 -- common/autotest_common.sh@10 -- # set +x 00:11:20.174 ************************************ 00:11:20.174 END TEST nvmf_multitarget 00:11:20.174 ************************************ 00:11:20.174 15:35:11 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:20.174 15:35:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:20.174 15:35:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:20.174 15:35:11 -- common/autotest_common.sh@10 -- # set +x 00:11:20.174 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:11:20.174 ************************************ 00:11:20.174 START TEST nvmf_rpc 00:11:20.174 ************************************ 00:11:20.174 15:35:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:20.174 * Looking for test storage... 00:11:20.174 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:20.174 15:35:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:20.174 15:35:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:20.174 15:35:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:20.174 15:35:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:20.174 15:35:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:20.174 15:35:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:20.174 15:35:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:20.174 15:35:11 -- scripts/common.sh@335 -- # IFS=.-: 00:11:20.174 15:35:11 -- scripts/common.sh@335 -- # read -ra ver1 00:11:20.174 15:35:11 -- scripts/common.sh@336 -- # IFS=.-: 00:11:20.174 15:35:11 -- scripts/common.sh@336 -- # read -ra ver2 00:11:20.174 15:35:11 -- scripts/common.sh@337 -- # local 'op=<' 00:11:20.174 15:35:11 -- scripts/common.sh@339 -- # ver1_l=2 00:11:20.174 15:35:11 -- scripts/common.sh@340 -- # ver2_l=1 00:11:20.174 15:35:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:20.174 15:35:11 -- scripts/common.sh@343 -- # case "$op" in 00:11:20.174 15:35:11 -- scripts/common.sh@344 -- # : 1 00:11:20.174 15:35:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:20.174 15:35:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:20.174 15:35:11 -- scripts/common.sh@364 -- # decimal 1 00:11:20.174 15:35:11 -- scripts/common.sh@352 -- # local d=1 00:11:20.174 15:35:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:20.174 15:35:11 -- scripts/common.sh@354 -- # echo 1 00:11:20.174 15:35:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:20.174 15:35:11 -- scripts/common.sh@365 -- # decimal 2 00:11:20.174 15:35:11 -- scripts/common.sh@352 -- # local d=2 00:11:20.174 15:35:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:20.174 15:35:11 -- scripts/common.sh@354 -- # echo 2 00:11:20.174 15:35:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:20.174 15:35:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:20.174 15:35:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:20.174 15:35:11 -- scripts/common.sh@367 -- # return 0 00:11:20.175 15:35:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:20.175 15:35:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:20.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:20.175 --rc genhtml_branch_coverage=1 00:11:20.175 --rc genhtml_function_coverage=1 00:11:20.175 --rc genhtml_legend=1 00:11:20.175 --rc geninfo_all_blocks=1 00:11:20.175 --rc geninfo_unexecuted_blocks=1 00:11:20.175 00:11:20.175 ' 00:11:20.175 15:35:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:20.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:20.175 --rc genhtml_branch_coverage=1 00:11:20.175 --rc genhtml_function_coverage=1 00:11:20.175 --rc genhtml_legend=1 00:11:20.175 --rc geninfo_all_blocks=1 00:11:20.175 --rc geninfo_unexecuted_blocks=1 00:11:20.175 00:11:20.175 ' 00:11:20.175 15:35:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:20.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:20.175 --rc genhtml_branch_coverage=1 00:11:20.175 --rc genhtml_function_coverage=1 00:11:20.175 --rc genhtml_legend=1 00:11:20.175 --rc geninfo_all_blocks=1 00:11:20.175 --rc geninfo_unexecuted_blocks=1 00:11:20.175 00:11:20.175 ' 00:11:20.175 15:35:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:20.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:20.175 --rc genhtml_branch_coverage=1 00:11:20.175 --rc genhtml_function_coverage=1 00:11:20.175 --rc genhtml_legend=1 00:11:20.175 --rc geninfo_all_blocks=1 00:11:20.175 --rc geninfo_unexecuted_blocks=1 00:11:20.175 00:11:20.175 ' 00:11:20.175 15:35:11 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:20.175 15:35:11 -- nvmf/common.sh@7 -- # uname -s 00:11:20.175 15:35:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:20.175 15:35:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:20.175 15:35:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:20.175 15:35:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:20.175 15:35:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:20.175 15:35:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:20.175 15:35:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:20.175 15:35:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:20.175 15:35:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:20.175 15:35:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:20.175 15:35:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:20.175 15:35:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:20.175 15:35:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:20.175 15:35:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:20.175 15:35:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:20.175 15:35:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:20.175 15:35:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:20.175 15:35:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:20.175 15:35:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:20.175 15:35:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:20.175 15:35:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:20.175 15:35:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:20.175 15:35:11 -- paths/export.sh@5 -- # export PATH 00:11:20.175 15:35:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:20.175 15:35:11 -- nvmf/common.sh@46 -- # : 0 00:11:20.175 15:35:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:20.175 15:35:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:20.175 15:35:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:20.175 15:35:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:20.175 15:35:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:20.175 15:35:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:20.175 15:35:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:20.175 15:35:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:20.175 15:35:11 -- target/rpc.sh@11 -- # loops=5 00:11:20.175 15:35:11 -- target/rpc.sh@23 -- # nvmftestinit 00:11:20.175 15:35:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:20.175 15:35:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:20.175 15:35:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:20.175 15:35:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:20.175 15:35:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:20.175 15:35:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:20.175 15:35:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:20.175 15:35:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:20.175 15:35:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:20.175 15:35:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:20.175 15:35:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:20.175 15:35:11 -- common/autotest_common.sh@10 -- # set +x 00:11:22.083 15:35:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:22.083 15:35:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:22.083 15:35:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:22.083 15:35:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:22.083 15:35:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:22.083 15:35:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:22.083 15:35:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:22.083 15:35:13 -- nvmf/common.sh@294 -- # net_devs=() 00:11:22.083 15:35:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:22.083 15:35:13 -- nvmf/common.sh@295 -- # e810=() 00:11:22.083 15:35:13 -- nvmf/common.sh@295 -- # local -ga e810 00:11:22.083 15:35:13 -- nvmf/common.sh@296 -- # x722=() 00:11:22.083 15:35:13 -- nvmf/common.sh@296 -- # local -ga x722 00:11:22.083 15:35:13 -- nvmf/common.sh@297 -- # mlx=() 00:11:22.083 15:35:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:22.083 15:35:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:22.083 15:35:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:22.083 15:35:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:22.083 15:35:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:22.083 15:35:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:22.083 15:35:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:22.083 15:35:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:22.083 15:35:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:22.083 15:35:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:22.083 15:35:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:22.083 15:35:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:22.083 15:35:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:22.083 15:35:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:22.083 15:35:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:22.083 15:35:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:22.083 15:35:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:22.083 15:35:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:22.083 15:35:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:22.083 15:35:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:22.083 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:22.083 15:35:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:22.083 15:35:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:22.083 15:35:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:22.083 15:35:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:22.083 15:35:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:22.083 15:35:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:22.083 15:35:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:22.083 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:22.083 15:35:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:22.083 15:35:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:22.083 15:35:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:22.084 15:35:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:22.084 15:35:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:22.084 15:35:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:22.084 15:35:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:22.084 15:35:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:22.084 15:35:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:22.084 15:35:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:22.084 15:35:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:22.084 15:35:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:22.084 15:35:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:22.084 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:22.084 15:35:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:22.084 15:35:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:22.084 15:35:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:22.084 15:35:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:22.084 15:35:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:22.084 15:35:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:22.084 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:22.084 15:35:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:22.084 15:35:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:22.084 15:35:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:22.084 15:35:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:22.084 15:35:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:22.084 15:35:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:22.084 15:35:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:22.084 15:35:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:22.084 15:35:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:22.084 15:35:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:22.084 15:35:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:22.084 15:35:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:22.084 15:35:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:22.084 15:35:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:22.084 15:35:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:22.084 15:35:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:22.084 15:35:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:22.084 15:35:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:22.084 15:35:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:22.084 15:35:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:22.084 15:35:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:22.084 15:35:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:22.084 15:35:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:22.084 15:35:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:22.084 15:35:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:22.084 15:35:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:22.084 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:22.084 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:11:22.084 00:11:22.084 --- 10.0.0.2 ping statistics --- 00:11:22.084 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:22.084 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:11:22.084 15:35:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:22.084 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:22.084 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:11:22.084 00:11:22.084 --- 10.0.0.1 ping statistics --- 00:11:22.084 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:22.084 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:11:22.084 15:35:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:22.084 15:35:13 -- nvmf/common.sh@410 -- # return 0 00:11:22.084 15:35:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:22.084 15:35:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:22.084 15:35:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:22.084 15:35:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:22.084 15:35:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:22.084 15:35:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:22.084 15:35:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:22.344 15:35:13 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:22.344 15:35:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:22.344 15:35:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:22.344 15:35:13 -- common/autotest_common.sh@10 -- # set +x 00:11:22.344 15:35:13 -- nvmf/common.sh@469 -- # nvmfpid=815219 00:11:22.344 15:35:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:22.344 15:35:13 -- nvmf/common.sh@470 -- # waitforlisten 815219 00:11:22.344 15:35:13 -- common/autotest_common.sh@829 -- # '[' -z 815219 ']' 00:11:22.344 15:35:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:22.344 15:35:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:22.344 15:35:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:22.344 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:22.344 15:35:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:22.344 15:35:13 -- common/autotest_common.sh@10 -- # set +x 00:11:22.344 [2024-11-26 15:35:13.580956] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:22.344 [2024-11-26 15:35:13.581064] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:22.344 EAL: No free 2048 kB hugepages reported on node 1 00:11:22.344 [2024-11-26 15:35:13.645113] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:22.344 [2024-11-26 15:35:13.750336] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:22.344 [2024-11-26 15:35:13.750502] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:22.344 [2024-11-26 15:35:13.750527] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:22.344 [2024-11-26 15:35:13.750545] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:22.344 [2024-11-26 15:35:13.750603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:22.344 [2024-11-26 15:35:13.750650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:22.344 [2024-11-26 15:35:13.750713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:22.344 [2024-11-26 15:35:13.750721] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:23.282 15:35:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:23.282 15:35:14 -- common/autotest_common.sh@862 -- # return 0 00:11:23.282 15:35:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:23.282 15:35:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:23.282 15:35:14 -- common/autotest_common.sh@10 -- # set +x 00:11:23.282 15:35:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:23.282 15:35:14 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:23.282 15:35:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.282 15:35:14 -- common/autotest_common.sh@10 -- # set +x 00:11:23.282 15:35:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.282 15:35:14 -- target/rpc.sh@26 -- # stats='{ 00:11:23.282 "tick_rate": 2700000000, 00:11:23.282 "poll_groups": [ 00:11:23.282 { 00:11:23.282 "name": "nvmf_tgt_poll_group_0", 00:11:23.282 "admin_qpairs": 0, 00:11:23.282 "io_qpairs": 0, 00:11:23.282 "current_admin_qpairs": 0, 00:11:23.282 "current_io_qpairs": 0, 00:11:23.282 "pending_bdev_io": 0, 00:11:23.282 "completed_nvme_io": 0, 00:11:23.282 "transports": [] 00:11:23.282 }, 00:11:23.282 { 00:11:23.282 "name": "nvmf_tgt_poll_group_1", 00:11:23.282 "admin_qpairs": 0, 00:11:23.282 "io_qpairs": 0, 00:11:23.282 "current_admin_qpairs": 0, 00:11:23.282 "current_io_qpairs": 0, 00:11:23.282 "pending_bdev_io": 0, 00:11:23.282 "completed_nvme_io": 0, 00:11:23.282 "transports": [] 00:11:23.282 }, 00:11:23.282 { 00:11:23.282 "name": "nvmf_tgt_poll_group_2", 00:11:23.282 "admin_qpairs": 0, 00:11:23.282 "io_qpairs": 0, 00:11:23.282 "current_admin_qpairs": 0, 00:11:23.282 "current_io_qpairs": 0, 00:11:23.282 "pending_bdev_io": 0, 00:11:23.282 "completed_nvme_io": 0, 00:11:23.282 "transports": [] 00:11:23.282 }, 00:11:23.282 { 00:11:23.282 "name": "nvmf_tgt_poll_group_3", 00:11:23.282 "admin_qpairs": 0, 00:11:23.282 "io_qpairs": 0, 00:11:23.282 "current_admin_qpairs": 0, 00:11:23.282 "current_io_qpairs": 0, 00:11:23.282 "pending_bdev_io": 0, 00:11:23.282 "completed_nvme_io": 0, 00:11:23.282 "transports": [] 00:11:23.282 } 00:11:23.282 ] 00:11:23.282 }' 00:11:23.282 15:35:14 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:23.282 15:35:14 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:23.282 15:35:14 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:23.282 15:35:14 -- target/rpc.sh@15 -- # wc -l 00:11:23.282 15:35:14 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:23.282 15:35:14 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:23.282 15:35:14 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:23.282 15:35:14 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:23.282 15:35:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.282 15:35:14 -- common/autotest_common.sh@10 -- # set +x 00:11:23.282 [2024-11-26 15:35:14.702711] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:23.282 15:35:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.282 15:35:14 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:23.282 15:35:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.282 15:35:14 -- common/autotest_common.sh@10 -- # set +x 00:11:23.282 15:35:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.282 15:35:14 -- target/rpc.sh@33 -- # stats='{ 00:11:23.282 "tick_rate": 2700000000, 00:11:23.282 "poll_groups": [ 00:11:23.282 { 00:11:23.282 "name": "nvmf_tgt_poll_group_0", 00:11:23.282 "admin_qpairs": 0, 00:11:23.282 "io_qpairs": 0, 00:11:23.282 "current_admin_qpairs": 0, 00:11:23.282 "current_io_qpairs": 0, 00:11:23.282 "pending_bdev_io": 0, 00:11:23.282 "completed_nvme_io": 0, 00:11:23.282 "transports": [ 00:11:23.282 { 00:11:23.282 "trtype": "TCP" 00:11:23.282 } 00:11:23.282 ] 00:11:23.282 }, 00:11:23.282 { 00:11:23.282 "name": "nvmf_tgt_poll_group_1", 00:11:23.282 "admin_qpairs": 0, 00:11:23.282 "io_qpairs": 0, 00:11:23.282 "current_admin_qpairs": 0, 00:11:23.282 "current_io_qpairs": 0, 00:11:23.282 "pending_bdev_io": 0, 00:11:23.282 "completed_nvme_io": 0, 00:11:23.282 "transports": [ 00:11:23.282 { 00:11:23.282 "trtype": "TCP" 00:11:23.282 } 00:11:23.282 ] 00:11:23.282 }, 00:11:23.282 { 00:11:23.282 "name": "nvmf_tgt_poll_group_2", 00:11:23.282 "admin_qpairs": 0, 00:11:23.282 "io_qpairs": 0, 00:11:23.282 "current_admin_qpairs": 0, 00:11:23.282 "current_io_qpairs": 0, 00:11:23.282 "pending_bdev_io": 0, 00:11:23.282 "completed_nvme_io": 0, 00:11:23.282 "transports": [ 00:11:23.282 { 00:11:23.282 "trtype": "TCP" 00:11:23.282 } 00:11:23.282 ] 00:11:23.282 }, 00:11:23.282 { 00:11:23.282 "name": "nvmf_tgt_poll_group_3", 00:11:23.282 "admin_qpairs": 0, 00:11:23.282 "io_qpairs": 0, 00:11:23.282 "current_admin_qpairs": 0, 00:11:23.282 "current_io_qpairs": 0, 00:11:23.282 "pending_bdev_io": 0, 00:11:23.282 "completed_nvme_io": 0, 00:11:23.282 "transports": [ 00:11:23.282 { 00:11:23.282 "trtype": "TCP" 00:11:23.282 } 00:11:23.282 ] 00:11:23.282 } 00:11:23.282 ] 00:11:23.282 }' 00:11:23.282 15:35:14 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:23.282 15:35:14 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:23.282 15:35:14 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:23.282 15:35:14 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:23.540 15:35:14 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:23.540 15:35:14 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:23.540 15:35:14 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:23.540 15:35:14 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:23.540 15:35:14 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:23.540 15:35:14 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:23.540 15:35:14 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:23.540 15:35:14 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:23.540 15:35:14 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:23.540 15:35:14 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:23.540 15:35:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.540 15:35:14 -- common/autotest_common.sh@10 -- # set +x 00:11:23.540 Malloc1 00:11:23.540 15:35:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.540 15:35:14 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:23.540 15:35:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.540 15:35:14 -- common/autotest_common.sh@10 -- # set +x 00:11:23.540 15:35:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.540 15:35:14 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:23.540 15:35:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.540 15:35:14 -- common/autotest_common.sh@10 -- # set +x 00:11:23.540 15:35:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.540 15:35:14 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:23.540 15:35:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.540 15:35:14 -- common/autotest_common.sh@10 -- # set +x 00:11:23.540 15:35:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.540 15:35:14 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:23.540 15:35:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.540 15:35:14 -- common/autotest_common.sh@10 -- # set +x 00:11:23.540 [2024-11-26 15:35:14.856313] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:23.540 15:35:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.540 15:35:14 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:23.540 15:35:14 -- common/autotest_common.sh@650 -- # local es=0 00:11:23.540 15:35:14 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:23.540 15:35:14 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:23.540 15:35:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:23.540 15:35:14 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:23.540 15:35:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:23.540 15:35:14 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:23.540 15:35:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:23.540 15:35:14 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:23.540 15:35:14 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:23.540 15:35:14 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:23.540 [2024-11-26 15:35:14.878715] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:23.540 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:23.540 could not add new controller: failed to write to nvme-fabrics device 00:11:23.540 15:35:14 -- common/autotest_common.sh@653 -- # es=1 00:11:23.540 15:35:14 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:23.540 15:35:14 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:23.540 15:35:14 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:23.540 15:35:14 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:23.540 15:35:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.540 15:35:14 -- common/autotest_common.sh@10 -- # set +x 00:11:23.540 15:35:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.540 15:35:14 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:24.477 15:35:15 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:24.477 15:35:15 -- common/autotest_common.sh@1187 -- # local i=0 00:11:24.477 15:35:15 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:24.477 15:35:15 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:24.477 15:35:15 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:26.379 15:35:17 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:26.379 15:35:17 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:26.380 15:35:17 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:26.380 15:35:17 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:26.380 15:35:17 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:26.380 15:35:17 -- common/autotest_common.sh@1197 -- # return 0 00:11:26.380 15:35:17 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:26.380 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.380 15:35:17 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:26.380 15:35:17 -- common/autotest_common.sh@1208 -- # local i=0 00:11:26.380 15:35:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:26.380 15:35:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:26.380 15:35:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:26.380 15:35:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:26.380 15:35:17 -- common/autotest_common.sh@1220 -- # return 0 00:11:26.380 15:35:17 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:26.380 15:35:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:26.380 15:35:17 -- common/autotest_common.sh@10 -- # set +x 00:11:26.380 15:35:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:26.380 15:35:17 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:26.380 15:35:17 -- common/autotest_common.sh@650 -- # local es=0 00:11:26.380 15:35:17 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:26.380 15:35:17 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:26.380 15:35:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:26.380 15:35:17 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:26.380 15:35:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:26.380 15:35:17 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:26.380 15:35:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:26.380 15:35:17 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:26.380 15:35:17 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:26.380 15:35:17 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:26.380 [2024-11-26 15:35:17.722282] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:26.380 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:26.380 could not add new controller: failed to write to nvme-fabrics device 00:11:26.380 15:35:17 -- common/autotest_common.sh@653 -- # es=1 00:11:26.380 15:35:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:26.380 15:35:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:26.380 15:35:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:26.380 15:35:17 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:26.380 15:35:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:26.380 15:35:17 -- common/autotest_common.sh@10 -- # set +x 00:11:26.380 15:35:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:26.380 15:35:17 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:26.952 15:35:18 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:26.952 15:35:18 -- common/autotest_common.sh@1187 -- # local i=0 00:11:26.952 15:35:18 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:26.952 15:35:18 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:26.952 15:35:18 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:29.493 15:35:20 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:29.493 15:35:20 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:29.493 15:35:20 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:29.493 15:35:20 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:29.493 15:35:20 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:29.493 15:35:20 -- common/autotest_common.sh@1197 -- # return 0 00:11:29.493 15:35:20 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:29.493 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.493 15:35:20 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:29.493 15:35:20 -- common/autotest_common.sh@1208 -- # local i=0 00:11:29.493 15:35:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:29.493 15:35:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:29.493 15:35:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:29.493 15:35:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:29.493 15:35:20 -- common/autotest_common.sh@1220 -- # return 0 00:11:29.493 15:35:20 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:29.493 15:35:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:29.493 15:35:20 -- common/autotest_common.sh@10 -- # set +x 00:11:29.493 15:35:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:29.493 15:35:20 -- target/rpc.sh@81 -- # seq 1 5 00:11:29.493 15:35:20 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:29.493 15:35:20 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:29.493 15:35:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:29.493 15:35:20 -- common/autotest_common.sh@10 -- # set +x 00:11:29.493 15:35:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:29.493 15:35:20 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:29.493 15:35:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:29.493 15:35:20 -- common/autotest_common.sh@10 -- # set +x 00:11:29.493 [2024-11-26 15:35:20.492956] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:29.493 15:35:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:29.493 15:35:20 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:29.493 15:35:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:29.493 15:35:20 -- common/autotest_common.sh@10 -- # set +x 00:11:29.493 15:35:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:29.493 15:35:20 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:29.494 15:35:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:29.494 15:35:20 -- common/autotest_common.sh@10 -- # set +x 00:11:29.494 15:35:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:29.494 15:35:20 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:29.754 15:35:21 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:29.754 15:35:21 -- common/autotest_common.sh@1187 -- # local i=0 00:11:29.754 15:35:21 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:29.754 15:35:21 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:29.754 15:35:21 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:32.290 15:35:23 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:32.290 15:35:23 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:32.290 15:35:23 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:32.290 15:35:23 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:32.290 15:35:23 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:32.290 15:35:23 -- common/autotest_common.sh@1197 -- # return 0 00:11:32.290 15:35:23 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:32.290 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.290 15:35:23 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:32.290 15:35:23 -- common/autotest_common.sh@1208 -- # local i=0 00:11:32.290 15:35:23 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:32.290 15:35:23 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:32.290 15:35:23 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:32.290 15:35:23 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:32.290 15:35:23 -- common/autotest_common.sh@1220 -- # return 0 00:11:32.290 15:35:23 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:32.290 15:35:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:32.290 15:35:23 -- common/autotest_common.sh@10 -- # set +x 00:11:32.290 15:35:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:32.290 15:35:23 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:32.290 15:35:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:32.290 15:35:23 -- common/autotest_common.sh@10 -- # set +x 00:11:32.290 15:35:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:32.290 15:35:23 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:32.290 15:35:23 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:32.290 15:35:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:32.290 15:35:23 -- common/autotest_common.sh@10 -- # set +x 00:11:32.290 15:35:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:32.290 15:35:23 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:32.290 15:35:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:32.290 15:35:23 -- common/autotest_common.sh@10 -- # set +x 00:11:32.290 [2024-11-26 15:35:23.274380] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:32.290 15:35:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:32.290 15:35:23 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:32.290 15:35:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:32.290 15:35:23 -- common/autotest_common.sh@10 -- # set +x 00:11:32.290 15:35:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:32.290 15:35:23 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:32.290 15:35:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:32.290 15:35:23 -- common/autotest_common.sh@10 -- # set +x 00:11:32.290 15:35:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:32.290 15:35:23 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:32.550 15:35:23 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:32.550 15:35:23 -- common/autotest_common.sh@1187 -- # local i=0 00:11:32.550 15:35:23 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:32.550 15:35:23 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:32.550 15:35:23 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:35.084 15:35:25 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:35.084 15:35:25 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:35.084 15:35:25 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:35.084 15:35:25 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:35.084 15:35:25 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:35.084 15:35:25 -- common/autotest_common.sh@1197 -- # return 0 00:11:35.084 15:35:25 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:35.084 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.084 15:35:26 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:35.084 15:35:26 -- common/autotest_common.sh@1208 -- # local i=0 00:11:35.084 15:35:26 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:35.084 15:35:26 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:35.084 15:35:26 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:35.084 15:35:26 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:35.084 15:35:26 -- common/autotest_common.sh@1220 -- # return 0 00:11:35.084 15:35:26 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:35.084 15:35:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:35.084 15:35:26 -- common/autotest_common.sh@10 -- # set +x 00:11:35.084 15:35:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:35.084 15:35:26 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:35.084 15:35:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:35.084 15:35:26 -- common/autotest_common.sh@10 -- # set +x 00:11:35.084 15:35:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:35.084 15:35:26 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:35.084 15:35:26 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:35.084 15:35:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:35.084 15:35:26 -- common/autotest_common.sh@10 -- # set +x 00:11:35.084 15:35:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:35.084 15:35:26 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:35.084 15:35:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:35.084 15:35:26 -- common/autotest_common.sh@10 -- # set +x 00:11:35.084 [2024-11-26 15:35:26.102556] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:35.084 15:35:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:35.084 15:35:26 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:35.084 15:35:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:35.084 15:35:26 -- common/autotest_common.sh@10 -- # set +x 00:11:35.084 15:35:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:35.084 15:35:26 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:35.084 15:35:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:35.084 15:35:26 -- common/autotest_common.sh@10 -- # set +x 00:11:35.084 15:35:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:35.084 15:35:26 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:35.344 15:35:26 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:35.344 15:35:26 -- common/autotest_common.sh@1187 -- # local i=0 00:11:35.344 15:35:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:35.345 15:35:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:35.345 15:35:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:37.884 15:35:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:37.884 15:35:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:37.884 15:35:28 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:37.884 15:35:28 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:37.884 15:35:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:37.884 15:35:28 -- common/autotest_common.sh@1197 -- # return 0 00:11:37.884 15:35:28 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:37.884 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.884 15:35:28 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:37.884 15:35:28 -- common/autotest_common.sh@1208 -- # local i=0 00:11:37.884 15:35:28 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:37.884 15:35:28 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:37.884 15:35:28 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:37.884 15:35:28 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:37.884 15:35:28 -- common/autotest_common.sh@1220 -- # return 0 00:11:37.884 15:35:28 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:37.884 15:35:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.884 15:35:28 -- common/autotest_common.sh@10 -- # set +x 00:11:37.884 15:35:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.884 15:35:28 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:37.884 15:35:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.884 15:35:28 -- common/autotest_common.sh@10 -- # set +x 00:11:37.884 15:35:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.884 15:35:28 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:37.884 15:35:28 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:37.884 15:35:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.884 15:35:28 -- common/autotest_common.sh@10 -- # set +x 00:11:37.884 15:35:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.884 15:35:28 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:37.884 15:35:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.884 15:35:28 -- common/autotest_common.sh@10 -- # set +x 00:11:37.884 [2024-11-26 15:35:28.887402] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:37.884 15:35:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.884 15:35:28 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:37.884 15:35:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.884 15:35:28 -- common/autotest_common.sh@10 -- # set +x 00:11:37.884 15:35:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.884 15:35:28 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:37.884 15:35:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.884 15:35:28 -- common/autotest_common.sh@10 -- # set +x 00:11:37.884 15:35:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.884 15:35:28 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:38.142 15:35:29 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:38.142 15:35:29 -- common/autotest_common.sh@1187 -- # local i=0 00:11:38.142 15:35:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:38.142 15:35:29 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:38.142 15:35:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:40.715 15:35:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:40.715 15:35:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:40.715 15:35:31 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:40.715 15:35:31 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:40.715 15:35:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:40.715 15:35:31 -- common/autotest_common.sh@1197 -- # return 0 00:11:40.715 15:35:31 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:40.715 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.715 15:35:31 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:40.715 15:35:31 -- common/autotest_common.sh@1208 -- # local i=0 00:11:40.715 15:35:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:40.715 15:35:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:40.715 15:35:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:40.715 15:35:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:40.715 15:35:31 -- common/autotest_common.sh@1220 -- # return 0 00:11:40.715 15:35:31 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:40.715 15:35:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:40.715 15:35:31 -- common/autotest_common.sh@10 -- # set +x 00:11:40.715 15:35:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:40.715 15:35:31 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:40.715 15:35:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:40.715 15:35:31 -- common/autotest_common.sh@10 -- # set +x 00:11:40.715 15:35:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:40.715 15:35:31 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:40.715 15:35:31 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:40.715 15:35:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:40.715 15:35:31 -- common/autotest_common.sh@10 -- # set +x 00:11:40.715 15:35:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:40.715 15:35:31 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:40.715 15:35:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:40.715 15:35:31 -- common/autotest_common.sh@10 -- # set +x 00:11:40.715 [2024-11-26 15:35:31.711939] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:40.715 15:35:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:40.715 15:35:31 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:40.715 15:35:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:40.715 15:35:31 -- common/autotest_common.sh@10 -- # set +x 00:11:40.715 15:35:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:40.715 15:35:31 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:40.715 15:35:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:40.715 15:35:31 -- common/autotest_common.sh@10 -- # set +x 00:11:40.715 15:35:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:40.715 15:35:31 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:40.975 15:35:32 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:40.975 15:35:32 -- common/autotest_common.sh@1187 -- # local i=0 00:11:40.975 15:35:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:40.975 15:35:32 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:40.975 15:35:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:42.884 15:35:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:42.884 15:35:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:42.884 15:35:34 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:43.142 15:35:34 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:43.142 15:35:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:43.142 15:35:34 -- common/autotest_common.sh@1197 -- # return 0 00:11:43.142 15:35:34 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:43.142 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.142 15:35:34 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:43.142 15:35:34 -- common/autotest_common.sh@1208 -- # local i=0 00:11:43.142 15:35:34 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:43.142 15:35:34 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:43.142 15:35:34 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:43.142 15:35:34 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:43.142 15:35:34 -- common/autotest_common.sh@1220 -- # return 0 00:11:43.142 15:35:34 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:43.142 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.142 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.142 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.142 15:35:34 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:43.142 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.142 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@99 -- # seq 1 5 00:11:43.143 15:35:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:43.143 15:35:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 [2024-11-26 15:35:34.477088] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:43.143 15:35:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 [2024-11-26 15:35:34.525121] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:43.143 15:35:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 [2024-11-26 15:35:34.573281] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.143 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.143 15:35:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:43.143 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.143 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.402 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.402 15:35:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:43.402 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.402 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.402 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.402 15:35:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:43.402 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.402 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.402 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.402 15:35:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:43.402 15:35:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:43.402 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.402 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.402 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.402 15:35:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:43.402 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.402 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.402 [2024-11-26 15:35:34.621433] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:43.402 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.403 15:35:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:43.403 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.403 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.403 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.403 15:35:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:43.403 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.403 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.403 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.403 15:35:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:43.403 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.403 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.403 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.403 15:35:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:43.403 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.403 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.403 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.403 15:35:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:43.403 15:35:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:43.403 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.403 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.403 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.403 15:35:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:43.403 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.403 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.403 [2024-11-26 15:35:34.669593] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:43.403 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.403 15:35:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:43.403 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.403 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.403 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.403 15:35:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:43.403 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.403 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.403 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.403 15:35:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:43.403 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.403 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.403 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.403 15:35:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:43.403 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.403 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.403 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.403 15:35:34 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:11:43.403 15:35:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.403 15:35:34 -- common/autotest_common.sh@10 -- # set +x 00:11:43.403 15:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.403 15:35:34 -- target/rpc.sh@110 -- # stats='{ 00:11:43.403 "tick_rate": 2700000000, 00:11:43.403 "poll_groups": [ 00:11:43.403 { 00:11:43.403 "name": "nvmf_tgt_poll_group_0", 00:11:43.403 "admin_qpairs": 2, 00:11:43.403 "io_qpairs": 84, 00:11:43.403 "current_admin_qpairs": 0, 00:11:43.403 "current_io_qpairs": 0, 00:11:43.403 "pending_bdev_io": 0, 00:11:43.403 "completed_nvme_io": 183, 00:11:43.403 "transports": [ 00:11:43.403 { 00:11:43.403 "trtype": "TCP" 00:11:43.403 } 00:11:43.403 ] 00:11:43.403 }, 00:11:43.403 { 00:11:43.403 "name": "nvmf_tgt_poll_group_1", 00:11:43.403 "admin_qpairs": 2, 00:11:43.403 "io_qpairs": 84, 00:11:43.403 "current_admin_qpairs": 0, 00:11:43.403 "current_io_qpairs": 0, 00:11:43.403 "pending_bdev_io": 0, 00:11:43.403 "completed_nvme_io": 134, 00:11:43.403 "transports": [ 00:11:43.403 { 00:11:43.403 "trtype": "TCP" 00:11:43.403 } 00:11:43.403 ] 00:11:43.403 }, 00:11:43.403 { 00:11:43.403 "name": "nvmf_tgt_poll_group_2", 00:11:43.403 "admin_qpairs": 1, 00:11:43.403 "io_qpairs": 84, 00:11:43.403 "current_admin_qpairs": 0, 00:11:43.403 "current_io_qpairs": 0, 00:11:43.403 "pending_bdev_io": 0, 00:11:43.403 "completed_nvme_io": 185, 00:11:43.403 "transports": [ 00:11:43.403 { 00:11:43.403 "trtype": "TCP" 00:11:43.403 } 00:11:43.403 ] 00:11:43.403 }, 00:11:43.403 { 00:11:43.403 "name": "nvmf_tgt_poll_group_3", 00:11:43.403 "admin_qpairs": 2, 00:11:43.403 "io_qpairs": 84, 00:11:43.403 "current_admin_qpairs": 0, 00:11:43.403 "current_io_qpairs": 0, 00:11:43.403 "pending_bdev_io": 0, 00:11:43.403 "completed_nvme_io": 184, 00:11:43.403 "transports": [ 00:11:43.403 { 00:11:43.403 "trtype": "TCP" 00:11:43.403 } 00:11:43.403 ] 00:11:43.403 } 00:11:43.403 ] 00:11:43.403 }' 00:11:43.403 15:35:34 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:11:43.403 15:35:34 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:43.403 15:35:34 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:43.403 15:35:34 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:43.403 15:35:34 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:11:43.403 15:35:34 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:11:43.403 15:35:34 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:43.403 15:35:34 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:43.403 15:35:34 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:43.403 15:35:34 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:11:43.403 15:35:34 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:11:43.403 15:35:34 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:11:43.403 15:35:34 -- target/rpc.sh@123 -- # nvmftestfini 00:11:43.403 15:35:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:43.403 15:35:34 -- nvmf/common.sh@116 -- # sync 00:11:43.403 15:35:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:43.403 15:35:34 -- nvmf/common.sh@119 -- # set +e 00:11:43.403 15:35:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:43.403 15:35:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:43.403 rmmod nvme_tcp 00:11:43.403 rmmod nvme_fabrics 00:11:43.403 rmmod nvme_keyring 00:11:43.664 15:35:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:43.664 15:35:34 -- nvmf/common.sh@123 -- # set -e 00:11:43.664 15:35:34 -- nvmf/common.sh@124 -- # return 0 00:11:43.664 15:35:34 -- nvmf/common.sh@477 -- # '[' -n 815219 ']' 00:11:43.664 15:35:34 -- nvmf/common.sh@478 -- # killprocess 815219 00:11:43.664 15:35:34 -- common/autotest_common.sh@936 -- # '[' -z 815219 ']' 00:11:43.664 15:35:34 -- common/autotest_common.sh@940 -- # kill -0 815219 00:11:43.664 15:35:34 -- common/autotest_common.sh@941 -- # uname 00:11:43.664 15:35:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:43.664 15:35:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 815219 00:11:43.664 15:35:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:43.664 15:35:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:43.664 15:35:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 815219' 00:11:43.664 killing process with pid 815219 00:11:43.664 15:35:34 -- common/autotest_common.sh@955 -- # kill 815219 00:11:43.664 15:35:34 -- common/autotest_common.sh@960 -- # wait 815219 00:11:43.928 15:35:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:43.928 15:35:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:43.928 15:35:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:43.928 15:35:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:43.928 15:35:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:43.928 15:35:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:43.928 15:35:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:43.928 15:35:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:45.837 15:35:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:45.837 00:11:45.837 real 0m26.168s 00:11:45.837 user 1m25.223s 00:11:45.837 sys 0m4.143s 00:11:45.837 15:35:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:45.837 15:35:37 -- common/autotest_common.sh@10 -- # set +x 00:11:45.837 ************************************ 00:11:45.837 END TEST nvmf_rpc 00:11:45.837 ************************************ 00:11:45.837 15:35:37 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:45.837 15:35:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:45.837 15:35:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:45.837 15:35:37 -- common/autotest_common.sh@10 -- # set +x 00:11:45.837 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:11:45.837 ************************************ 00:11:45.837 START TEST nvmf_invalid 00:11:45.837 ************************************ 00:11:45.837 15:35:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:46.097 * Looking for test storage... 00:11:46.097 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:46.097 15:35:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:46.097 15:35:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:46.097 15:35:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:46.097 15:35:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:46.097 15:35:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:46.097 15:35:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:46.097 15:35:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:46.097 15:35:37 -- scripts/common.sh@335 -- # IFS=.-: 00:11:46.097 15:35:37 -- scripts/common.sh@335 -- # read -ra ver1 00:11:46.097 15:35:37 -- scripts/common.sh@336 -- # IFS=.-: 00:11:46.097 15:35:37 -- scripts/common.sh@336 -- # read -ra ver2 00:11:46.097 15:35:37 -- scripts/common.sh@337 -- # local 'op=<' 00:11:46.097 15:35:37 -- scripts/common.sh@339 -- # ver1_l=2 00:11:46.097 15:35:37 -- scripts/common.sh@340 -- # ver2_l=1 00:11:46.097 15:35:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:46.097 15:35:37 -- scripts/common.sh@343 -- # case "$op" in 00:11:46.097 15:35:37 -- scripts/common.sh@344 -- # : 1 00:11:46.097 15:35:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:46.097 15:35:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:46.097 15:35:37 -- scripts/common.sh@364 -- # decimal 1 00:11:46.097 15:35:37 -- scripts/common.sh@352 -- # local d=1 00:11:46.097 15:35:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:46.097 15:35:37 -- scripts/common.sh@354 -- # echo 1 00:11:46.097 15:35:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:46.097 15:35:37 -- scripts/common.sh@365 -- # decimal 2 00:11:46.097 15:35:37 -- scripts/common.sh@352 -- # local d=2 00:11:46.097 15:35:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:46.097 15:35:37 -- scripts/common.sh@354 -- # echo 2 00:11:46.097 15:35:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:46.097 15:35:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:46.097 15:35:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:46.097 15:35:37 -- scripts/common.sh@367 -- # return 0 00:11:46.097 15:35:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:46.097 15:35:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:46.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.097 --rc genhtml_branch_coverage=1 00:11:46.097 --rc genhtml_function_coverage=1 00:11:46.097 --rc genhtml_legend=1 00:11:46.097 --rc geninfo_all_blocks=1 00:11:46.097 --rc geninfo_unexecuted_blocks=1 00:11:46.097 00:11:46.097 ' 00:11:46.097 15:35:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:46.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.097 --rc genhtml_branch_coverage=1 00:11:46.097 --rc genhtml_function_coverage=1 00:11:46.097 --rc genhtml_legend=1 00:11:46.097 --rc geninfo_all_blocks=1 00:11:46.097 --rc geninfo_unexecuted_blocks=1 00:11:46.097 00:11:46.097 ' 00:11:46.097 15:35:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:46.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.097 --rc genhtml_branch_coverage=1 00:11:46.097 --rc genhtml_function_coverage=1 00:11:46.097 --rc genhtml_legend=1 00:11:46.097 --rc geninfo_all_blocks=1 00:11:46.097 --rc geninfo_unexecuted_blocks=1 00:11:46.097 00:11:46.097 ' 00:11:46.097 15:35:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:46.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.097 --rc genhtml_branch_coverage=1 00:11:46.097 --rc genhtml_function_coverage=1 00:11:46.097 --rc genhtml_legend=1 00:11:46.097 --rc geninfo_all_blocks=1 00:11:46.097 --rc geninfo_unexecuted_blocks=1 00:11:46.097 00:11:46.097 ' 00:11:46.097 15:35:37 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:46.097 15:35:37 -- nvmf/common.sh@7 -- # uname -s 00:11:46.097 15:35:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:46.097 15:35:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:46.097 15:35:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:46.097 15:35:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:46.097 15:35:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:46.097 15:35:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:46.097 15:35:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:46.097 15:35:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:46.097 15:35:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:46.097 15:35:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:46.097 15:35:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:46.097 15:35:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:46.097 15:35:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:46.097 15:35:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:46.097 15:35:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:46.097 15:35:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:46.097 15:35:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:46.097 15:35:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:46.097 15:35:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:46.097 15:35:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.097 15:35:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.097 15:35:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.097 15:35:37 -- paths/export.sh@5 -- # export PATH 00:11:46.098 15:35:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.098 15:35:37 -- nvmf/common.sh@46 -- # : 0 00:11:46.098 15:35:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:46.098 15:35:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:46.098 15:35:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:46.098 15:35:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:46.098 15:35:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:46.098 15:35:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:46.098 15:35:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:46.098 15:35:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:46.098 15:35:37 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:46.098 15:35:37 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:11:46.098 15:35:37 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:11:46.098 15:35:37 -- target/invalid.sh@14 -- # target=foobar 00:11:46.098 15:35:37 -- target/invalid.sh@16 -- # RANDOM=0 00:11:46.098 15:35:37 -- target/invalid.sh@34 -- # nvmftestinit 00:11:46.098 15:35:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:46.098 15:35:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:46.098 15:35:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:46.098 15:35:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:46.098 15:35:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:46.098 15:35:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:46.098 15:35:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:46.098 15:35:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:46.098 15:35:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:46.098 15:35:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:46.098 15:35:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:46.098 15:35:37 -- common/autotest_common.sh@10 -- # set +x 00:11:48.635 15:35:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:48.636 15:35:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:48.636 15:35:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:48.636 15:35:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:48.636 15:35:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:48.636 15:35:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:48.636 15:35:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:48.636 15:35:39 -- nvmf/common.sh@294 -- # net_devs=() 00:11:48.636 15:35:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:48.636 15:35:39 -- nvmf/common.sh@295 -- # e810=() 00:11:48.636 15:35:39 -- nvmf/common.sh@295 -- # local -ga e810 00:11:48.636 15:35:39 -- nvmf/common.sh@296 -- # x722=() 00:11:48.636 15:35:39 -- nvmf/common.sh@296 -- # local -ga x722 00:11:48.636 15:35:39 -- nvmf/common.sh@297 -- # mlx=() 00:11:48.636 15:35:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:48.636 15:35:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:48.636 15:35:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:48.636 15:35:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:48.636 15:35:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:48.636 15:35:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:48.636 15:35:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:48.636 15:35:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:48.636 15:35:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:48.636 15:35:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:48.636 15:35:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:48.636 15:35:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:48.636 15:35:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:48.636 15:35:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:48.636 15:35:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:48.636 15:35:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:48.636 15:35:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:48.636 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:48.636 15:35:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:48.636 15:35:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:48.636 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:48.636 15:35:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:48.636 15:35:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:48.636 15:35:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:48.636 15:35:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:48.636 15:35:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:48.636 15:35:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:48.636 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:48.636 15:35:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:48.636 15:35:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:48.636 15:35:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:48.636 15:35:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:48.636 15:35:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:48.636 15:35:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:48.636 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:48.636 15:35:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:48.636 15:35:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:48.636 15:35:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:48.636 15:35:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:48.636 15:35:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:48.636 15:35:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:48.636 15:35:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:48.636 15:35:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:48.636 15:35:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:48.636 15:35:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:48.636 15:35:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:48.636 15:35:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:48.636 15:35:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:48.636 15:35:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:48.636 15:35:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:48.636 15:35:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:48.636 15:35:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:48.636 15:35:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:48.636 15:35:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:48.636 15:35:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:48.636 15:35:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:48.636 15:35:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:48.636 15:35:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:48.636 15:35:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:48.636 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:48.636 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.236 ms 00:11:48.636 00:11:48.636 --- 10.0.0.2 ping statistics --- 00:11:48.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:48.636 rtt min/avg/max/mdev = 0.236/0.236/0.236/0.000 ms 00:11:48.636 15:35:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:48.636 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:48.636 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:11:48.636 00:11:48.636 --- 10.0.0.1 ping statistics --- 00:11:48.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:48.636 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:11:48.636 15:35:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:48.636 15:35:39 -- nvmf/common.sh@410 -- # return 0 00:11:48.636 15:35:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:48.636 15:35:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:48.636 15:35:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:48.636 15:35:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:48.636 15:35:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:48.636 15:35:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:48.636 15:35:39 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:11:48.636 15:35:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:48.636 15:35:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:48.636 15:35:39 -- common/autotest_common.sh@10 -- # set +x 00:11:48.636 15:35:39 -- nvmf/common.sh@469 -- # nvmfpid=819726 00:11:48.637 15:35:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:48.637 15:35:39 -- nvmf/common.sh@470 -- # waitforlisten 819726 00:11:48.637 15:35:39 -- common/autotest_common.sh@829 -- # '[' -z 819726 ']' 00:11:48.637 15:35:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:48.637 15:35:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:48.637 15:35:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:48.637 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:48.637 15:35:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:48.637 15:35:39 -- common/autotest_common.sh@10 -- # set +x 00:11:48.637 [2024-11-26 15:35:39.756608] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:48.637 [2024-11-26 15:35:39.756682] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:48.637 EAL: No free 2048 kB hugepages reported on node 1 00:11:48.637 [2024-11-26 15:35:39.821620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:48.637 [2024-11-26 15:35:39.928835] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:48.637 [2024-11-26 15:35:39.928987] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:48.637 [2024-11-26 15:35:39.929012] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:48.637 [2024-11-26 15:35:39.929030] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:48.637 [2024-11-26 15:35:39.929089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:48.637 [2024-11-26 15:35:39.929146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:48.637 [2024-11-26 15:35:39.929213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:48.637 [2024-11-26 15:35:39.929222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:49.572 15:35:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:49.572 15:35:40 -- common/autotest_common.sh@862 -- # return 0 00:11:49.572 15:35:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:49.572 15:35:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:49.572 15:35:40 -- common/autotest_common.sh@10 -- # set +x 00:11:49.572 15:35:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:49.572 15:35:40 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:49.572 15:35:40 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode3555 00:11:49.830 [2024-11-26 15:35:41.101395] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:11:49.830 15:35:41 -- target/invalid.sh@40 -- # out='request: 00:11:49.830 { 00:11:49.830 "nqn": "nqn.2016-06.io.spdk:cnode3555", 00:11:49.830 "tgt_name": "foobar", 00:11:49.830 "method": "nvmf_create_subsystem", 00:11:49.830 "req_id": 1 00:11:49.830 } 00:11:49.830 Got JSON-RPC error response 00:11:49.830 response: 00:11:49.830 { 00:11:49.830 "code": -32603, 00:11:49.830 "message": "Unable to find target foobar" 00:11:49.830 }' 00:11:49.830 15:35:41 -- target/invalid.sh@41 -- # [[ request: 00:11:49.830 { 00:11:49.830 "nqn": "nqn.2016-06.io.spdk:cnode3555", 00:11:49.830 "tgt_name": "foobar", 00:11:49.830 "method": "nvmf_create_subsystem", 00:11:49.830 "req_id": 1 00:11:49.830 } 00:11:49.830 Got JSON-RPC error response 00:11:49.830 response: 00:11:49.830 { 00:11:49.830 "code": -32603, 00:11:49.830 "message": "Unable to find target foobar" 00:11:49.830 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:11:49.830 15:35:41 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:11:49.830 15:35:41 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode25070 00:11:50.088 [2024-11-26 15:35:41.362272] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25070: invalid serial number 'SPDKISFASTANDAWESOME' 00:11:50.088 15:35:41 -- target/invalid.sh@45 -- # out='request: 00:11:50.088 { 00:11:50.088 "nqn": "nqn.2016-06.io.spdk:cnode25070", 00:11:50.088 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:50.088 "method": "nvmf_create_subsystem", 00:11:50.088 "req_id": 1 00:11:50.088 } 00:11:50.088 Got JSON-RPC error response 00:11:50.088 response: 00:11:50.088 { 00:11:50.088 "code": -32602, 00:11:50.088 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:50.088 }' 00:11:50.088 15:35:41 -- target/invalid.sh@46 -- # [[ request: 00:11:50.088 { 00:11:50.088 "nqn": "nqn.2016-06.io.spdk:cnode25070", 00:11:50.088 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:50.088 "method": "nvmf_create_subsystem", 00:11:50.088 "req_id": 1 00:11:50.088 } 00:11:50.088 Got JSON-RPC error response 00:11:50.088 response: 00:11:50.088 { 00:11:50.088 "code": -32602, 00:11:50.088 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:50.088 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:50.088 15:35:41 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:11:50.088 15:35:41 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode22078 00:11:50.347 [2024-11-26 15:35:41.619081] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22078: invalid model number 'SPDK_Controller' 00:11:50.347 15:35:41 -- target/invalid.sh@50 -- # out='request: 00:11:50.347 { 00:11:50.347 "nqn": "nqn.2016-06.io.spdk:cnode22078", 00:11:50.348 "model_number": "SPDK_Controller\u001f", 00:11:50.348 "method": "nvmf_create_subsystem", 00:11:50.348 "req_id": 1 00:11:50.348 } 00:11:50.348 Got JSON-RPC error response 00:11:50.348 response: 00:11:50.348 { 00:11:50.348 "code": -32602, 00:11:50.348 "message": "Invalid MN SPDK_Controller\u001f" 00:11:50.348 }' 00:11:50.348 15:35:41 -- target/invalid.sh@51 -- # [[ request: 00:11:50.348 { 00:11:50.348 "nqn": "nqn.2016-06.io.spdk:cnode22078", 00:11:50.348 "model_number": "SPDK_Controller\u001f", 00:11:50.348 "method": "nvmf_create_subsystem", 00:11:50.348 "req_id": 1 00:11:50.348 } 00:11:50.348 Got JSON-RPC error response 00:11:50.348 response: 00:11:50.348 { 00:11:50.348 "code": -32602, 00:11:50.348 "message": "Invalid MN SPDK_Controller\u001f" 00:11:50.348 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:11:50.348 15:35:41 -- target/invalid.sh@54 -- # gen_random_s 21 00:11:50.348 15:35:41 -- target/invalid.sh@19 -- # local length=21 ll 00:11:50.348 15:35:41 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:50.348 15:35:41 -- target/invalid.sh@21 -- # local chars 00:11:50.348 15:35:41 -- target/invalid.sh@22 -- # local string 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 33 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x21' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+='!' 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 68 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x44' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=D 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 47 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=/ 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 88 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x58' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=X 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 34 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x22' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+='"' 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 44 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=, 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 111 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=o 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 86 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x56' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=V 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 84 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x54' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=T 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 74 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=J 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 106 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=j 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 125 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+='}' 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 119 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x77' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=w 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 40 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x28' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+='(' 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 98 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x62' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=b 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 101 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x65' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=e 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 68 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x44' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=D 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 94 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+='^' 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 81 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x51' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=Q 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 44 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+=, 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # printf %x 61 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:11:50.348 15:35:41 -- target/invalid.sh@25 -- # string+== 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.348 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.348 15:35:41 -- target/invalid.sh@28 -- # [[ ! == \- ]] 00:11:50.348 15:35:41 -- target/invalid.sh@31 -- # echo '!D/X",oVTJj}w(beD^Q,=' 00:11:50.348 15:35:41 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '!D/X",oVTJj}w(beD^Q,=' nqn.2016-06.io.spdk:cnode16507 00:11:50.607 [2024-11-26 15:35:41.952152] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16507: invalid serial number '!D/X",oVTJj}w(beD^Q,=' 00:11:50.607 15:35:41 -- target/invalid.sh@54 -- # out='request: 00:11:50.607 { 00:11:50.607 "nqn": "nqn.2016-06.io.spdk:cnode16507", 00:11:50.607 "serial_number": "!D/X\",oVTJj}w(beD^Q,=", 00:11:50.607 "method": "nvmf_create_subsystem", 00:11:50.607 "req_id": 1 00:11:50.607 } 00:11:50.607 Got JSON-RPC error response 00:11:50.607 response: 00:11:50.607 { 00:11:50.607 "code": -32602, 00:11:50.607 "message": "Invalid SN !D/X\",oVTJj}w(beD^Q,=" 00:11:50.607 }' 00:11:50.607 15:35:41 -- target/invalid.sh@55 -- # [[ request: 00:11:50.607 { 00:11:50.607 "nqn": "nqn.2016-06.io.spdk:cnode16507", 00:11:50.607 "serial_number": "!D/X\",oVTJj}w(beD^Q,=", 00:11:50.607 "method": "nvmf_create_subsystem", 00:11:50.607 "req_id": 1 00:11:50.607 } 00:11:50.607 Got JSON-RPC error response 00:11:50.607 response: 00:11:50.607 { 00:11:50.607 "code": -32602, 00:11:50.607 "message": "Invalid SN !D/X\",oVTJj}w(beD^Q,=" 00:11:50.607 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:50.607 15:35:41 -- target/invalid.sh@58 -- # gen_random_s 41 00:11:50.607 15:35:41 -- target/invalid.sh@19 -- # local length=41 ll 00:11:50.607 15:35:41 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:50.607 15:35:41 -- target/invalid.sh@21 -- # local chars 00:11:50.607 15:35:41 -- target/invalid.sh@22 -- # local string 00:11:50.607 15:35:41 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:50.607 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.607 15:35:41 -- target/invalid.sh@25 -- # printf %x 109 00:11:50.607 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:11:50.607 15:35:41 -- target/invalid.sh@25 -- # string+=m 00:11:50.607 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.607 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # printf %x 98 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x62' 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # string+=b 00:11:50.608 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # printf %x 35 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x23' 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # string+='#' 00:11:50.608 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # printf %x 110 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # string+=n 00:11:50.608 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # printf %x 127 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # string+=$'\177' 00:11:50.608 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # printf %x 126 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # string+='~' 00:11:50.608 15:35:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # printf %x 92 00:11:50.608 15:35:41 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+='\' 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 40 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x28' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+='(' 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 74 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+=J 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 54 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x36' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+=6 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 107 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+=k 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 82 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x52' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+=R 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 120 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x78' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+=x 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 91 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+='[' 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 77 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+=M 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 70 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x46' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+=F 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 65 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x41' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+=A 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 36 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x24' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+='$' 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 115 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x73' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+=s 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 124 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+='|' 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 63 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+='?' 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 122 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # string+=z 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.608 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.608 15:35:42 -- target/invalid.sh@25 -- # printf %x 96 00:11:50.866 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x60' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+='`' 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 108 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=l 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 119 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x77' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=w 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 42 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+='*' 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 105 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x69' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=i 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 82 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x52' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=R 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 95 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=_ 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 104 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x68' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=h 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 73 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x49' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=I 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 64 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x40' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=@ 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 108 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=l 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 92 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+='\' 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 82 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x52' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=R 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 72 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x48' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=H 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 87 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x57' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=W 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 51 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x33' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=3 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 32 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x20' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=' ' 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 61 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+== 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # printf %x 114 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # echo -e '\x72' 00:11:50.867 15:35:42 -- target/invalid.sh@25 -- # string+=r 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:50.867 15:35:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:50.867 15:35:42 -- target/invalid.sh@28 -- # [[ m == \- ]] 00:11:50.867 15:35:42 -- target/invalid.sh@31 -- # echo 'mb#n~\(J6kRx[MFA$s|?z`lw*iR_hI@l\RHW3 =r' 00:11:50.867 15:35:42 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'mb#n~\(J6kRx[MFA$s|?z`lw*iR_hI@l\RHW3 =r' nqn.2016-06.io.spdk:cnode10291 00:11:51.125 [2024-11-26 15:35:42.341406] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10291: invalid model number 'mb#n~\(J6kRx[MFA$s|?z`lw*iR_hI@l\RHW3 =r' 00:11:51.125 15:35:42 -- target/invalid.sh@58 -- # out='request: 00:11:51.125 { 00:11:51.125 "nqn": "nqn.2016-06.io.spdk:cnode10291", 00:11:51.125 "model_number": "mb#n\u007f~\\(J6kRx[MFA$s|?z`lw*iR_hI@l\\RHW3 =r", 00:11:51.125 "method": "nvmf_create_subsystem", 00:11:51.125 "req_id": 1 00:11:51.125 } 00:11:51.126 Got JSON-RPC error response 00:11:51.126 response: 00:11:51.126 { 00:11:51.126 "code": -32602, 00:11:51.126 "message": "Invalid MN mb#n\u007f~\\(J6kRx[MFA$s|?z`lw*iR_hI@l\\RHW3 =r" 00:11:51.126 }' 00:11:51.126 15:35:42 -- target/invalid.sh@59 -- # [[ request: 00:11:51.126 { 00:11:51.126 "nqn": "nqn.2016-06.io.spdk:cnode10291", 00:11:51.126 "model_number": "mb#n\u007f~\\(J6kRx[MFA$s|?z`lw*iR_hI@l\\RHW3 =r", 00:11:51.126 "method": "nvmf_create_subsystem", 00:11:51.126 "req_id": 1 00:11:51.126 } 00:11:51.126 Got JSON-RPC error response 00:11:51.126 response: 00:11:51.126 { 00:11:51.126 "code": -32602, 00:11:51.126 "message": "Invalid MN mb#n\u007f~\\(J6kRx[MFA$s|?z`lw*iR_hI@l\\RHW3 =r" 00:11:51.126 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:11:51.126 15:35:42 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:11:51.384 [2024-11-26 15:35:42.594343] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:51.384 15:35:42 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:11:51.642 15:35:42 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:11:51.642 15:35:42 -- target/invalid.sh@67 -- # echo '' 00:11:51.642 15:35:42 -- target/invalid.sh@67 -- # head -n 1 00:11:51.643 15:35:42 -- target/invalid.sh@67 -- # IP= 00:11:51.643 15:35:42 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:11:51.901 [2024-11-26 15:35:43.108132] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:11:51.901 15:35:43 -- target/invalid.sh@69 -- # out='request: 00:11:51.901 { 00:11:51.901 "nqn": "nqn.2016-06.io.spdk:cnode", 00:11:51.901 "listen_address": { 00:11:51.901 "trtype": "tcp", 00:11:51.901 "traddr": "", 00:11:51.901 "trsvcid": "4421" 00:11:51.901 }, 00:11:51.901 "method": "nvmf_subsystem_remove_listener", 00:11:51.901 "req_id": 1 00:11:51.901 } 00:11:51.901 Got JSON-RPC error response 00:11:51.901 response: 00:11:51.901 { 00:11:51.901 "code": -32602, 00:11:51.901 "message": "Invalid parameters" 00:11:51.901 }' 00:11:51.901 15:35:43 -- target/invalid.sh@70 -- # [[ request: 00:11:51.901 { 00:11:51.901 "nqn": "nqn.2016-06.io.spdk:cnode", 00:11:51.901 "listen_address": { 00:11:51.901 "trtype": "tcp", 00:11:51.901 "traddr": "", 00:11:51.901 "trsvcid": "4421" 00:11:51.901 }, 00:11:51.901 "method": "nvmf_subsystem_remove_listener", 00:11:51.901 "req_id": 1 00:11:51.901 } 00:11:51.901 Got JSON-RPC error response 00:11:51.901 response: 00:11:51.901 { 00:11:51.901 "code": -32602, 00:11:51.901 "message": "Invalid parameters" 00:11:51.901 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:11:51.901 15:35:43 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode30510 -i 0 00:11:52.159 [2024-11-26 15:35:43.364856] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode30510: invalid cntlid range [0-65519] 00:11:52.159 15:35:43 -- target/invalid.sh@73 -- # out='request: 00:11:52.159 { 00:11:52.159 "nqn": "nqn.2016-06.io.spdk:cnode30510", 00:11:52.159 "min_cntlid": 0, 00:11:52.159 "method": "nvmf_create_subsystem", 00:11:52.159 "req_id": 1 00:11:52.159 } 00:11:52.159 Got JSON-RPC error response 00:11:52.159 response: 00:11:52.159 { 00:11:52.159 "code": -32602, 00:11:52.159 "message": "Invalid cntlid range [0-65519]" 00:11:52.159 }' 00:11:52.159 15:35:43 -- target/invalid.sh@74 -- # [[ request: 00:11:52.159 { 00:11:52.159 "nqn": "nqn.2016-06.io.spdk:cnode30510", 00:11:52.159 "min_cntlid": 0, 00:11:52.159 "method": "nvmf_create_subsystem", 00:11:52.159 "req_id": 1 00:11:52.159 } 00:11:52.159 Got JSON-RPC error response 00:11:52.159 response: 00:11:52.159 { 00:11:52.159 "code": -32602, 00:11:52.159 "message": "Invalid cntlid range [0-65519]" 00:11:52.159 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:52.159 15:35:43 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode16579 -i 65520 00:11:52.418 [2024-11-26 15:35:43.609681] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16579: invalid cntlid range [65520-65519] 00:11:52.418 15:35:43 -- target/invalid.sh@75 -- # out='request: 00:11:52.418 { 00:11:52.418 "nqn": "nqn.2016-06.io.spdk:cnode16579", 00:11:52.418 "min_cntlid": 65520, 00:11:52.418 "method": "nvmf_create_subsystem", 00:11:52.418 "req_id": 1 00:11:52.418 } 00:11:52.418 Got JSON-RPC error response 00:11:52.418 response: 00:11:52.418 { 00:11:52.418 "code": -32602, 00:11:52.418 "message": "Invalid cntlid range [65520-65519]" 00:11:52.418 }' 00:11:52.418 15:35:43 -- target/invalid.sh@76 -- # [[ request: 00:11:52.418 { 00:11:52.418 "nqn": "nqn.2016-06.io.spdk:cnode16579", 00:11:52.418 "min_cntlid": 65520, 00:11:52.418 "method": "nvmf_create_subsystem", 00:11:52.418 "req_id": 1 00:11:52.418 } 00:11:52.418 Got JSON-RPC error response 00:11:52.418 response: 00:11:52.418 { 00:11:52.418 "code": -32602, 00:11:52.418 "message": "Invalid cntlid range [65520-65519]" 00:11:52.418 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:52.418 15:35:43 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode32102 -I 0 00:11:52.418 [2024-11-26 15:35:43.862541] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode32102: invalid cntlid range [1-0] 00:11:52.676 15:35:43 -- target/invalid.sh@77 -- # out='request: 00:11:52.676 { 00:11:52.676 "nqn": "nqn.2016-06.io.spdk:cnode32102", 00:11:52.676 "max_cntlid": 0, 00:11:52.676 "method": "nvmf_create_subsystem", 00:11:52.676 "req_id": 1 00:11:52.676 } 00:11:52.676 Got JSON-RPC error response 00:11:52.676 response: 00:11:52.676 { 00:11:52.676 "code": -32602, 00:11:52.676 "message": "Invalid cntlid range [1-0]" 00:11:52.676 }' 00:11:52.676 15:35:43 -- target/invalid.sh@78 -- # [[ request: 00:11:52.676 { 00:11:52.676 "nqn": "nqn.2016-06.io.spdk:cnode32102", 00:11:52.676 "max_cntlid": 0, 00:11:52.676 "method": "nvmf_create_subsystem", 00:11:52.676 "req_id": 1 00:11:52.676 } 00:11:52.676 Got JSON-RPC error response 00:11:52.676 response: 00:11:52.676 { 00:11:52.676 "code": -32602, 00:11:52.676 "message": "Invalid cntlid range [1-0]" 00:11:52.676 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:52.676 15:35:43 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode30567 -I 65520 00:11:52.676 [2024-11-26 15:35:44.111392] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode30567: invalid cntlid range [1-65520] 00:11:52.937 15:35:44 -- target/invalid.sh@79 -- # out='request: 00:11:52.937 { 00:11:52.937 "nqn": "nqn.2016-06.io.spdk:cnode30567", 00:11:52.937 "max_cntlid": 65520, 00:11:52.937 "method": "nvmf_create_subsystem", 00:11:52.937 "req_id": 1 00:11:52.937 } 00:11:52.937 Got JSON-RPC error response 00:11:52.937 response: 00:11:52.937 { 00:11:52.937 "code": -32602, 00:11:52.937 "message": "Invalid cntlid range [1-65520]" 00:11:52.937 }' 00:11:52.937 15:35:44 -- target/invalid.sh@80 -- # [[ request: 00:11:52.937 { 00:11:52.937 "nqn": "nqn.2016-06.io.spdk:cnode30567", 00:11:52.937 "max_cntlid": 65520, 00:11:52.937 "method": "nvmf_create_subsystem", 00:11:52.937 "req_id": 1 00:11:52.937 } 00:11:52.937 Got JSON-RPC error response 00:11:52.937 response: 00:11:52.937 { 00:11:52.937 "code": -32602, 00:11:52.937 "message": "Invalid cntlid range [1-65520]" 00:11:52.937 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:52.937 15:35:44 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3551 -i 6 -I 5 00:11:52.937 [2024-11-26 15:35:44.376327] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode3551: invalid cntlid range [6-5] 00:11:53.198 15:35:44 -- target/invalid.sh@83 -- # out='request: 00:11:53.198 { 00:11:53.198 "nqn": "nqn.2016-06.io.spdk:cnode3551", 00:11:53.198 "min_cntlid": 6, 00:11:53.198 "max_cntlid": 5, 00:11:53.198 "method": "nvmf_create_subsystem", 00:11:53.198 "req_id": 1 00:11:53.198 } 00:11:53.198 Got JSON-RPC error response 00:11:53.198 response: 00:11:53.198 { 00:11:53.198 "code": -32602, 00:11:53.198 "message": "Invalid cntlid range [6-5]" 00:11:53.198 }' 00:11:53.198 15:35:44 -- target/invalid.sh@84 -- # [[ request: 00:11:53.198 { 00:11:53.198 "nqn": "nqn.2016-06.io.spdk:cnode3551", 00:11:53.198 "min_cntlid": 6, 00:11:53.198 "max_cntlid": 5, 00:11:53.198 "method": "nvmf_create_subsystem", 00:11:53.198 "req_id": 1 00:11:53.198 } 00:11:53.198 Got JSON-RPC error response 00:11:53.198 response: 00:11:53.198 { 00:11:53.198 "code": -32602, 00:11:53.198 "message": "Invalid cntlid range [6-5]" 00:11:53.198 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:53.198 15:35:44 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:11:53.198 15:35:44 -- target/invalid.sh@87 -- # out='request: 00:11:53.198 { 00:11:53.198 "name": "foobar", 00:11:53.198 "method": "nvmf_delete_target", 00:11:53.198 "req_id": 1 00:11:53.198 } 00:11:53.198 Got JSON-RPC error response 00:11:53.198 response: 00:11:53.198 { 00:11:53.198 "code": -32602, 00:11:53.198 "message": "The specified target doesn'\''t exist, cannot delete it." 00:11:53.198 }' 00:11:53.198 15:35:44 -- target/invalid.sh@88 -- # [[ request: 00:11:53.198 { 00:11:53.198 "name": "foobar", 00:11:53.198 "method": "nvmf_delete_target", 00:11:53.198 "req_id": 1 00:11:53.198 } 00:11:53.198 Got JSON-RPC error response 00:11:53.198 response: 00:11:53.198 { 00:11:53.198 "code": -32602, 00:11:53.198 "message": "The specified target doesn't exist, cannot delete it." 00:11:53.198 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:11:53.198 15:35:44 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:11:53.198 15:35:44 -- target/invalid.sh@91 -- # nvmftestfini 00:11:53.198 15:35:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:53.198 15:35:44 -- nvmf/common.sh@116 -- # sync 00:11:53.198 15:35:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:53.198 15:35:44 -- nvmf/common.sh@119 -- # set +e 00:11:53.198 15:35:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:53.198 15:35:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:53.198 rmmod nvme_tcp 00:11:53.198 rmmod nvme_fabrics 00:11:53.198 rmmod nvme_keyring 00:11:53.198 15:35:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:53.198 15:35:44 -- nvmf/common.sh@123 -- # set -e 00:11:53.198 15:35:44 -- nvmf/common.sh@124 -- # return 0 00:11:53.198 15:35:44 -- nvmf/common.sh@477 -- # '[' -n 819726 ']' 00:11:53.198 15:35:44 -- nvmf/common.sh@478 -- # killprocess 819726 00:11:53.198 15:35:44 -- common/autotest_common.sh@936 -- # '[' -z 819726 ']' 00:11:53.198 15:35:44 -- common/autotest_common.sh@940 -- # kill -0 819726 00:11:53.198 15:35:44 -- common/autotest_common.sh@941 -- # uname 00:11:53.198 15:35:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:53.198 15:35:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 819726 00:11:53.198 15:35:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:53.198 15:35:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:53.198 15:35:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 819726' 00:11:53.198 killing process with pid 819726 00:11:53.198 15:35:44 -- common/autotest_common.sh@955 -- # kill 819726 00:11:53.198 15:35:44 -- common/autotest_common.sh@960 -- # wait 819726 00:11:53.457 15:35:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:53.457 15:35:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:53.457 15:35:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:53.457 15:35:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:53.457 15:35:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:53.457 15:35:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:53.457 15:35:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:53.457 15:35:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:55.999 15:35:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:55.999 00:11:55.999 real 0m9.630s 00:11:55.999 user 0m23.713s 00:11:55.999 sys 0m2.498s 00:11:55.999 15:35:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:55.999 15:35:46 -- common/autotest_common.sh@10 -- # set +x 00:11:55.999 ************************************ 00:11:55.999 END TEST nvmf_invalid 00:11:55.999 ************************************ 00:11:55.999 15:35:46 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:11:55.999 15:35:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:55.999 15:35:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:55.999 15:35:46 -- common/autotest_common.sh@10 -- # set +x 00:11:55.999 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:11:55.999 ************************************ 00:11:55.999 START TEST nvmf_abort 00:11:55.999 ************************************ 00:11:55.999 15:35:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:11:55.999 * Looking for test storage... 00:11:55.999 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:55.999 15:35:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:55.999 15:35:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:55.999 15:35:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:55.999 15:35:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:55.999 15:35:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:55.999 15:35:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:55.999 15:35:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:55.999 15:35:47 -- scripts/common.sh@335 -- # IFS=.-: 00:11:55.999 15:35:47 -- scripts/common.sh@335 -- # read -ra ver1 00:11:55.999 15:35:47 -- scripts/common.sh@336 -- # IFS=.-: 00:11:55.999 15:35:47 -- scripts/common.sh@336 -- # read -ra ver2 00:11:55.999 15:35:47 -- scripts/common.sh@337 -- # local 'op=<' 00:11:55.999 15:35:47 -- scripts/common.sh@339 -- # ver1_l=2 00:11:55.999 15:35:47 -- scripts/common.sh@340 -- # ver2_l=1 00:11:55.999 15:35:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:55.999 15:35:47 -- scripts/common.sh@343 -- # case "$op" in 00:11:55.999 15:35:47 -- scripts/common.sh@344 -- # : 1 00:11:55.999 15:35:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:55.999 15:35:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:55.999 15:35:47 -- scripts/common.sh@364 -- # decimal 1 00:11:55.999 15:35:47 -- scripts/common.sh@352 -- # local d=1 00:11:55.999 15:35:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:55.999 15:35:47 -- scripts/common.sh@354 -- # echo 1 00:11:55.999 15:35:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:55.999 15:35:47 -- scripts/common.sh@365 -- # decimal 2 00:11:55.999 15:35:47 -- scripts/common.sh@352 -- # local d=2 00:11:55.999 15:35:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:55.999 15:35:47 -- scripts/common.sh@354 -- # echo 2 00:11:55.999 15:35:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:55.999 15:35:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:55.999 15:35:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:55.999 15:35:47 -- scripts/common.sh@367 -- # return 0 00:11:55.999 15:35:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:55.999 15:35:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:55.999 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:55.999 --rc genhtml_branch_coverage=1 00:11:55.999 --rc genhtml_function_coverage=1 00:11:55.999 --rc genhtml_legend=1 00:11:55.999 --rc geninfo_all_blocks=1 00:11:55.999 --rc geninfo_unexecuted_blocks=1 00:11:55.999 00:11:55.999 ' 00:11:55.999 15:35:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:55.999 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:55.999 --rc genhtml_branch_coverage=1 00:11:55.999 --rc genhtml_function_coverage=1 00:11:55.999 --rc genhtml_legend=1 00:11:55.999 --rc geninfo_all_blocks=1 00:11:55.999 --rc geninfo_unexecuted_blocks=1 00:11:55.999 00:11:55.999 ' 00:11:55.999 15:35:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:55.999 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:55.999 --rc genhtml_branch_coverage=1 00:11:55.999 --rc genhtml_function_coverage=1 00:11:56.000 --rc genhtml_legend=1 00:11:56.000 --rc geninfo_all_blocks=1 00:11:56.000 --rc geninfo_unexecuted_blocks=1 00:11:56.000 00:11:56.000 ' 00:11:56.000 15:35:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:56.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:56.000 --rc genhtml_branch_coverage=1 00:11:56.000 --rc genhtml_function_coverage=1 00:11:56.000 --rc genhtml_legend=1 00:11:56.000 --rc geninfo_all_blocks=1 00:11:56.000 --rc geninfo_unexecuted_blocks=1 00:11:56.000 00:11:56.000 ' 00:11:56.000 15:35:47 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:56.000 15:35:47 -- nvmf/common.sh@7 -- # uname -s 00:11:56.000 15:35:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:56.000 15:35:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:56.000 15:35:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:56.000 15:35:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:56.000 15:35:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:56.000 15:35:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:56.000 15:35:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:56.000 15:35:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:56.000 15:35:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:56.000 15:35:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:56.000 15:35:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:56.000 15:35:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:56.000 15:35:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:56.000 15:35:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:56.000 15:35:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:56.000 15:35:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:56.000 15:35:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:56.000 15:35:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:56.000 15:35:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:56.000 15:35:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.000 15:35:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.000 15:35:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.000 15:35:47 -- paths/export.sh@5 -- # export PATH 00:11:56.000 15:35:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.000 15:35:47 -- nvmf/common.sh@46 -- # : 0 00:11:56.000 15:35:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:56.000 15:35:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:56.000 15:35:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:56.000 15:35:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:56.000 15:35:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:56.000 15:35:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:56.000 15:35:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:56.000 15:35:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:56.000 15:35:47 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:56.000 15:35:47 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:11:56.000 15:35:47 -- target/abort.sh@14 -- # nvmftestinit 00:11:56.000 15:35:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:56.000 15:35:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:56.000 15:35:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:56.000 15:35:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:56.000 15:35:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:56.000 15:35:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:56.000 15:35:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:56.000 15:35:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:56.000 15:35:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:56.000 15:35:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:56.000 15:35:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:56.000 15:35:47 -- common/autotest_common.sh@10 -- # set +x 00:11:57.908 15:35:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:57.908 15:35:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:57.908 15:35:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:57.908 15:35:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:57.908 15:35:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:57.908 15:35:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:57.908 15:35:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:57.908 15:35:49 -- nvmf/common.sh@294 -- # net_devs=() 00:11:57.908 15:35:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:57.908 15:35:49 -- nvmf/common.sh@295 -- # e810=() 00:11:57.908 15:35:49 -- nvmf/common.sh@295 -- # local -ga e810 00:11:57.908 15:35:49 -- nvmf/common.sh@296 -- # x722=() 00:11:57.908 15:35:49 -- nvmf/common.sh@296 -- # local -ga x722 00:11:57.908 15:35:49 -- nvmf/common.sh@297 -- # mlx=() 00:11:57.908 15:35:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:57.908 15:35:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:57.908 15:35:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:57.908 15:35:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:57.908 15:35:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:57.908 15:35:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:57.908 15:35:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:57.908 15:35:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:57.908 15:35:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:57.908 15:35:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:57.908 15:35:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:57.908 15:35:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:57.908 15:35:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:57.908 15:35:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:57.908 15:35:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:57.908 15:35:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:57.908 15:35:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:57.908 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:57.908 15:35:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:57.908 15:35:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:57.908 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:57.908 15:35:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:57.908 15:35:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:57.908 15:35:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:57.908 15:35:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:57.908 15:35:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:57.908 15:35:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:57.908 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:57.908 15:35:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:57.908 15:35:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:57.908 15:35:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:57.908 15:35:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:57.908 15:35:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:57.908 15:35:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:57.908 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:57.908 15:35:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:57.908 15:35:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:57.908 15:35:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:57.908 15:35:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:57.908 15:35:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:57.908 15:35:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:57.908 15:35:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:57.908 15:35:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:57.908 15:35:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:57.908 15:35:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:57.908 15:35:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:57.908 15:35:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:57.909 15:35:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:57.909 15:35:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:57.909 15:35:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:57.909 15:35:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:57.909 15:35:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:57.909 15:35:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:57.909 15:35:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:57.909 15:35:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:57.909 15:35:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:57.909 15:35:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:57.909 15:35:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:57.909 15:35:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:57.909 15:35:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:57.909 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:57.909 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.284 ms 00:11:57.909 00:11:57.909 --- 10.0.0.2 ping statistics --- 00:11:57.909 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:57.909 rtt min/avg/max/mdev = 0.284/0.284/0.284/0.000 ms 00:11:57.909 15:35:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:57.909 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:57.909 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.167 ms 00:11:57.909 00:11:57.909 --- 10.0.0.1 ping statistics --- 00:11:57.909 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:57.909 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:11:57.909 15:35:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:57.909 15:35:49 -- nvmf/common.sh@410 -- # return 0 00:11:57.909 15:35:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:57.909 15:35:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:57.909 15:35:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:57.909 15:35:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:57.909 15:35:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:57.909 15:35:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:57.909 15:35:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:57.909 15:35:49 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:11:57.909 15:35:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:57.909 15:35:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:57.909 15:35:49 -- common/autotest_common.sh@10 -- # set +x 00:11:57.909 15:35:49 -- nvmf/common.sh@469 -- # nvmfpid=822464 00:11:57.909 15:35:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:11:57.909 15:35:49 -- nvmf/common.sh@470 -- # waitforlisten 822464 00:11:57.909 15:35:49 -- common/autotest_common.sh@829 -- # '[' -z 822464 ']' 00:11:57.909 15:35:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:57.909 15:35:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:57.909 15:35:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:57.909 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:57.909 15:35:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:57.909 15:35:49 -- common/autotest_common.sh@10 -- # set +x 00:11:58.173 [2024-11-26 15:35:49.362681] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:58.173 [2024-11-26 15:35:49.362772] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:58.173 EAL: No free 2048 kB hugepages reported on node 1 00:11:58.173 [2024-11-26 15:35:49.430403] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:11:58.173 [2024-11-26 15:35:49.538452] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:58.173 [2024-11-26 15:35:49.538598] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:58.173 [2024-11-26 15:35:49.538615] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:58.173 [2024-11-26 15:35:49.538627] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:58.173 [2024-11-26 15:35:49.538714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:58.173 [2024-11-26 15:35:49.538777] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:58.173 [2024-11-26 15:35:49.538781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:59.111 15:35:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:59.111 15:35:50 -- common/autotest_common.sh@862 -- # return 0 00:11:59.111 15:35:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:59.111 15:35:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:59.111 15:35:50 -- common/autotest_common.sh@10 -- # set +x 00:11:59.111 15:35:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:59.111 15:35:50 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:11:59.111 15:35:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.111 15:35:50 -- common/autotest_common.sh@10 -- # set +x 00:11:59.111 [2024-11-26 15:35:50.416601] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:59.111 15:35:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.111 15:35:50 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:11:59.111 15:35:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.111 15:35:50 -- common/autotest_common.sh@10 -- # set +x 00:11:59.111 Malloc0 00:11:59.111 15:35:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.111 15:35:50 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:11:59.111 15:35:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.111 15:35:50 -- common/autotest_common.sh@10 -- # set +x 00:11:59.111 Delay0 00:11:59.111 15:35:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.111 15:35:50 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:11:59.111 15:35:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.111 15:35:50 -- common/autotest_common.sh@10 -- # set +x 00:11:59.111 15:35:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.111 15:35:50 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:11:59.111 15:35:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.111 15:35:50 -- common/autotest_common.sh@10 -- # set +x 00:11:59.111 15:35:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.111 15:35:50 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:11:59.111 15:35:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.111 15:35:50 -- common/autotest_common.sh@10 -- # set +x 00:11:59.111 [2024-11-26 15:35:50.484719] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:59.111 15:35:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.111 15:35:50 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:11:59.111 15:35:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.111 15:35:50 -- common/autotest_common.sh@10 -- # set +x 00:11:59.111 15:35:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.111 15:35:50 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:11:59.112 EAL: No free 2048 kB hugepages reported on node 1 00:11:59.392 [2024-11-26 15:35:50.589678] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:01.926 Initializing NVMe Controllers 00:12:01.926 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:01.926 controller IO queue size 128 less than required 00:12:01.926 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:01.926 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:01.926 Initialization complete. Launching workers. 00:12:01.926 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 33286 00:12:01.926 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33347, failed to submit 62 00:12:01.926 success 33286, unsuccess 61, failed 0 00:12:01.926 15:35:52 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:01.926 15:35:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.926 15:35:52 -- common/autotest_common.sh@10 -- # set +x 00:12:01.926 15:35:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.926 15:35:52 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:01.926 15:35:52 -- target/abort.sh@38 -- # nvmftestfini 00:12:01.926 15:35:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:01.926 15:35:52 -- nvmf/common.sh@116 -- # sync 00:12:01.926 15:35:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:01.926 15:35:52 -- nvmf/common.sh@119 -- # set +e 00:12:01.926 15:35:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:01.926 15:35:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:01.926 rmmod nvme_tcp 00:12:01.926 rmmod nvme_fabrics 00:12:01.926 rmmod nvme_keyring 00:12:01.926 15:35:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:01.926 15:35:52 -- nvmf/common.sh@123 -- # set -e 00:12:01.926 15:35:52 -- nvmf/common.sh@124 -- # return 0 00:12:01.926 15:35:52 -- nvmf/common.sh@477 -- # '[' -n 822464 ']' 00:12:01.926 15:35:52 -- nvmf/common.sh@478 -- # killprocess 822464 00:12:01.926 15:35:52 -- common/autotest_common.sh@936 -- # '[' -z 822464 ']' 00:12:01.926 15:35:52 -- common/autotest_common.sh@940 -- # kill -0 822464 00:12:01.926 15:35:52 -- common/autotest_common.sh@941 -- # uname 00:12:01.926 15:35:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:01.926 15:35:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 822464 00:12:01.926 15:35:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:01.926 15:35:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:01.926 15:35:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 822464' 00:12:01.926 killing process with pid 822464 00:12:01.926 15:35:52 -- common/autotest_common.sh@955 -- # kill 822464 00:12:01.926 15:35:52 -- common/autotest_common.sh@960 -- # wait 822464 00:12:01.926 15:35:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:01.926 15:35:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:01.927 15:35:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:01.927 15:35:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:01.927 15:35:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:01.927 15:35:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:01.927 15:35:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:01.927 15:35:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:03.833 15:35:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:03.833 00:12:03.833 real 0m8.257s 00:12:03.833 user 0m13.264s 00:12:03.833 sys 0m2.694s 00:12:03.833 15:35:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:03.833 15:35:55 -- common/autotest_common.sh@10 -- # set +x 00:12:03.833 ************************************ 00:12:03.833 END TEST nvmf_abort 00:12:03.833 ************************************ 00:12:03.833 15:35:55 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:03.833 15:35:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:03.833 15:35:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:03.833 15:35:55 -- common/autotest_common.sh@10 -- # set +x 00:12:03.833 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:12:03.833 ************************************ 00:12:03.833 START TEST nvmf_ns_hotplug_stress 00:12:03.833 ************************************ 00:12:03.833 15:35:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:03.833 * Looking for test storage... 00:12:03.833 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:03.833 15:35:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:03.833 15:35:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:03.833 15:35:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:04.092 15:35:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:04.092 15:35:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:04.092 15:35:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:04.092 15:35:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:04.092 15:35:55 -- scripts/common.sh@335 -- # IFS=.-: 00:12:04.092 15:35:55 -- scripts/common.sh@335 -- # read -ra ver1 00:12:04.092 15:35:55 -- scripts/common.sh@336 -- # IFS=.-: 00:12:04.092 15:35:55 -- scripts/common.sh@336 -- # read -ra ver2 00:12:04.092 15:35:55 -- scripts/common.sh@337 -- # local 'op=<' 00:12:04.092 15:35:55 -- scripts/common.sh@339 -- # ver1_l=2 00:12:04.092 15:35:55 -- scripts/common.sh@340 -- # ver2_l=1 00:12:04.092 15:35:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:04.092 15:35:55 -- scripts/common.sh@343 -- # case "$op" in 00:12:04.092 15:35:55 -- scripts/common.sh@344 -- # : 1 00:12:04.092 15:35:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:04.092 15:35:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:04.092 15:35:55 -- scripts/common.sh@364 -- # decimal 1 00:12:04.092 15:35:55 -- scripts/common.sh@352 -- # local d=1 00:12:04.092 15:35:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:04.092 15:35:55 -- scripts/common.sh@354 -- # echo 1 00:12:04.092 15:35:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:04.092 15:35:55 -- scripts/common.sh@365 -- # decimal 2 00:12:04.092 15:35:55 -- scripts/common.sh@352 -- # local d=2 00:12:04.092 15:35:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:04.092 15:35:55 -- scripts/common.sh@354 -- # echo 2 00:12:04.092 15:35:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:04.092 15:35:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:04.092 15:35:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:04.092 15:35:55 -- scripts/common.sh@367 -- # return 0 00:12:04.092 15:35:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:04.092 15:35:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:04.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:04.092 --rc genhtml_branch_coverage=1 00:12:04.092 --rc genhtml_function_coverage=1 00:12:04.092 --rc genhtml_legend=1 00:12:04.092 --rc geninfo_all_blocks=1 00:12:04.092 --rc geninfo_unexecuted_blocks=1 00:12:04.092 00:12:04.092 ' 00:12:04.092 15:35:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:04.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:04.092 --rc genhtml_branch_coverage=1 00:12:04.092 --rc genhtml_function_coverage=1 00:12:04.092 --rc genhtml_legend=1 00:12:04.092 --rc geninfo_all_blocks=1 00:12:04.092 --rc geninfo_unexecuted_blocks=1 00:12:04.092 00:12:04.092 ' 00:12:04.092 15:35:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:04.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:04.092 --rc genhtml_branch_coverage=1 00:12:04.092 --rc genhtml_function_coverage=1 00:12:04.092 --rc genhtml_legend=1 00:12:04.092 --rc geninfo_all_blocks=1 00:12:04.092 --rc geninfo_unexecuted_blocks=1 00:12:04.092 00:12:04.092 ' 00:12:04.092 15:35:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:04.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:04.092 --rc genhtml_branch_coverage=1 00:12:04.092 --rc genhtml_function_coverage=1 00:12:04.092 --rc genhtml_legend=1 00:12:04.092 --rc geninfo_all_blocks=1 00:12:04.092 --rc geninfo_unexecuted_blocks=1 00:12:04.092 00:12:04.092 ' 00:12:04.092 15:35:55 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:04.092 15:35:55 -- nvmf/common.sh@7 -- # uname -s 00:12:04.092 15:35:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:04.092 15:35:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:04.092 15:35:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:04.092 15:35:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:04.092 15:35:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:04.092 15:35:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:04.092 15:35:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:04.092 15:35:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:04.092 15:35:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:04.092 15:35:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:04.092 15:35:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:04.092 15:35:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:04.092 15:35:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:04.092 15:35:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:04.092 15:35:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:04.092 15:35:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:04.092 15:35:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:04.092 15:35:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:04.092 15:35:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:04.092 15:35:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:04.092 15:35:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:04.092 15:35:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:04.092 15:35:55 -- paths/export.sh@5 -- # export PATH 00:12:04.093 15:35:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:04.093 15:35:55 -- nvmf/common.sh@46 -- # : 0 00:12:04.093 15:35:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:04.093 15:35:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:04.093 15:35:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:04.093 15:35:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:04.093 15:35:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:04.093 15:35:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:04.093 15:35:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:04.093 15:35:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:04.093 15:35:55 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:04.093 15:35:55 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:04.093 15:35:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:04.093 15:35:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:04.093 15:35:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:04.093 15:35:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:04.093 15:35:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:04.093 15:35:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:04.093 15:35:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:04.093 15:35:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:04.093 15:35:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:04.093 15:35:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:04.093 15:35:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:04.093 15:35:55 -- common/autotest_common.sh@10 -- # set +x 00:12:06.002 15:35:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:06.002 15:35:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:06.002 15:35:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:06.002 15:35:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:06.002 15:35:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:06.002 15:35:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:06.002 15:35:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:06.002 15:35:57 -- nvmf/common.sh@294 -- # net_devs=() 00:12:06.002 15:35:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:06.002 15:35:57 -- nvmf/common.sh@295 -- # e810=() 00:12:06.002 15:35:57 -- nvmf/common.sh@295 -- # local -ga e810 00:12:06.002 15:35:57 -- nvmf/common.sh@296 -- # x722=() 00:12:06.002 15:35:57 -- nvmf/common.sh@296 -- # local -ga x722 00:12:06.002 15:35:57 -- nvmf/common.sh@297 -- # mlx=() 00:12:06.002 15:35:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:06.002 15:35:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:06.002 15:35:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:06.002 15:35:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:06.002 15:35:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:06.002 15:35:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:06.002 15:35:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:06.002 15:35:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:06.002 15:35:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:06.002 15:35:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:06.002 15:35:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:06.002 15:35:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:06.002 15:35:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:06.002 15:35:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:06.002 15:35:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:06.002 15:35:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:06.002 15:35:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:06.002 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:06.002 15:35:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:06.002 15:35:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:06.002 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:06.002 15:35:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:06.002 15:35:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:06.002 15:35:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:06.002 15:35:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:06.002 15:35:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:06.002 15:35:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:06.002 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:06.002 15:35:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:06.002 15:35:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:06.002 15:35:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:06.002 15:35:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:06.002 15:35:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:06.002 15:35:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:06.002 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:06.002 15:35:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:06.002 15:35:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:06.002 15:35:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:06.002 15:35:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:06.002 15:35:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:06.002 15:35:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:06.002 15:35:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:06.002 15:35:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:06.002 15:35:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:06.002 15:35:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:06.002 15:35:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:06.002 15:35:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:06.002 15:35:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:06.002 15:35:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:06.002 15:35:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:06.002 15:35:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:06.002 15:35:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:06.002 15:35:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:06.262 15:35:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:06.262 15:35:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:06.262 15:35:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:06.262 15:35:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:06.262 15:35:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:06.262 15:35:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:06.262 15:35:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:06.262 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:06.262 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:12:06.262 00:12:06.262 --- 10.0.0.2 ping statistics --- 00:12:06.262 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:06.262 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:12:06.262 15:35:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:06.262 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:06.262 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.060 ms 00:12:06.262 00:12:06.262 --- 10.0.0.1 ping statistics --- 00:12:06.262 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:06.262 rtt min/avg/max/mdev = 0.060/0.060/0.060/0.000 ms 00:12:06.262 15:35:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:06.262 15:35:57 -- nvmf/common.sh@410 -- # return 0 00:12:06.262 15:35:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:06.262 15:35:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:06.262 15:35:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:06.262 15:35:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:06.262 15:35:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:06.262 15:35:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:06.262 15:35:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:06.262 15:35:57 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:06.262 15:35:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:06.262 15:35:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:06.262 15:35:57 -- common/autotest_common.sh@10 -- # set +x 00:12:06.262 15:35:57 -- nvmf/common.sh@469 -- # nvmfpid=824802 00:12:06.262 15:35:57 -- nvmf/common.sh@470 -- # waitforlisten 824802 00:12:06.262 15:35:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:06.262 15:35:57 -- common/autotest_common.sh@829 -- # '[' -z 824802 ']' 00:12:06.262 15:35:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:06.262 15:35:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:06.262 15:35:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:06.262 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:06.262 15:35:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:06.262 15:35:57 -- common/autotest_common.sh@10 -- # set +x 00:12:06.262 [2024-11-26 15:35:57.666007] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:06.262 [2024-11-26 15:35:57.666082] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:06.262 EAL: No free 2048 kB hugepages reported on node 1 00:12:06.521 [2024-11-26 15:35:57.741738] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:06.521 [2024-11-26 15:35:57.863977] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:06.521 [2024-11-26 15:35:57.864135] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:06.521 [2024-11-26 15:35:57.864154] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:06.521 [2024-11-26 15:35:57.864168] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:06.521 [2024-11-26 15:35:57.864253] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:06.521 [2024-11-26 15:35:57.864316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:06.521 [2024-11-26 15:35:57.864313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:07.458 15:35:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:07.458 15:35:58 -- common/autotest_common.sh@862 -- # return 0 00:12:07.458 15:35:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:07.458 15:35:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:07.458 15:35:58 -- common/autotest_common.sh@10 -- # set +x 00:12:07.458 15:35:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:07.458 15:35:58 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:07.458 15:35:58 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:07.716 [2024-11-26 15:35:58.958907] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:07.716 15:35:58 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:07.974 15:35:59 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:08.232 [2024-11-26 15:35:59.477868] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:08.232 15:35:59 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:08.490 15:35:59 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:08.749 Malloc0 00:12:08.749 15:36:00 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:09.007 Delay0 00:12:09.007 15:36:00 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:09.265 15:36:00 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:09.525 NULL1 00:12:09.525 15:36:00 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:09.839 15:36:01 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=825298 00:12:09.840 15:36:01 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:09.840 15:36:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:09.840 15:36:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:09.840 EAL: No free 2048 kB hugepages reported on node 1 00:12:10.805 Read completed with error (sct=0, sc=11) 00:12:10.805 15:36:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:10.805 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:11.064 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:11.064 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:11.064 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:11.064 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:11.064 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:11.064 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:11.064 15:36:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:11.064 15:36:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:11.323 true 00:12:11.323 15:36:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:11.323 15:36:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:12.260 15:36:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:12.518 15:36:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:12.518 15:36:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:12.777 true 00:12:12.777 15:36:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:12.777 15:36:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:13.036 15:36:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:13.294 15:36:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:13.294 15:36:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:13.552 true 00:12:13.552 15:36:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:13.552 15:36:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:13.811 15:36:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:14.068 15:36:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:14.069 15:36:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:14.326 true 00:12:14.326 15:36:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:14.326 15:36:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:15.262 15:36:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:15.520 15:36:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:15.520 15:36:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:15.778 true 00:12:15.778 15:36:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:15.778 15:36:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:16.036 15:36:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:16.294 15:36:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:16.294 15:36:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:16.552 true 00:12:16.552 15:36:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:16.552 15:36:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:16.810 15:36:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:17.068 15:36:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:17.068 15:36:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:17.326 true 00:12:17.326 15:36:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:17.326 15:36:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:18.261 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:18.261 15:36:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:18.519 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:18.519 15:36:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:18.519 15:36:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:18.776 true 00:12:19.033 15:36:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:19.033 15:36:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.292 15:36:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:19.551 15:36:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:19.551 15:36:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:19.551 true 00:12:19.551 15:36:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:19.551 15:36:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:20.507 15:36:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:20.507 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:20.764 15:36:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:20.764 15:36:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:21.022 true 00:12:21.022 15:36:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:21.022 15:36:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.280 15:36:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:21.537 15:36:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:21.537 15:36:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:21.794 true 00:12:21.794 15:36:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:21.794 15:36:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.729 15:36:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:22.729 15:36:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:22.729 15:36:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:22.987 true 00:12:22.987 15:36:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:22.987 15:36:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:23.245 15:36:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:23.504 15:36:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:23.504 15:36:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:23.762 true 00:12:23.762 15:36:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:23.762 15:36:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:24.019 15:36:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:24.277 15:36:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:24.277 15:36:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:24.536 true 00:12:24.536 15:36:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:24.536 15:36:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:25.917 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:25.917 15:36:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:25.917 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:25.917 15:36:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:25.917 15:36:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:26.175 true 00:12:26.175 15:36:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:26.175 15:36:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:26.433 15:36:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:26.691 15:36:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:26.691 15:36:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:26.949 true 00:12:26.949 15:36:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:26.949 15:36:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:27.893 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:27.893 15:36:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:27.893 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:27.893 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:27.893 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:28.159 15:36:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:28.159 15:36:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:28.417 true 00:12:28.417 15:36:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:28.417 15:36:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:28.675 15:36:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:28.932 15:36:20 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:12:28.932 15:36:20 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:12:29.190 true 00:12:29.190 15:36:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:29.190 15:36:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:30.126 15:36:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:30.383 15:36:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:12:30.384 15:36:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:12:30.641 true 00:12:30.641 15:36:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:30.641 15:36:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:30.899 15:36:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:31.156 15:36:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:12:31.156 15:36:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:31.414 true 00:12:31.414 15:36:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:31.414 15:36:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:32.352 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:32.352 15:36:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:32.352 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:32.352 15:36:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:12:32.352 15:36:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:12:32.610 true 00:12:32.610 15:36:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:32.610 15:36:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:32.868 15:36:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:33.125 15:36:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:12:33.126 15:36:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:12:33.384 true 00:12:33.384 15:36:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:33.384 15:36:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:34.318 15:36:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:34.318 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:34.582 15:36:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:12:34.582 15:36:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:12:34.582 true 00:12:34.873 15:36:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:34.873 15:36:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:34.873 15:36:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:35.154 15:36:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:12:35.154 15:36:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:12:35.412 true 00:12:35.412 15:36:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:35.412 15:36:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.348 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:36.348 15:36:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:36.348 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:36.606 15:36:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:12:36.606 15:36:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:12:36.864 true 00:12:36.864 15:36:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:36.864 15:36:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:37.122 15:36:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:37.380 15:36:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:12:37.380 15:36:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:12:37.638 true 00:12:37.638 15:36:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:37.638 15:36:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:38.572 15:36:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:38.572 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:38.572 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:38.572 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:38.831 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:38.831 15:36:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:12:38.831 15:36:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:12:39.089 true 00:12:39.089 15:36:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:39.089 15:36:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:39.347 15:36:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:39.605 15:36:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:12:39.605 15:36:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:12:39.865 true 00:12:39.865 15:36:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:39.865 15:36:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:40.802 Initializing NVMe Controllers 00:12:40.802 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:12:40.802 Controller IO queue size 128, less than required. 00:12:40.802 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:40.802 Controller IO queue size 128, less than required. 00:12:40.802 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:40.802 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:12:40.802 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:12:40.802 Initialization complete. Launching workers. 00:12:40.802 ======================================================== 00:12:40.802 Latency(us) 00:12:40.802 Device Information : IOPS MiB/s Average min max 00:12:40.802 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 900.80 0.44 74399.99 2767.78 1082488.65 00:12:40.802 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11394.93 5.56 11232.56 2047.59 364170.19 00:12:40.802 ======================================================== 00:12:40.802 Total : 12295.73 6.00 15860.28 2047.59 1082488.65 00:12:40.802 00:12:40.802 15:36:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.060 15:36:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:12:41.060 15:36:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:12:41.318 true 00:12:41.318 15:36:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 825298 00:12:41.318 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (825298) - No such process 00:12:41.318 15:36:32 -- target/ns_hotplug_stress.sh@53 -- # wait 825298 00:12:41.319 15:36:32 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:41.577 15:36:32 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:41.835 15:36:33 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:12:41.835 15:36:33 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:12:41.835 15:36:33 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:12:41.835 15:36:33 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:41.835 15:36:33 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:12:42.093 null0 00:12:42.093 15:36:33 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:42.093 15:36:33 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:42.093 15:36:33 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:12:42.350 null1 00:12:42.350 15:36:33 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:42.350 15:36:33 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:42.350 15:36:33 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:12:42.608 null2 00:12:42.608 15:36:33 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:42.608 15:36:33 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:42.608 15:36:33 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:12:42.866 null3 00:12:42.866 15:36:34 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:42.866 15:36:34 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:42.866 15:36:34 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:12:43.124 null4 00:12:43.124 15:36:34 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:43.124 15:36:34 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:43.124 15:36:34 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:12:43.382 null5 00:12:43.382 15:36:34 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:43.382 15:36:34 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:43.382 15:36:34 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:12:43.639 null6 00:12:43.640 15:36:34 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:43.640 15:36:34 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:43.640 15:36:34 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:12:43.898 null7 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:43.898 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@66 -- # wait 829929 829930 829932 829934 829936 829938 829940 829942 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:43.899 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:44.158 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:44.158 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:44.158 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:44.158 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.158 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:44.158 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:44.158 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:44.158 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.417 15:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:44.675 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:44.675 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.675 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:44.675 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:44.675 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:44.675 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:44.675 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:44.675 15:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:44.933 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:45.191 15:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:45.191 15:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:45.191 15:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.191 15:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:45.191 15:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:45.191 15:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:45.191 15:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:45.191 15:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.450 15:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:45.708 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.708 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:45.708 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:45.708 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:45.708 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:45.708 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:45.708 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:45.708 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.966 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:46.224 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:46.224 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.224 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:46.224 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:46.224 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:46.482 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:46.482 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:46.482 15:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.740 15:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:46.999 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.999 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:46.999 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:46.999 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:46.999 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:46.999 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:46.999 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:46.999 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.258 15:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:47.517 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.517 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:47.517 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:47.517 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:47.517 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:47.517 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:47.517 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:47.517 15:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.775 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:48.033 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:48.033 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.033 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:48.033 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:48.033 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:48.033 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:48.033 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:48.033 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.291 15:36:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:48.550 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.550 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:48.550 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:48.550 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:48.550 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:48.550 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:48.550 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:48.550 15:36:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:48.808 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.808 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.808 15:36:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:48.808 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.808 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.808 15:36:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:48.808 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.808 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.808 15:36:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:48.808 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.808 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.808 15:36:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:48.808 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.808 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.809 15:36:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:48.809 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.809 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.809 15:36:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:48.809 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.809 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.809 15:36:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:48.809 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.809 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.809 15:36:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:49.067 15:36:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:49.067 15:36:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:49.067 15:36:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:49.067 15:36:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.067 15:36:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:49.067 15:36:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:49.067 15:36:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:49.067 15:36:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:49.326 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.326 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.326 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.326 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.326 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.326 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.326 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.326 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.584 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.584 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.584 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.584 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.584 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.584 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.584 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.584 15:36:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.584 15:36:40 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:12:49.584 15:36:40 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:12:49.584 15:36:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:49.584 15:36:40 -- nvmf/common.sh@116 -- # sync 00:12:49.584 15:36:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:49.584 15:36:40 -- nvmf/common.sh@119 -- # set +e 00:12:49.584 15:36:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:49.584 15:36:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:49.584 rmmod nvme_tcp 00:12:49.584 rmmod nvme_fabrics 00:12:49.584 rmmod nvme_keyring 00:12:49.584 15:36:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:49.584 15:36:40 -- nvmf/common.sh@123 -- # set -e 00:12:49.584 15:36:40 -- nvmf/common.sh@124 -- # return 0 00:12:49.584 15:36:40 -- nvmf/common.sh@477 -- # '[' -n 824802 ']' 00:12:49.584 15:36:40 -- nvmf/common.sh@478 -- # killprocess 824802 00:12:49.584 15:36:40 -- common/autotest_common.sh@936 -- # '[' -z 824802 ']' 00:12:49.584 15:36:40 -- common/autotest_common.sh@940 -- # kill -0 824802 00:12:49.584 15:36:40 -- common/autotest_common.sh@941 -- # uname 00:12:49.584 15:36:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:49.584 15:36:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 824802 00:12:49.584 15:36:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:49.584 15:36:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:49.584 15:36:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 824802' 00:12:49.584 killing process with pid 824802 00:12:49.584 15:36:40 -- common/autotest_common.sh@955 -- # kill 824802 00:12:49.584 15:36:40 -- common/autotest_common.sh@960 -- # wait 824802 00:12:49.843 15:36:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:49.843 15:36:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:49.843 15:36:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:49.843 15:36:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:49.843 15:36:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:49.843 15:36:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:49.843 15:36:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:49.843 15:36:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:51.753 15:36:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:51.753 00:12:51.753 real 0m47.977s 00:12:51.753 user 3m39.265s 00:12:51.753 sys 0m15.067s 00:12:51.753 15:36:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:51.753 15:36:43 -- common/autotest_common.sh@10 -- # set +x 00:12:51.753 ************************************ 00:12:51.753 END TEST nvmf_ns_hotplug_stress 00:12:51.753 ************************************ 00:12:52.012 15:36:43 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:12:52.012 15:36:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:52.012 15:36:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:52.012 15:36:43 -- common/autotest_common.sh@10 -- # set +x 00:12:52.012 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:12:52.012 ************************************ 00:12:52.012 START TEST nvmf_connect_stress 00:12:52.012 ************************************ 00:12:52.012 15:36:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:12:52.012 * Looking for test storage... 00:12:52.012 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:52.012 15:36:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:52.012 15:36:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:52.012 15:36:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:52.012 15:36:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:52.012 15:36:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:52.012 15:36:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:52.012 15:36:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:52.012 15:36:43 -- scripts/common.sh@335 -- # IFS=.-: 00:12:52.012 15:36:43 -- scripts/common.sh@335 -- # read -ra ver1 00:12:52.012 15:36:43 -- scripts/common.sh@336 -- # IFS=.-: 00:12:52.012 15:36:43 -- scripts/common.sh@336 -- # read -ra ver2 00:12:52.012 15:36:43 -- scripts/common.sh@337 -- # local 'op=<' 00:12:52.012 15:36:43 -- scripts/common.sh@339 -- # ver1_l=2 00:12:52.012 15:36:43 -- scripts/common.sh@340 -- # ver2_l=1 00:12:52.012 15:36:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:52.012 15:36:43 -- scripts/common.sh@343 -- # case "$op" in 00:12:52.012 15:36:43 -- scripts/common.sh@344 -- # : 1 00:12:52.012 15:36:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:52.012 15:36:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:52.012 15:36:43 -- scripts/common.sh@364 -- # decimal 1 00:12:52.012 15:36:43 -- scripts/common.sh@352 -- # local d=1 00:12:52.012 15:36:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:52.012 15:36:43 -- scripts/common.sh@354 -- # echo 1 00:12:52.012 15:36:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:52.012 15:36:43 -- scripts/common.sh@365 -- # decimal 2 00:12:52.012 15:36:43 -- scripts/common.sh@352 -- # local d=2 00:12:52.012 15:36:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:52.012 15:36:43 -- scripts/common.sh@354 -- # echo 2 00:12:52.012 15:36:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:52.012 15:36:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:52.012 15:36:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:52.012 15:36:43 -- scripts/common.sh@367 -- # return 0 00:12:52.012 15:36:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:52.012 15:36:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:52.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:52.012 --rc genhtml_branch_coverage=1 00:12:52.012 --rc genhtml_function_coverage=1 00:12:52.012 --rc genhtml_legend=1 00:12:52.012 --rc geninfo_all_blocks=1 00:12:52.012 --rc geninfo_unexecuted_blocks=1 00:12:52.012 00:12:52.012 ' 00:12:52.012 15:36:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:52.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:52.012 --rc genhtml_branch_coverage=1 00:12:52.012 --rc genhtml_function_coverage=1 00:12:52.012 --rc genhtml_legend=1 00:12:52.012 --rc geninfo_all_blocks=1 00:12:52.012 --rc geninfo_unexecuted_blocks=1 00:12:52.012 00:12:52.012 ' 00:12:52.012 15:36:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:52.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:52.012 --rc genhtml_branch_coverage=1 00:12:52.012 --rc genhtml_function_coverage=1 00:12:52.012 --rc genhtml_legend=1 00:12:52.012 --rc geninfo_all_blocks=1 00:12:52.012 --rc geninfo_unexecuted_blocks=1 00:12:52.012 00:12:52.012 ' 00:12:52.012 15:36:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:52.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:52.012 --rc genhtml_branch_coverage=1 00:12:52.012 --rc genhtml_function_coverage=1 00:12:52.012 --rc genhtml_legend=1 00:12:52.012 --rc geninfo_all_blocks=1 00:12:52.012 --rc geninfo_unexecuted_blocks=1 00:12:52.012 00:12:52.012 ' 00:12:52.012 15:36:43 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:52.012 15:36:43 -- nvmf/common.sh@7 -- # uname -s 00:12:52.012 15:36:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:52.012 15:36:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:52.012 15:36:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:52.012 15:36:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:52.012 15:36:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:52.012 15:36:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:52.012 15:36:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:52.012 15:36:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:52.012 15:36:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:52.012 15:36:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:52.012 15:36:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:52.012 15:36:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:52.012 15:36:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:52.013 15:36:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:52.013 15:36:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:52.013 15:36:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:52.013 15:36:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:52.013 15:36:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:52.013 15:36:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:52.013 15:36:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.013 15:36:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.013 15:36:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.013 15:36:43 -- paths/export.sh@5 -- # export PATH 00:12:52.013 15:36:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.013 15:36:43 -- nvmf/common.sh@46 -- # : 0 00:12:52.013 15:36:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:52.013 15:36:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:52.013 15:36:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:52.013 15:36:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:52.013 15:36:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:52.013 15:36:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:52.013 15:36:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:52.013 15:36:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:52.013 15:36:43 -- target/connect_stress.sh@12 -- # nvmftestinit 00:12:52.013 15:36:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:52.013 15:36:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:52.013 15:36:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:52.013 15:36:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:52.013 15:36:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:52.013 15:36:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:52.013 15:36:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:52.013 15:36:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:52.013 15:36:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:52.013 15:36:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:52.013 15:36:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:52.013 15:36:43 -- common/autotest_common.sh@10 -- # set +x 00:12:53.918 15:36:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:53.918 15:36:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:53.918 15:36:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:53.918 15:36:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:53.918 15:36:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:53.918 15:36:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:53.918 15:36:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:53.918 15:36:45 -- nvmf/common.sh@294 -- # net_devs=() 00:12:53.918 15:36:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:53.918 15:36:45 -- nvmf/common.sh@295 -- # e810=() 00:12:53.918 15:36:45 -- nvmf/common.sh@295 -- # local -ga e810 00:12:53.918 15:36:45 -- nvmf/common.sh@296 -- # x722=() 00:12:53.919 15:36:45 -- nvmf/common.sh@296 -- # local -ga x722 00:12:53.919 15:36:45 -- nvmf/common.sh@297 -- # mlx=() 00:12:53.919 15:36:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:53.919 15:36:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:53.919 15:36:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:53.919 15:36:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:53.919 15:36:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:53.919 15:36:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:53.919 15:36:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:53.919 15:36:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:53.919 15:36:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:53.919 15:36:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:53.919 15:36:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:53.919 15:36:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:53.919 15:36:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:53.919 15:36:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:53.919 15:36:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:53.919 15:36:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:53.919 15:36:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:53.919 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:53.919 15:36:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:53.919 15:36:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:53.919 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:53.919 15:36:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:53.919 15:36:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:53.919 15:36:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:53.919 15:36:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:53.919 15:36:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:53.919 15:36:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:53.919 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:53.919 15:36:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:53.919 15:36:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:53.919 15:36:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:53.919 15:36:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:53.919 15:36:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:53.919 15:36:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:53.919 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:53.919 15:36:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:53.919 15:36:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:53.919 15:36:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:53.919 15:36:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:53.919 15:36:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:53.919 15:36:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:53.919 15:36:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:53.919 15:36:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:53.919 15:36:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:53.919 15:36:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:53.919 15:36:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:53.919 15:36:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:53.919 15:36:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:53.919 15:36:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:53.919 15:36:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:53.919 15:36:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:53.919 15:36:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:53.919 15:36:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:54.177 15:36:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:54.177 15:36:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:54.177 15:36:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:54.177 15:36:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:54.177 15:36:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:54.177 15:36:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:54.177 15:36:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:54.177 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:54.177 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:12:54.177 00:12:54.177 --- 10.0.0.2 ping statistics --- 00:12:54.177 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:54.177 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:12:54.177 15:36:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:54.177 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:54.177 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.155 ms 00:12:54.177 00:12:54.177 --- 10.0.0.1 ping statistics --- 00:12:54.177 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:54.177 rtt min/avg/max/mdev = 0.155/0.155/0.155/0.000 ms 00:12:54.177 15:36:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:54.177 15:36:45 -- nvmf/common.sh@410 -- # return 0 00:12:54.177 15:36:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:54.177 15:36:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:54.177 15:36:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:54.177 15:36:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:54.177 15:36:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:54.177 15:36:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:54.177 15:36:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:54.177 15:36:45 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:12:54.177 15:36:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:54.177 15:36:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:54.177 15:36:45 -- common/autotest_common.sh@10 -- # set +x 00:12:54.177 15:36:45 -- nvmf/common.sh@469 -- # nvmfpid=832668 00:12:54.177 15:36:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:54.177 15:36:45 -- nvmf/common.sh@470 -- # waitforlisten 832668 00:12:54.177 15:36:45 -- common/autotest_common.sh@829 -- # '[' -z 832668 ']' 00:12:54.177 15:36:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:54.177 15:36:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:54.177 15:36:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:54.177 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:54.177 15:36:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:54.177 15:36:45 -- common/autotest_common.sh@10 -- # set +x 00:12:54.436 [2024-11-26 15:36:45.653392] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:54.436 [2024-11-26 15:36:45.653465] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:54.436 EAL: No free 2048 kB hugepages reported on node 1 00:12:54.436 [2024-11-26 15:36:45.721402] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:54.436 [2024-11-26 15:36:45.840135] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:54.436 [2024-11-26 15:36:45.840297] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:54.436 [2024-11-26 15:36:45.840328] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:54.436 [2024-11-26 15:36:45.840340] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:54.436 [2024-11-26 15:36:45.840408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:54.436 [2024-11-26 15:36:45.840472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:54.436 [2024-11-26 15:36:45.840475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:55.373 15:36:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:55.373 15:36:46 -- common/autotest_common.sh@862 -- # return 0 00:12:55.373 15:36:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:55.373 15:36:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:55.373 15:36:46 -- common/autotest_common.sh@10 -- # set +x 00:12:55.373 15:36:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:55.373 15:36:46 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:55.373 15:36:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:55.373 15:36:46 -- common/autotest_common.sh@10 -- # set +x 00:12:55.373 [2024-11-26 15:36:46.673759] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:55.373 15:36:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:55.373 15:36:46 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:55.373 15:36:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:55.373 15:36:46 -- common/autotest_common.sh@10 -- # set +x 00:12:55.373 15:36:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:55.373 15:36:46 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:55.373 15:36:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:55.373 15:36:46 -- common/autotest_common.sh@10 -- # set +x 00:12:55.373 [2024-11-26 15:36:46.699855] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:55.373 15:36:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:55.373 15:36:46 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:55.373 15:36:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:55.373 15:36:46 -- common/autotest_common.sh@10 -- # set +x 00:12:55.373 NULL1 00:12:55.373 15:36:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:55.373 15:36:46 -- target/connect_stress.sh@21 -- # PERF_PID=832819 00:12:55.373 15:36:46 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:12:55.373 15:36:46 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:55.373 15:36:46 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # seq 1 20 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 EAL: No free 2048 kB hugepages reported on node 1 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:55.373 15:36:46 -- target/connect_stress.sh@28 -- # cat 00:12:55.373 15:36:46 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:55.373 15:36:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:55.373 15:36:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:55.373 15:36:46 -- common/autotest_common.sh@10 -- # set +x 00:12:55.632 15:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:55.632 15:36:47 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:55.632 15:36:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:55.632 15:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:55.632 15:36:47 -- common/autotest_common.sh@10 -- # set +x 00:12:56.200 15:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.200 15:36:47 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:56.200 15:36:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:56.200 15:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.200 15:36:47 -- common/autotest_common.sh@10 -- # set +x 00:12:56.458 15:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.458 15:36:47 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:56.458 15:36:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:56.458 15:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.458 15:36:47 -- common/autotest_common.sh@10 -- # set +x 00:12:56.716 15:36:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.716 15:36:48 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:56.716 15:36:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:56.716 15:36:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.716 15:36:48 -- common/autotest_common.sh@10 -- # set +x 00:12:56.976 15:36:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.976 15:36:48 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:56.976 15:36:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:56.976 15:36:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.976 15:36:48 -- common/autotest_common.sh@10 -- # set +x 00:12:57.237 15:36:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.237 15:36:48 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:57.237 15:36:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:57.237 15:36:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.237 15:36:48 -- common/autotest_common.sh@10 -- # set +x 00:12:57.805 15:36:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.806 15:36:49 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:57.806 15:36:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:57.806 15:36:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.806 15:36:49 -- common/autotest_common.sh@10 -- # set +x 00:12:58.065 15:36:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:58.065 15:36:49 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:58.065 15:36:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:58.065 15:36:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:58.065 15:36:49 -- common/autotest_common.sh@10 -- # set +x 00:12:58.325 15:36:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:58.325 15:36:49 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:58.325 15:36:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:58.325 15:36:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:58.325 15:36:49 -- common/autotest_common.sh@10 -- # set +x 00:12:58.585 15:36:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:58.585 15:36:49 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:58.585 15:36:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:58.585 15:36:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:58.585 15:36:49 -- common/autotest_common.sh@10 -- # set +x 00:12:58.846 15:36:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:58.846 15:36:50 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:58.846 15:36:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:58.846 15:36:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:58.846 15:36:50 -- common/autotest_common.sh@10 -- # set +x 00:12:59.476 15:36:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.476 15:36:50 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:59.476 15:36:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.476 15:36:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.476 15:36:50 -- common/autotest_common.sh@10 -- # set +x 00:12:59.737 15:36:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.737 15:36:50 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:59.737 15:36:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.737 15:36:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.737 15:36:50 -- common/autotest_common.sh@10 -- # set +x 00:12:59.998 15:36:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.998 15:36:51 -- target/connect_stress.sh@34 -- # kill -0 832819 00:12:59.998 15:36:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.998 15:36:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.998 15:36:51 -- common/autotest_common.sh@10 -- # set +x 00:13:00.257 15:36:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.257 15:36:51 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:00.257 15:36:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.257 15:36:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.257 15:36:51 -- common/autotest_common.sh@10 -- # set +x 00:13:00.515 15:36:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.515 15:36:51 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:00.515 15:36:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.515 15:36:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.515 15:36:51 -- common/autotest_common.sh@10 -- # set +x 00:13:00.774 15:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.774 15:36:52 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:00.774 15:36:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.774 15:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.774 15:36:52 -- common/autotest_common.sh@10 -- # set +x 00:13:01.343 15:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.343 15:36:52 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:01.343 15:36:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:01.343 15:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.343 15:36:52 -- common/autotest_common.sh@10 -- # set +x 00:13:01.603 15:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.603 15:36:52 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:01.603 15:36:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:01.603 15:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.603 15:36:52 -- common/autotest_common.sh@10 -- # set +x 00:13:01.861 15:36:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.861 15:36:53 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:01.861 15:36:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:01.861 15:36:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.862 15:36:53 -- common/autotest_common.sh@10 -- # set +x 00:13:02.120 15:36:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.120 15:36:53 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:02.120 15:36:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:02.120 15:36:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.120 15:36:53 -- common/autotest_common.sh@10 -- # set +x 00:13:02.380 15:36:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.380 15:36:53 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:02.380 15:36:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:02.380 15:36:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.380 15:36:53 -- common/autotest_common.sh@10 -- # set +x 00:13:02.950 15:36:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.950 15:36:54 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:02.950 15:36:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:02.950 15:36:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.950 15:36:54 -- common/autotest_common.sh@10 -- # set +x 00:13:03.209 15:36:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.209 15:36:54 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:03.209 15:36:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.209 15:36:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.209 15:36:54 -- common/autotest_common.sh@10 -- # set +x 00:13:03.470 15:36:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.470 15:36:54 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:03.470 15:36:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.470 15:36:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.470 15:36:54 -- common/autotest_common.sh@10 -- # set +x 00:13:03.730 15:36:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.730 15:36:55 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:03.730 15:36:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.731 15:36:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.731 15:36:55 -- common/autotest_common.sh@10 -- # set +x 00:13:03.991 15:36:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.991 15:36:55 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:03.991 15:36:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.991 15:36:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.991 15:36:55 -- common/autotest_common.sh@10 -- # set +x 00:13:04.560 15:36:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.560 15:36:55 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:04.560 15:36:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:04.560 15:36:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.560 15:36:55 -- common/autotest_common.sh@10 -- # set +x 00:13:04.819 15:36:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.819 15:36:56 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:04.819 15:36:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:04.819 15:36:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.819 15:36:56 -- common/autotest_common.sh@10 -- # set +x 00:13:05.079 15:36:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.079 15:36:56 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:05.079 15:36:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.079 15:36:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.079 15:36:56 -- common/autotest_common.sh@10 -- # set +x 00:13:05.339 15:36:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.339 15:36:56 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:05.339 15:36:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.339 15:36:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.339 15:36:56 -- common/autotest_common.sh@10 -- # set +x 00:13:05.598 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:05.598 15:36:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.598 15:36:57 -- target/connect_stress.sh@34 -- # kill -0 832819 00:13:05.598 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (832819) - No such process 00:13:05.598 15:36:57 -- target/connect_stress.sh@38 -- # wait 832819 00:13:05.598 15:36:57 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:05.598 15:36:57 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:05.598 15:36:57 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:05.598 15:36:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:05.598 15:36:57 -- nvmf/common.sh@116 -- # sync 00:13:05.598 15:36:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:05.598 15:36:57 -- nvmf/common.sh@119 -- # set +e 00:13:05.598 15:36:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:05.598 15:36:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:05.857 rmmod nvme_tcp 00:13:05.857 rmmod nvme_fabrics 00:13:05.857 rmmod nvme_keyring 00:13:05.857 15:36:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:05.857 15:36:57 -- nvmf/common.sh@123 -- # set -e 00:13:05.857 15:36:57 -- nvmf/common.sh@124 -- # return 0 00:13:05.857 15:36:57 -- nvmf/common.sh@477 -- # '[' -n 832668 ']' 00:13:05.857 15:36:57 -- nvmf/common.sh@478 -- # killprocess 832668 00:13:05.857 15:36:57 -- common/autotest_common.sh@936 -- # '[' -z 832668 ']' 00:13:05.857 15:36:57 -- common/autotest_common.sh@940 -- # kill -0 832668 00:13:05.857 15:36:57 -- common/autotest_common.sh@941 -- # uname 00:13:05.857 15:36:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:05.857 15:36:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 832668 00:13:05.857 15:36:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:05.857 15:36:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:05.857 15:36:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 832668' 00:13:05.857 killing process with pid 832668 00:13:05.857 15:36:57 -- common/autotest_common.sh@955 -- # kill 832668 00:13:05.857 15:36:57 -- common/autotest_common.sh@960 -- # wait 832668 00:13:06.116 15:36:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:06.116 15:36:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:06.116 15:36:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:06.116 15:36:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:06.116 15:36:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:06.116 15:36:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:06.116 15:36:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:06.116 15:36:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:08.024 15:36:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:08.024 00:13:08.024 real 0m16.218s 00:13:08.024 user 0m41.061s 00:13:08.024 sys 0m5.668s 00:13:08.024 15:36:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:08.024 15:36:59 -- common/autotest_common.sh@10 -- # set +x 00:13:08.024 ************************************ 00:13:08.024 END TEST nvmf_connect_stress 00:13:08.024 ************************************ 00:13:08.024 15:36:59 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:08.024 15:36:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:08.024 15:36:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:08.024 15:36:59 -- common/autotest_common.sh@10 -- # set +x 00:13:08.024 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:13:08.024 ************************************ 00:13:08.024 START TEST nvmf_fused_ordering 00:13:08.024 ************************************ 00:13:08.024 15:36:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:08.282 * Looking for test storage... 00:13:08.282 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:08.283 15:36:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:08.283 15:36:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:08.283 15:36:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:08.283 15:36:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:08.283 15:36:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:08.283 15:36:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:08.283 15:36:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:08.283 15:36:59 -- scripts/common.sh@335 -- # IFS=.-: 00:13:08.283 15:36:59 -- scripts/common.sh@335 -- # read -ra ver1 00:13:08.283 15:36:59 -- scripts/common.sh@336 -- # IFS=.-: 00:13:08.283 15:36:59 -- scripts/common.sh@336 -- # read -ra ver2 00:13:08.283 15:36:59 -- scripts/common.sh@337 -- # local 'op=<' 00:13:08.283 15:36:59 -- scripts/common.sh@339 -- # ver1_l=2 00:13:08.283 15:36:59 -- scripts/common.sh@340 -- # ver2_l=1 00:13:08.283 15:36:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:08.283 15:36:59 -- scripts/common.sh@343 -- # case "$op" in 00:13:08.283 15:36:59 -- scripts/common.sh@344 -- # : 1 00:13:08.283 15:36:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:08.283 15:36:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:08.283 15:36:59 -- scripts/common.sh@364 -- # decimal 1 00:13:08.283 15:36:59 -- scripts/common.sh@352 -- # local d=1 00:13:08.283 15:36:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:08.283 15:36:59 -- scripts/common.sh@354 -- # echo 1 00:13:08.283 15:36:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:08.283 15:36:59 -- scripts/common.sh@365 -- # decimal 2 00:13:08.283 15:36:59 -- scripts/common.sh@352 -- # local d=2 00:13:08.283 15:36:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:08.283 15:36:59 -- scripts/common.sh@354 -- # echo 2 00:13:08.283 15:36:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:08.283 15:36:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:08.283 15:36:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:08.283 15:36:59 -- scripts/common.sh@367 -- # return 0 00:13:08.283 15:36:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:08.283 15:36:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:08.283 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:08.283 --rc genhtml_branch_coverage=1 00:13:08.283 --rc genhtml_function_coverage=1 00:13:08.283 --rc genhtml_legend=1 00:13:08.283 --rc geninfo_all_blocks=1 00:13:08.283 --rc geninfo_unexecuted_blocks=1 00:13:08.283 00:13:08.283 ' 00:13:08.283 15:36:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:08.283 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:08.283 --rc genhtml_branch_coverage=1 00:13:08.283 --rc genhtml_function_coverage=1 00:13:08.283 --rc genhtml_legend=1 00:13:08.283 --rc geninfo_all_blocks=1 00:13:08.283 --rc geninfo_unexecuted_blocks=1 00:13:08.283 00:13:08.283 ' 00:13:08.283 15:36:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:08.283 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:08.283 --rc genhtml_branch_coverage=1 00:13:08.283 --rc genhtml_function_coverage=1 00:13:08.283 --rc genhtml_legend=1 00:13:08.283 --rc geninfo_all_blocks=1 00:13:08.283 --rc geninfo_unexecuted_blocks=1 00:13:08.283 00:13:08.283 ' 00:13:08.283 15:36:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:08.283 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:08.283 --rc genhtml_branch_coverage=1 00:13:08.283 --rc genhtml_function_coverage=1 00:13:08.283 --rc genhtml_legend=1 00:13:08.283 --rc geninfo_all_blocks=1 00:13:08.283 --rc geninfo_unexecuted_blocks=1 00:13:08.283 00:13:08.283 ' 00:13:08.283 15:36:59 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:08.283 15:36:59 -- nvmf/common.sh@7 -- # uname -s 00:13:08.283 15:36:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:08.283 15:36:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:08.283 15:36:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:08.283 15:36:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:08.283 15:36:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:08.283 15:36:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:08.283 15:36:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:08.283 15:36:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:08.283 15:36:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:08.283 15:36:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:08.283 15:36:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:08.283 15:36:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:08.283 15:36:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:08.283 15:36:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:08.283 15:36:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:08.283 15:36:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:08.283 15:36:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:08.283 15:36:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:08.283 15:36:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:08.283 15:36:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:08.283 15:36:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:08.283 15:36:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:08.283 15:36:59 -- paths/export.sh@5 -- # export PATH 00:13:08.283 15:36:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:08.283 15:36:59 -- nvmf/common.sh@46 -- # : 0 00:13:08.283 15:36:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:08.283 15:36:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:08.283 15:36:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:08.283 15:36:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:08.283 15:36:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:08.283 15:36:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:08.283 15:36:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:08.283 15:36:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:08.283 15:36:59 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:08.283 15:36:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:08.283 15:36:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:08.283 15:36:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:08.283 15:36:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:08.283 15:36:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:08.283 15:36:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:08.283 15:36:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:08.283 15:36:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:08.283 15:36:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:08.283 15:36:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:08.283 15:36:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:08.283 15:36:59 -- common/autotest_common.sh@10 -- # set +x 00:13:10.190 15:37:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:10.190 15:37:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:10.190 15:37:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:10.190 15:37:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:10.190 15:37:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:10.190 15:37:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:10.190 15:37:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:10.190 15:37:01 -- nvmf/common.sh@294 -- # net_devs=() 00:13:10.190 15:37:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:10.190 15:37:01 -- nvmf/common.sh@295 -- # e810=() 00:13:10.190 15:37:01 -- nvmf/common.sh@295 -- # local -ga e810 00:13:10.190 15:37:01 -- nvmf/common.sh@296 -- # x722=() 00:13:10.190 15:37:01 -- nvmf/common.sh@296 -- # local -ga x722 00:13:10.190 15:37:01 -- nvmf/common.sh@297 -- # mlx=() 00:13:10.190 15:37:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:10.190 15:37:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:10.190 15:37:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:10.190 15:37:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:10.190 15:37:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:10.190 15:37:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:10.190 15:37:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:10.190 15:37:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:10.190 15:37:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:10.190 15:37:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:10.190 15:37:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:10.190 15:37:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:10.190 15:37:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:10.190 15:37:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:10.190 15:37:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:10.190 15:37:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:10.190 15:37:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:10.190 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:10.190 15:37:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:10.190 15:37:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:10.190 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:10.190 15:37:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:10.190 15:37:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:10.190 15:37:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:10.190 15:37:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:10.190 15:37:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:10.190 15:37:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:10.190 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:10.190 15:37:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:10.190 15:37:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:10.190 15:37:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:10.190 15:37:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:10.190 15:37:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:10.190 15:37:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:10.190 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:10.190 15:37:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:10.190 15:37:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:10.190 15:37:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:10.190 15:37:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:10.190 15:37:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:10.190 15:37:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:10.190 15:37:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:10.190 15:37:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:10.190 15:37:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:10.190 15:37:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:10.190 15:37:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:10.190 15:37:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:10.190 15:37:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:10.190 15:37:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:10.190 15:37:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:10.190 15:37:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:10.190 15:37:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:10.190 15:37:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:10.449 15:37:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:10.449 15:37:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:10.449 15:37:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:10.449 15:37:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:10.449 15:37:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:10.449 15:37:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:10.449 15:37:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:10.449 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:10.449 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.283 ms 00:13:10.449 00:13:10.449 --- 10.0.0.2 ping statistics --- 00:13:10.449 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:10.449 rtt min/avg/max/mdev = 0.283/0.283/0.283/0.000 ms 00:13:10.449 15:37:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:10.449 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:10.450 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.179 ms 00:13:10.450 00:13:10.450 --- 10.0.0.1 ping statistics --- 00:13:10.450 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:10.450 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:13:10.450 15:37:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:10.450 15:37:01 -- nvmf/common.sh@410 -- # return 0 00:13:10.450 15:37:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:10.450 15:37:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:10.450 15:37:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:10.450 15:37:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:10.450 15:37:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:10.450 15:37:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:10.450 15:37:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:10.450 15:37:01 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:10.450 15:37:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:10.450 15:37:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:10.450 15:37:01 -- common/autotest_common.sh@10 -- # set +x 00:13:10.450 15:37:01 -- nvmf/common.sh@469 -- # nvmfpid=835936 00:13:10.450 15:37:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:10.450 15:37:01 -- nvmf/common.sh@470 -- # waitforlisten 835936 00:13:10.450 15:37:01 -- common/autotest_common.sh@829 -- # '[' -z 835936 ']' 00:13:10.450 15:37:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:10.450 15:37:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:10.450 15:37:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:10.450 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:10.450 15:37:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:10.450 15:37:01 -- common/autotest_common.sh@10 -- # set +x 00:13:10.450 [2024-11-26 15:37:01.780790] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:10.450 [2024-11-26 15:37:01.780863] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:10.450 EAL: No free 2048 kB hugepages reported on node 1 00:13:10.450 [2024-11-26 15:37:01.848019] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:10.710 [2024-11-26 15:37:01.954047] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:10.710 [2024-11-26 15:37:01.954227] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:10.710 [2024-11-26 15:37:01.954244] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:10.710 [2024-11-26 15:37:01.954256] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:10.710 [2024-11-26 15:37:01.954286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:11.647 15:37:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:11.647 15:37:02 -- common/autotest_common.sh@862 -- # return 0 00:13:11.647 15:37:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:11.647 15:37:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:11.647 15:37:02 -- common/autotest_common.sh@10 -- # set +x 00:13:11.647 15:37:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:11.647 15:37:02 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:11.647 15:37:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.647 15:37:02 -- common/autotest_common.sh@10 -- # set +x 00:13:11.647 [2024-11-26 15:37:02.768801] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:11.647 15:37:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.647 15:37:02 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:11.647 15:37:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.647 15:37:02 -- common/autotest_common.sh@10 -- # set +x 00:13:11.647 15:37:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.647 15:37:02 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:11.647 15:37:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.647 15:37:02 -- common/autotest_common.sh@10 -- # set +x 00:13:11.647 [2024-11-26 15:37:02.785029] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:11.647 15:37:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.647 15:37:02 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:11.647 15:37:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.647 15:37:02 -- common/autotest_common.sh@10 -- # set +x 00:13:11.647 NULL1 00:13:11.647 15:37:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.647 15:37:02 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:11.647 15:37:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.647 15:37:02 -- common/autotest_common.sh@10 -- # set +x 00:13:11.647 15:37:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.647 15:37:02 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:11.647 15:37:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.647 15:37:02 -- common/autotest_common.sh@10 -- # set +x 00:13:11.647 15:37:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.647 15:37:02 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:11.647 [2024-11-26 15:37:02.831113] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:11.647 [2024-11-26 15:37:02.831154] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid836089 ] 00:13:11.647 EAL: No free 2048 kB hugepages reported on node 1 00:13:11.907 Attached to nqn.2016-06.io.spdk:cnode1 00:13:11.907 Namespace ID: 1 size: 1GB 00:13:11.907 fused_ordering(0) 00:13:11.907 fused_ordering(1) 00:13:11.907 fused_ordering(2) 00:13:11.907 fused_ordering(3) 00:13:11.907 fused_ordering(4) 00:13:11.907 fused_ordering(5) 00:13:11.907 fused_ordering(6) 00:13:11.907 fused_ordering(7) 00:13:11.907 fused_ordering(8) 00:13:11.907 fused_ordering(9) 00:13:11.907 fused_ordering(10) 00:13:11.907 fused_ordering(11) 00:13:11.907 fused_ordering(12) 00:13:11.907 fused_ordering(13) 00:13:11.907 fused_ordering(14) 00:13:11.907 fused_ordering(15) 00:13:11.907 fused_ordering(16) 00:13:11.907 fused_ordering(17) 00:13:11.907 fused_ordering(18) 00:13:11.907 fused_ordering(19) 00:13:11.907 fused_ordering(20) 00:13:11.907 fused_ordering(21) 00:13:11.907 fused_ordering(22) 00:13:11.907 fused_ordering(23) 00:13:11.907 fused_ordering(24) 00:13:11.907 fused_ordering(25) 00:13:11.907 fused_ordering(26) 00:13:11.907 fused_ordering(27) 00:13:11.907 fused_ordering(28) 00:13:11.907 fused_ordering(29) 00:13:11.907 fused_ordering(30) 00:13:11.907 fused_ordering(31) 00:13:11.907 fused_ordering(32) 00:13:11.907 fused_ordering(33) 00:13:11.907 fused_ordering(34) 00:13:11.907 fused_ordering(35) 00:13:11.907 fused_ordering(36) 00:13:11.907 fused_ordering(37) 00:13:11.907 fused_ordering(38) 00:13:11.907 fused_ordering(39) 00:13:11.907 fused_ordering(40) 00:13:11.907 fused_ordering(41) 00:13:11.907 fused_ordering(42) 00:13:11.907 fused_ordering(43) 00:13:11.907 fused_ordering(44) 00:13:11.907 fused_ordering(45) 00:13:11.907 fused_ordering(46) 00:13:11.907 fused_ordering(47) 00:13:11.907 fused_ordering(48) 00:13:11.907 fused_ordering(49) 00:13:11.907 fused_ordering(50) 00:13:11.907 fused_ordering(51) 00:13:11.907 fused_ordering(52) 00:13:11.907 fused_ordering(53) 00:13:11.907 fused_ordering(54) 00:13:11.907 fused_ordering(55) 00:13:11.907 fused_ordering(56) 00:13:11.907 fused_ordering(57) 00:13:11.907 fused_ordering(58) 00:13:11.907 fused_ordering(59) 00:13:11.907 fused_ordering(60) 00:13:11.907 fused_ordering(61) 00:13:11.907 fused_ordering(62) 00:13:11.907 fused_ordering(63) 00:13:11.907 fused_ordering(64) 00:13:11.907 fused_ordering(65) 00:13:11.907 fused_ordering(66) 00:13:11.907 fused_ordering(67) 00:13:11.907 fused_ordering(68) 00:13:11.907 fused_ordering(69) 00:13:11.907 fused_ordering(70) 00:13:11.907 fused_ordering(71) 00:13:11.907 fused_ordering(72) 00:13:11.907 fused_ordering(73) 00:13:11.907 fused_ordering(74) 00:13:11.907 fused_ordering(75) 00:13:11.907 fused_ordering(76) 00:13:11.907 fused_ordering(77) 00:13:11.907 fused_ordering(78) 00:13:11.907 fused_ordering(79) 00:13:11.907 fused_ordering(80) 00:13:11.907 fused_ordering(81) 00:13:11.907 fused_ordering(82) 00:13:11.907 fused_ordering(83) 00:13:11.907 fused_ordering(84) 00:13:11.907 fused_ordering(85) 00:13:11.907 fused_ordering(86) 00:13:11.907 fused_ordering(87) 00:13:11.907 fused_ordering(88) 00:13:11.907 fused_ordering(89) 00:13:11.907 fused_ordering(90) 00:13:11.907 fused_ordering(91) 00:13:11.907 fused_ordering(92) 00:13:11.907 fused_ordering(93) 00:13:11.907 fused_ordering(94) 00:13:11.907 fused_ordering(95) 00:13:11.907 fused_ordering(96) 00:13:11.907 fused_ordering(97) 00:13:11.907 fused_ordering(98) 00:13:11.907 fused_ordering(99) 00:13:11.907 fused_ordering(100) 00:13:11.907 fused_ordering(101) 00:13:11.907 fused_ordering(102) 00:13:11.907 fused_ordering(103) 00:13:11.907 fused_ordering(104) 00:13:11.907 fused_ordering(105) 00:13:11.907 fused_ordering(106) 00:13:11.907 fused_ordering(107) 00:13:11.907 fused_ordering(108) 00:13:11.907 fused_ordering(109) 00:13:11.907 fused_ordering(110) 00:13:11.907 fused_ordering(111) 00:13:11.907 fused_ordering(112) 00:13:11.907 fused_ordering(113) 00:13:11.907 fused_ordering(114) 00:13:11.907 fused_ordering(115) 00:13:11.907 fused_ordering(116) 00:13:11.907 fused_ordering(117) 00:13:11.907 fused_ordering(118) 00:13:11.907 fused_ordering(119) 00:13:11.907 fused_ordering(120) 00:13:11.907 fused_ordering(121) 00:13:11.907 fused_ordering(122) 00:13:11.907 fused_ordering(123) 00:13:11.907 fused_ordering(124) 00:13:11.907 fused_ordering(125) 00:13:11.907 fused_ordering(126) 00:13:11.907 fused_ordering(127) 00:13:11.907 fused_ordering(128) 00:13:11.907 fused_ordering(129) 00:13:11.907 fused_ordering(130) 00:13:11.907 fused_ordering(131) 00:13:11.907 fused_ordering(132) 00:13:11.907 fused_ordering(133) 00:13:11.907 fused_ordering(134) 00:13:11.907 fused_ordering(135) 00:13:11.907 fused_ordering(136) 00:13:11.907 fused_ordering(137) 00:13:11.907 fused_ordering(138) 00:13:11.907 fused_ordering(139) 00:13:11.907 fused_ordering(140) 00:13:11.907 fused_ordering(141) 00:13:11.907 fused_ordering(142) 00:13:11.907 fused_ordering(143) 00:13:11.907 fused_ordering(144) 00:13:11.907 fused_ordering(145) 00:13:11.907 fused_ordering(146) 00:13:11.907 fused_ordering(147) 00:13:11.907 fused_ordering(148) 00:13:11.907 fused_ordering(149) 00:13:11.907 fused_ordering(150) 00:13:11.907 fused_ordering(151) 00:13:11.907 fused_ordering(152) 00:13:11.907 fused_ordering(153) 00:13:11.907 fused_ordering(154) 00:13:11.907 fused_ordering(155) 00:13:11.907 fused_ordering(156) 00:13:11.907 fused_ordering(157) 00:13:11.907 fused_ordering(158) 00:13:11.907 fused_ordering(159) 00:13:11.907 fused_ordering(160) 00:13:11.907 fused_ordering(161) 00:13:11.907 fused_ordering(162) 00:13:11.907 fused_ordering(163) 00:13:11.907 fused_ordering(164) 00:13:11.907 fused_ordering(165) 00:13:11.907 fused_ordering(166) 00:13:11.907 fused_ordering(167) 00:13:11.907 fused_ordering(168) 00:13:11.907 fused_ordering(169) 00:13:11.907 fused_ordering(170) 00:13:11.907 fused_ordering(171) 00:13:11.907 fused_ordering(172) 00:13:11.907 fused_ordering(173) 00:13:11.907 fused_ordering(174) 00:13:11.907 fused_ordering(175) 00:13:11.907 fused_ordering(176) 00:13:11.907 fused_ordering(177) 00:13:11.907 fused_ordering(178) 00:13:11.907 fused_ordering(179) 00:13:11.907 fused_ordering(180) 00:13:11.907 fused_ordering(181) 00:13:11.907 fused_ordering(182) 00:13:11.907 fused_ordering(183) 00:13:11.907 fused_ordering(184) 00:13:11.907 fused_ordering(185) 00:13:11.907 fused_ordering(186) 00:13:11.907 fused_ordering(187) 00:13:11.907 fused_ordering(188) 00:13:11.907 fused_ordering(189) 00:13:11.908 fused_ordering(190) 00:13:11.908 fused_ordering(191) 00:13:11.908 fused_ordering(192) 00:13:11.908 fused_ordering(193) 00:13:11.908 fused_ordering(194) 00:13:11.908 fused_ordering(195) 00:13:11.908 fused_ordering(196) 00:13:11.908 fused_ordering(197) 00:13:11.908 fused_ordering(198) 00:13:11.908 fused_ordering(199) 00:13:11.908 fused_ordering(200) 00:13:11.908 fused_ordering(201) 00:13:11.908 fused_ordering(202) 00:13:11.908 fused_ordering(203) 00:13:11.908 fused_ordering(204) 00:13:11.908 fused_ordering(205) 00:13:12.477 fused_ordering(206) 00:13:12.477 fused_ordering(207) 00:13:12.477 fused_ordering(208) 00:13:12.477 fused_ordering(209) 00:13:12.477 fused_ordering(210) 00:13:12.477 fused_ordering(211) 00:13:12.477 fused_ordering(212) 00:13:12.477 fused_ordering(213) 00:13:12.477 fused_ordering(214) 00:13:12.477 fused_ordering(215) 00:13:12.477 fused_ordering(216) 00:13:12.477 fused_ordering(217) 00:13:12.477 fused_ordering(218) 00:13:12.477 fused_ordering(219) 00:13:12.477 fused_ordering(220) 00:13:12.477 fused_ordering(221) 00:13:12.477 fused_ordering(222) 00:13:12.477 fused_ordering(223) 00:13:12.477 fused_ordering(224) 00:13:12.477 fused_ordering(225) 00:13:12.477 fused_ordering(226) 00:13:12.477 fused_ordering(227) 00:13:12.477 fused_ordering(228) 00:13:12.477 fused_ordering(229) 00:13:12.477 fused_ordering(230) 00:13:12.477 fused_ordering(231) 00:13:12.477 fused_ordering(232) 00:13:12.477 fused_ordering(233) 00:13:12.477 fused_ordering(234) 00:13:12.477 fused_ordering(235) 00:13:12.477 fused_ordering(236) 00:13:12.477 fused_ordering(237) 00:13:12.477 fused_ordering(238) 00:13:12.477 fused_ordering(239) 00:13:12.477 fused_ordering(240) 00:13:12.477 fused_ordering(241) 00:13:12.477 fused_ordering(242) 00:13:12.477 fused_ordering(243) 00:13:12.477 fused_ordering(244) 00:13:12.477 fused_ordering(245) 00:13:12.477 fused_ordering(246) 00:13:12.477 fused_ordering(247) 00:13:12.477 fused_ordering(248) 00:13:12.477 fused_ordering(249) 00:13:12.477 fused_ordering(250) 00:13:12.477 fused_ordering(251) 00:13:12.477 fused_ordering(252) 00:13:12.477 fused_ordering(253) 00:13:12.477 fused_ordering(254) 00:13:12.477 fused_ordering(255) 00:13:12.477 fused_ordering(256) 00:13:12.477 fused_ordering(257) 00:13:12.477 fused_ordering(258) 00:13:12.477 fused_ordering(259) 00:13:12.477 fused_ordering(260) 00:13:12.477 fused_ordering(261) 00:13:12.477 fused_ordering(262) 00:13:12.477 fused_ordering(263) 00:13:12.477 fused_ordering(264) 00:13:12.477 fused_ordering(265) 00:13:12.477 fused_ordering(266) 00:13:12.477 fused_ordering(267) 00:13:12.477 fused_ordering(268) 00:13:12.477 fused_ordering(269) 00:13:12.477 fused_ordering(270) 00:13:12.477 fused_ordering(271) 00:13:12.477 fused_ordering(272) 00:13:12.477 fused_ordering(273) 00:13:12.478 fused_ordering(274) 00:13:12.478 fused_ordering(275) 00:13:12.478 fused_ordering(276) 00:13:12.478 fused_ordering(277) 00:13:12.478 fused_ordering(278) 00:13:12.478 fused_ordering(279) 00:13:12.478 fused_ordering(280) 00:13:12.478 fused_ordering(281) 00:13:12.478 fused_ordering(282) 00:13:12.478 fused_ordering(283) 00:13:12.478 fused_ordering(284) 00:13:12.478 fused_ordering(285) 00:13:12.478 fused_ordering(286) 00:13:12.478 fused_ordering(287) 00:13:12.478 fused_ordering(288) 00:13:12.478 fused_ordering(289) 00:13:12.478 fused_ordering(290) 00:13:12.478 fused_ordering(291) 00:13:12.478 fused_ordering(292) 00:13:12.478 fused_ordering(293) 00:13:12.478 fused_ordering(294) 00:13:12.478 fused_ordering(295) 00:13:12.478 fused_ordering(296) 00:13:12.478 fused_ordering(297) 00:13:12.478 fused_ordering(298) 00:13:12.478 fused_ordering(299) 00:13:12.478 fused_ordering(300) 00:13:12.478 fused_ordering(301) 00:13:12.478 fused_ordering(302) 00:13:12.478 fused_ordering(303) 00:13:12.478 fused_ordering(304) 00:13:12.478 fused_ordering(305) 00:13:12.478 fused_ordering(306) 00:13:12.478 fused_ordering(307) 00:13:12.478 fused_ordering(308) 00:13:12.478 fused_ordering(309) 00:13:12.478 fused_ordering(310) 00:13:12.478 fused_ordering(311) 00:13:12.478 fused_ordering(312) 00:13:12.478 fused_ordering(313) 00:13:12.478 fused_ordering(314) 00:13:12.478 fused_ordering(315) 00:13:12.478 fused_ordering(316) 00:13:12.478 fused_ordering(317) 00:13:12.478 fused_ordering(318) 00:13:12.478 fused_ordering(319) 00:13:12.478 fused_ordering(320) 00:13:12.478 fused_ordering(321) 00:13:12.478 fused_ordering(322) 00:13:12.478 fused_ordering(323) 00:13:12.478 fused_ordering(324) 00:13:12.478 fused_ordering(325) 00:13:12.478 fused_ordering(326) 00:13:12.478 fused_ordering(327) 00:13:12.478 fused_ordering(328) 00:13:12.478 fused_ordering(329) 00:13:12.478 fused_ordering(330) 00:13:12.478 fused_ordering(331) 00:13:12.478 fused_ordering(332) 00:13:12.478 fused_ordering(333) 00:13:12.478 fused_ordering(334) 00:13:12.478 fused_ordering(335) 00:13:12.478 fused_ordering(336) 00:13:12.478 fused_ordering(337) 00:13:12.478 fused_ordering(338) 00:13:12.478 fused_ordering(339) 00:13:12.478 fused_ordering(340) 00:13:12.478 fused_ordering(341) 00:13:12.478 fused_ordering(342) 00:13:12.478 fused_ordering(343) 00:13:12.478 fused_ordering(344) 00:13:12.478 fused_ordering(345) 00:13:12.478 fused_ordering(346) 00:13:12.478 fused_ordering(347) 00:13:12.478 fused_ordering(348) 00:13:12.478 fused_ordering(349) 00:13:12.478 fused_ordering(350) 00:13:12.478 fused_ordering(351) 00:13:12.478 fused_ordering(352) 00:13:12.478 fused_ordering(353) 00:13:12.478 fused_ordering(354) 00:13:12.478 fused_ordering(355) 00:13:12.478 fused_ordering(356) 00:13:12.478 fused_ordering(357) 00:13:12.478 fused_ordering(358) 00:13:12.478 fused_ordering(359) 00:13:12.478 fused_ordering(360) 00:13:12.478 fused_ordering(361) 00:13:12.478 fused_ordering(362) 00:13:12.478 fused_ordering(363) 00:13:12.478 fused_ordering(364) 00:13:12.478 fused_ordering(365) 00:13:12.478 fused_ordering(366) 00:13:12.478 fused_ordering(367) 00:13:12.478 fused_ordering(368) 00:13:12.478 fused_ordering(369) 00:13:12.478 fused_ordering(370) 00:13:12.478 fused_ordering(371) 00:13:12.478 fused_ordering(372) 00:13:12.478 fused_ordering(373) 00:13:12.478 fused_ordering(374) 00:13:12.478 fused_ordering(375) 00:13:12.478 fused_ordering(376) 00:13:12.478 fused_ordering(377) 00:13:12.478 fused_ordering(378) 00:13:12.478 fused_ordering(379) 00:13:12.478 fused_ordering(380) 00:13:12.478 fused_ordering(381) 00:13:12.478 fused_ordering(382) 00:13:12.478 fused_ordering(383) 00:13:12.478 fused_ordering(384) 00:13:12.478 fused_ordering(385) 00:13:12.478 fused_ordering(386) 00:13:12.478 fused_ordering(387) 00:13:12.478 fused_ordering(388) 00:13:12.478 fused_ordering(389) 00:13:12.478 fused_ordering(390) 00:13:12.478 fused_ordering(391) 00:13:12.478 fused_ordering(392) 00:13:12.478 fused_ordering(393) 00:13:12.478 fused_ordering(394) 00:13:12.478 fused_ordering(395) 00:13:12.478 fused_ordering(396) 00:13:12.478 fused_ordering(397) 00:13:12.478 fused_ordering(398) 00:13:12.478 fused_ordering(399) 00:13:12.478 fused_ordering(400) 00:13:12.478 fused_ordering(401) 00:13:12.478 fused_ordering(402) 00:13:12.478 fused_ordering(403) 00:13:12.478 fused_ordering(404) 00:13:12.478 fused_ordering(405) 00:13:12.478 fused_ordering(406) 00:13:12.478 fused_ordering(407) 00:13:12.478 fused_ordering(408) 00:13:12.478 fused_ordering(409) 00:13:12.478 fused_ordering(410) 00:13:12.737 fused_ordering(411) 00:13:12.737 fused_ordering(412) 00:13:12.737 fused_ordering(413) 00:13:12.737 fused_ordering(414) 00:13:12.737 fused_ordering(415) 00:13:12.737 fused_ordering(416) 00:13:12.737 fused_ordering(417) 00:13:12.737 fused_ordering(418) 00:13:12.737 fused_ordering(419) 00:13:12.737 fused_ordering(420) 00:13:12.737 fused_ordering(421) 00:13:12.737 fused_ordering(422) 00:13:12.737 fused_ordering(423) 00:13:12.737 fused_ordering(424) 00:13:12.737 fused_ordering(425) 00:13:12.737 fused_ordering(426) 00:13:12.737 fused_ordering(427) 00:13:12.737 fused_ordering(428) 00:13:12.737 fused_ordering(429) 00:13:12.737 fused_ordering(430) 00:13:12.737 fused_ordering(431) 00:13:12.737 fused_ordering(432) 00:13:12.737 fused_ordering(433) 00:13:12.737 fused_ordering(434) 00:13:12.737 fused_ordering(435) 00:13:12.737 fused_ordering(436) 00:13:12.737 fused_ordering(437) 00:13:12.737 fused_ordering(438) 00:13:12.737 fused_ordering(439) 00:13:12.737 fused_ordering(440) 00:13:12.737 fused_ordering(441) 00:13:12.737 fused_ordering(442) 00:13:12.737 fused_ordering(443) 00:13:12.737 fused_ordering(444) 00:13:12.737 fused_ordering(445) 00:13:12.737 fused_ordering(446) 00:13:12.737 fused_ordering(447) 00:13:12.737 fused_ordering(448) 00:13:12.737 fused_ordering(449) 00:13:12.737 fused_ordering(450) 00:13:12.737 fused_ordering(451) 00:13:12.737 fused_ordering(452) 00:13:12.737 fused_ordering(453) 00:13:12.737 fused_ordering(454) 00:13:12.737 fused_ordering(455) 00:13:12.737 fused_ordering(456) 00:13:12.737 fused_ordering(457) 00:13:12.737 fused_ordering(458) 00:13:12.737 fused_ordering(459) 00:13:12.737 fused_ordering(460) 00:13:12.737 fused_ordering(461) 00:13:12.737 fused_ordering(462) 00:13:12.737 fused_ordering(463) 00:13:12.737 fused_ordering(464) 00:13:12.737 fused_ordering(465) 00:13:12.737 fused_ordering(466) 00:13:12.737 fused_ordering(467) 00:13:12.737 fused_ordering(468) 00:13:12.737 fused_ordering(469) 00:13:12.737 fused_ordering(470) 00:13:12.737 fused_ordering(471) 00:13:12.737 fused_ordering(472) 00:13:12.737 fused_ordering(473) 00:13:12.737 fused_ordering(474) 00:13:12.737 fused_ordering(475) 00:13:12.737 fused_ordering(476) 00:13:12.737 fused_ordering(477) 00:13:12.737 fused_ordering(478) 00:13:12.737 fused_ordering(479) 00:13:12.737 fused_ordering(480) 00:13:12.737 fused_ordering(481) 00:13:12.737 fused_ordering(482) 00:13:12.737 fused_ordering(483) 00:13:12.737 fused_ordering(484) 00:13:12.737 fused_ordering(485) 00:13:12.737 fused_ordering(486) 00:13:12.737 fused_ordering(487) 00:13:12.737 fused_ordering(488) 00:13:12.737 fused_ordering(489) 00:13:12.737 fused_ordering(490) 00:13:12.737 fused_ordering(491) 00:13:12.737 fused_ordering(492) 00:13:12.737 fused_ordering(493) 00:13:12.737 fused_ordering(494) 00:13:12.737 fused_ordering(495) 00:13:12.737 fused_ordering(496) 00:13:12.737 fused_ordering(497) 00:13:12.737 fused_ordering(498) 00:13:12.737 fused_ordering(499) 00:13:12.737 fused_ordering(500) 00:13:12.738 fused_ordering(501) 00:13:12.738 fused_ordering(502) 00:13:12.738 fused_ordering(503) 00:13:12.738 fused_ordering(504) 00:13:12.738 fused_ordering(505) 00:13:12.738 fused_ordering(506) 00:13:12.738 fused_ordering(507) 00:13:12.738 fused_ordering(508) 00:13:12.738 fused_ordering(509) 00:13:12.738 fused_ordering(510) 00:13:12.738 fused_ordering(511) 00:13:12.738 fused_ordering(512) 00:13:12.738 fused_ordering(513) 00:13:12.738 fused_ordering(514) 00:13:12.738 fused_ordering(515) 00:13:12.738 fused_ordering(516) 00:13:12.738 fused_ordering(517) 00:13:12.738 fused_ordering(518) 00:13:12.738 fused_ordering(519) 00:13:12.738 fused_ordering(520) 00:13:12.738 fused_ordering(521) 00:13:12.738 fused_ordering(522) 00:13:12.738 fused_ordering(523) 00:13:12.738 fused_ordering(524) 00:13:12.738 fused_ordering(525) 00:13:12.738 fused_ordering(526) 00:13:12.738 fused_ordering(527) 00:13:12.738 fused_ordering(528) 00:13:12.738 fused_ordering(529) 00:13:12.738 fused_ordering(530) 00:13:12.738 fused_ordering(531) 00:13:12.738 fused_ordering(532) 00:13:12.738 fused_ordering(533) 00:13:12.738 fused_ordering(534) 00:13:12.738 fused_ordering(535) 00:13:12.738 fused_ordering(536) 00:13:12.738 fused_ordering(537) 00:13:12.738 fused_ordering(538) 00:13:12.738 fused_ordering(539) 00:13:12.738 fused_ordering(540) 00:13:12.738 fused_ordering(541) 00:13:12.738 fused_ordering(542) 00:13:12.738 fused_ordering(543) 00:13:12.738 fused_ordering(544) 00:13:12.738 fused_ordering(545) 00:13:12.738 fused_ordering(546) 00:13:12.738 fused_ordering(547) 00:13:12.738 fused_ordering(548) 00:13:12.738 fused_ordering(549) 00:13:12.738 fused_ordering(550) 00:13:12.738 fused_ordering(551) 00:13:12.738 fused_ordering(552) 00:13:12.738 fused_ordering(553) 00:13:12.738 fused_ordering(554) 00:13:12.738 fused_ordering(555) 00:13:12.738 fused_ordering(556) 00:13:12.738 fused_ordering(557) 00:13:12.738 fused_ordering(558) 00:13:12.738 fused_ordering(559) 00:13:12.738 fused_ordering(560) 00:13:12.738 fused_ordering(561) 00:13:12.738 fused_ordering(562) 00:13:12.738 fused_ordering(563) 00:13:12.738 fused_ordering(564) 00:13:12.738 fused_ordering(565) 00:13:12.738 fused_ordering(566) 00:13:12.738 fused_ordering(567) 00:13:12.738 fused_ordering(568) 00:13:12.738 fused_ordering(569) 00:13:12.738 fused_ordering(570) 00:13:12.738 fused_ordering(571) 00:13:12.738 fused_ordering(572) 00:13:12.738 fused_ordering(573) 00:13:12.738 fused_ordering(574) 00:13:12.738 fused_ordering(575) 00:13:12.738 fused_ordering(576) 00:13:12.738 fused_ordering(577) 00:13:12.738 fused_ordering(578) 00:13:12.738 fused_ordering(579) 00:13:12.738 fused_ordering(580) 00:13:12.738 fused_ordering(581) 00:13:12.738 fused_ordering(582) 00:13:12.738 fused_ordering(583) 00:13:12.738 fused_ordering(584) 00:13:12.738 fused_ordering(585) 00:13:12.738 fused_ordering(586) 00:13:12.738 fused_ordering(587) 00:13:12.738 fused_ordering(588) 00:13:12.738 fused_ordering(589) 00:13:12.738 fused_ordering(590) 00:13:12.738 fused_ordering(591) 00:13:12.738 fused_ordering(592) 00:13:12.738 fused_ordering(593) 00:13:12.738 fused_ordering(594) 00:13:12.738 fused_ordering(595) 00:13:12.738 fused_ordering(596) 00:13:12.738 fused_ordering(597) 00:13:12.738 fused_ordering(598) 00:13:12.738 fused_ordering(599) 00:13:12.738 fused_ordering(600) 00:13:12.738 fused_ordering(601) 00:13:12.738 fused_ordering(602) 00:13:12.738 fused_ordering(603) 00:13:12.738 fused_ordering(604) 00:13:12.738 fused_ordering(605) 00:13:12.738 fused_ordering(606) 00:13:12.738 fused_ordering(607) 00:13:12.738 fused_ordering(608) 00:13:12.738 fused_ordering(609) 00:13:12.738 fused_ordering(610) 00:13:12.738 fused_ordering(611) 00:13:12.738 fused_ordering(612) 00:13:12.738 fused_ordering(613) 00:13:12.738 fused_ordering(614) 00:13:12.738 fused_ordering(615) 00:13:13.406 fused_ordering(616) 00:13:13.406 fused_ordering(617) 00:13:13.406 fused_ordering(618) 00:13:13.406 fused_ordering(619) 00:13:13.406 fused_ordering(620) 00:13:13.406 fused_ordering(621) 00:13:13.406 fused_ordering(622) 00:13:13.406 fused_ordering(623) 00:13:13.406 fused_ordering(624) 00:13:13.406 fused_ordering(625) 00:13:13.406 fused_ordering(626) 00:13:13.406 fused_ordering(627) 00:13:13.406 fused_ordering(628) 00:13:13.406 fused_ordering(629) 00:13:13.406 fused_ordering(630) 00:13:13.406 fused_ordering(631) 00:13:13.406 fused_ordering(632) 00:13:13.406 fused_ordering(633) 00:13:13.406 fused_ordering(634) 00:13:13.406 fused_ordering(635) 00:13:13.406 fused_ordering(636) 00:13:13.406 fused_ordering(637) 00:13:13.406 fused_ordering(638) 00:13:13.406 fused_ordering(639) 00:13:13.406 fused_ordering(640) 00:13:13.406 fused_ordering(641) 00:13:13.406 fused_ordering(642) 00:13:13.406 fused_ordering(643) 00:13:13.406 fused_ordering(644) 00:13:13.406 fused_ordering(645) 00:13:13.406 fused_ordering(646) 00:13:13.406 fused_ordering(647) 00:13:13.406 fused_ordering(648) 00:13:13.406 fused_ordering(649) 00:13:13.406 fused_ordering(650) 00:13:13.406 fused_ordering(651) 00:13:13.406 fused_ordering(652) 00:13:13.406 fused_ordering(653) 00:13:13.406 fused_ordering(654) 00:13:13.406 fused_ordering(655) 00:13:13.406 fused_ordering(656) 00:13:13.406 fused_ordering(657) 00:13:13.406 fused_ordering(658) 00:13:13.406 fused_ordering(659) 00:13:13.406 fused_ordering(660) 00:13:13.406 fused_ordering(661) 00:13:13.406 fused_ordering(662) 00:13:13.406 fused_ordering(663) 00:13:13.406 fused_ordering(664) 00:13:13.406 fused_ordering(665) 00:13:13.406 fused_ordering(666) 00:13:13.406 fused_ordering(667) 00:13:13.406 fused_ordering(668) 00:13:13.406 fused_ordering(669) 00:13:13.406 fused_ordering(670) 00:13:13.406 fused_ordering(671) 00:13:13.406 fused_ordering(672) 00:13:13.406 fused_ordering(673) 00:13:13.406 fused_ordering(674) 00:13:13.406 fused_ordering(675) 00:13:13.406 fused_ordering(676) 00:13:13.406 fused_ordering(677) 00:13:13.406 fused_ordering(678) 00:13:13.406 fused_ordering(679) 00:13:13.406 fused_ordering(680) 00:13:13.406 fused_ordering(681) 00:13:13.406 fused_ordering(682) 00:13:13.406 fused_ordering(683) 00:13:13.406 fused_ordering(684) 00:13:13.406 fused_ordering(685) 00:13:13.406 fused_ordering(686) 00:13:13.406 fused_ordering(687) 00:13:13.406 fused_ordering(688) 00:13:13.406 fused_ordering(689) 00:13:13.406 fused_ordering(690) 00:13:13.406 fused_ordering(691) 00:13:13.406 fused_ordering(692) 00:13:13.406 fused_ordering(693) 00:13:13.406 fused_ordering(694) 00:13:13.406 fused_ordering(695) 00:13:13.406 fused_ordering(696) 00:13:13.406 fused_ordering(697) 00:13:13.406 fused_ordering(698) 00:13:13.406 fused_ordering(699) 00:13:13.406 fused_ordering(700) 00:13:13.406 fused_ordering(701) 00:13:13.406 fused_ordering(702) 00:13:13.406 fused_ordering(703) 00:13:13.406 fused_ordering(704) 00:13:13.406 fused_ordering(705) 00:13:13.406 fused_ordering(706) 00:13:13.406 fused_ordering(707) 00:13:13.406 fused_ordering(708) 00:13:13.406 fused_ordering(709) 00:13:13.406 fused_ordering(710) 00:13:13.406 fused_ordering(711) 00:13:13.406 fused_ordering(712) 00:13:13.406 fused_ordering(713) 00:13:13.406 fused_ordering(714) 00:13:13.406 fused_ordering(715) 00:13:13.406 fused_ordering(716) 00:13:13.406 fused_ordering(717) 00:13:13.406 fused_ordering(718) 00:13:13.406 fused_ordering(719) 00:13:13.406 fused_ordering(720) 00:13:13.406 fused_ordering(721) 00:13:13.406 fused_ordering(722) 00:13:13.406 fused_ordering(723) 00:13:13.406 fused_ordering(724) 00:13:13.406 fused_ordering(725) 00:13:13.406 fused_ordering(726) 00:13:13.406 fused_ordering(727) 00:13:13.406 fused_ordering(728) 00:13:13.406 fused_ordering(729) 00:13:13.406 fused_ordering(730) 00:13:13.406 fused_ordering(731) 00:13:13.406 fused_ordering(732) 00:13:13.406 fused_ordering(733) 00:13:13.406 fused_ordering(734) 00:13:13.406 fused_ordering(735) 00:13:13.406 fused_ordering(736) 00:13:13.407 fused_ordering(737) 00:13:13.407 fused_ordering(738) 00:13:13.407 fused_ordering(739) 00:13:13.407 fused_ordering(740) 00:13:13.407 fused_ordering(741) 00:13:13.407 fused_ordering(742) 00:13:13.407 fused_ordering(743) 00:13:13.407 fused_ordering(744) 00:13:13.407 fused_ordering(745) 00:13:13.407 fused_ordering(746) 00:13:13.407 fused_ordering(747) 00:13:13.407 fused_ordering(748) 00:13:13.407 fused_ordering(749) 00:13:13.407 fused_ordering(750) 00:13:13.407 fused_ordering(751) 00:13:13.407 fused_ordering(752) 00:13:13.407 fused_ordering(753) 00:13:13.407 fused_ordering(754) 00:13:13.407 fused_ordering(755) 00:13:13.407 fused_ordering(756) 00:13:13.407 fused_ordering(757) 00:13:13.407 fused_ordering(758) 00:13:13.407 fused_ordering(759) 00:13:13.407 fused_ordering(760) 00:13:13.407 fused_ordering(761) 00:13:13.407 fused_ordering(762) 00:13:13.407 fused_ordering(763) 00:13:13.407 fused_ordering(764) 00:13:13.407 fused_ordering(765) 00:13:13.407 fused_ordering(766) 00:13:13.407 fused_ordering(767) 00:13:13.407 fused_ordering(768) 00:13:13.407 fused_ordering(769) 00:13:13.407 fused_ordering(770) 00:13:13.407 fused_ordering(771) 00:13:13.407 fused_ordering(772) 00:13:13.407 fused_ordering(773) 00:13:13.407 fused_ordering(774) 00:13:13.407 fused_ordering(775) 00:13:13.407 fused_ordering(776) 00:13:13.407 fused_ordering(777) 00:13:13.407 fused_ordering(778) 00:13:13.407 fused_ordering(779) 00:13:13.407 fused_ordering(780) 00:13:13.407 fused_ordering(781) 00:13:13.407 fused_ordering(782) 00:13:13.407 fused_ordering(783) 00:13:13.407 fused_ordering(784) 00:13:13.407 fused_ordering(785) 00:13:13.407 fused_ordering(786) 00:13:13.407 fused_ordering(787) 00:13:13.407 fused_ordering(788) 00:13:13.407 fused_ordering(789) 00:13:13.407 fused_ordering(790) 00:13:13.407 fused_ordering(791) 00:13:13.407 fused_ordering(792) 00:13:13.407 fused_ordering(793) 00:13:13.407 fused_ordering(794) 00:13:13.407 fused_ordering(795) 00:13:13.407 fused_ordering(796) 00:13:13.407 fused_ordering(797) 00:13:13.407 fused_ordering(798) 00:13:13.407 fused_ordering(799) 00:13:13.407 fused_ordering(800) 00:13:13.407 fused_ordering(801) 00:13:13.407 fused_ordering(802) 00:13:13.407 fused_ordering(803) 00:13:13.407 fused_ordering(804) 00:13:13.407 fused_ordering(805) 00:13:13.407 fused_ordering(806) 00:13:13.407 fused_ordering(807) 00:13:13.407 fused_ordering(808) 00:13:13.407 fused_ordering(809) 00:13:13.407 fused_ordering(810) 00:13:13.407 fused_ordering(811) 00:13:13.407 fused_ordering(812) 00:13:13.407 fused_ordering(813) 00:13:13.407 fused_ordering(814) 00:13:13.407 fused_ordering(815) 00:13:13.407 fused_ordering(816) 00:13:13.407 fused_ordering(817) 00:13:13.407 fused_ordering(818) 00:13:13.407 fused_ordering(819) 00:13:13.407 fused_ordering(820) 00:13:14.384 fused_ordering(821) 00:13:14.384 fused_ordering(822) 00:13:14.384 fused_ordering(823) 00:13:14.384 fused_ordering(824) 00:13:14.384 fused_ordering(825) 00:13:14.384 fused_ordering(826) 00:13:14.384 fused_ordering(827) 00:13:14.384 fused_ordering(828) 00:13:14.384 fused_ordering(829) 00:13:14.384 fused_ordering(830) 00:13:14.384 fused_ordering(831) 00:13:14.384 fused_ordering(832) 00:13:14.384 fused_ordering(833) 00:13:14.384 fused_ordering(834) 00:13:14.384 fused_ordering(835) 00:13:14.384 fused_ordering(836) 00:13:14.384 fused_ordering(837) 00:13:14.384 fused_ordering(838) 00:13:14.384 fused_ordering(839) 00:13:14.384 fused_ordering(840) 00:13:14.384 fused_ordering(841) 00:13:14.384 fused_ordering(842) 00:13:14.384 fused_ordering(843) 00:13:14.384 fused_ordering(844) 00:13:14.384 fused_ordering(845) 00:13:14.384 fused_ordering(846) 00:13:14.384 fused_ordering(847) 00:13:14.384 fused_ordering(848) 00:13:14.384 fused_ordering(849) 00:13:14.384 fused_ordering(850) 00:13:14.384 fused_ordering(851) 00:13:14.384 fused_ordering(852) 00:13:14.384 fused_ordering(853) 00:13:14.384 fused_ordering(854) 00:13:14.384 fused_ordering(855) 00:13:14.384 fused_ordering(856) 00:13:14.384 fused_ordering(857) 00:13:14.384 fused_ordering(858) 00:13:14.384 fused_ordering(859) 00:13:14.384 fused_ordering(860) 00:13:14.384 fused_ordering(861) 00:13:14.384 fused_ordering(862) 00:13:14.384 fused_ordering(863) 00:13:14.384 fused_ordering(864) 00:13:14.384 fused_ordering(865) 00:13:14.384 fused_ordering(866) 00:13:14.384 fused_ordering(867) 00:13:14.384 fused_ordering(868) 00:13:14.384 fused_ordering(869) 00:13:14.384 fused_ordering(870) 00:13:14.384 fused_ordering(871) 00:13:14.384 fused_ordering(872) 00:13:14.384 fused_ordering(873) 00:13:14.384 fused_ordering(874) 00:13:14.384 fused_ordering(875) 00:13:14.384 fused_ordering(876) 00:13:14.384 fused_ordering(877) 00:13:14.384 fused_ordering(878) 00:13:14.384 fused_ordering(879) 00:13:14.384 fused_ordering(880) 00:13:14.384 fused_ordering(881) 00:13:14.384 fused_ordering(882) 00:13:14.384 fused_ordering(883) 00:13:14.384 fused_ordering(884) 00:13:14.384 fused_ordering(885) 00:13:14.384 fused_ordering(886) 00:13:14.384 fused_ordering(887) 00:13:14.384 fused_ordering(888) 00:13:14.384 fused_ordering(889) 00:13:14.384 fused_ordering(890) 00:13:14.384 fused_ordering(891) 00:13:14.384 fused_ordering(892) 00:13:14.384 fused_ordering(893) 00:13:14.384 fused_ordering(894) 00:13:14.384 fused_ordering(895) 00:13:14.384 fused_ordering(896) 00:13:14.384 fused_ordering(897) 00:13:14.384 fused_ordering(898) 00:13:14.384 fused_ordering(899) 00:13:14.384 fused_ordering(900) 00:13:14.384 fused_ordering(901) 00:13:14.384 fused_ordering(902) 00:13:14.384 fused_ordering(903) 00:13:14.384 fused_ordering(904) 00:13:14.384 fused_ordering(905) 00:13:14.384 fused_ordering(906) 00:13:14.384 fused_ordering(907) 00:13:14.384 fused_ordering(908) 00:13:14.384 fused_ordering(909) 00:13:14.384 fused_ordering(910) 00:13:14.384 fused_ordering(911) 00:13:14.384 fused_ordering(912) 00:13:14.384 fused_ordering(913) 00:13:14.384 fused_ordering(914) 00:13:14.384 fused_ordering(915) 00:13:14.384 fused_ordering(916) 00:13:14.385 fused_ordering(917) 00:13:14.385 fused_ordering(918) 00:13:14.385 fused_ordering(919) 00:13:14.385 fused_ordering(920) 00:13:14.385 fused_ordering(921) 00:13:14.385 fused_ordering(922) 00:13:14.385 fused_ordering(923) 00:13:14.385 fused_ordering(924) 00:13:14.385 fused_ordering(925) 00:13:14.385 fused_ordering(926) 00:13:14.385 fused_ordering(927) 00:13:14.385 fused_ordering(928) 00:13:14.385 fused_ordering(929) 00:13:14.385 fused_ordering(930) 00:13:14.385 fused_ordering(931) 00:13:14.385 fused_ordering(932) 00:13:14.385 fused_ordering(933) 00:13:14.385 fused_ordering(934) 00:13:14.385 fused_ordering(935) 00:13:14.385 fused_ordering(936) 00:13:14.385 fused_ordering(937) 00:13:14.385 fused_ordering(938) 00:13:14.385 fused_ordering(939) 00:13:14.385 fused_ordering(940) 00:13:14.385 fused_ordering(941) 00:13:14.385 fused_ordering(942) 00:13:14.385 fused_ordering(943) 00:13:14.385 fused_ordering(944) 00:13:14.385 fused_ordering(945) 00:13:14.385 fused_ordering(946) 00:13:14.385 fused_ordering(947) 00:13:14.385 fused_ordering(948) 00:13:14.385 fused_ordering(949) 00:13:14.385 fused_ordering(950) 00:13:14.385 fused_ordering(951) 00:13:14.385 fused_ordering(952) 00:13:14.385 fused_ordering(953) 00:13:14.385 fused_ordering(954) 00:13:14.385 fused_ordering(955) 00:13:14.385 fused_ordering(956) 00:13:14.385 fused_ordering(957) 00:13:14.385 fused_ordering(958) 00:13:14.385 fused_ordering(959) 00:13:14.385 fused_ordering(960) 00:13:14.385 fused_ordering(961) 00:13:14.385 fused_ordering(962) 00:13:14.385 fused_ordering(963) 00:13:14.385 fused_ordering(964) 00:13:14.385 fused_ordering(965) 00:13:14.385 fused_ordering(966) 00:13:14.385 fused_ordering(967) 00:13:14.385 fused_ordering(968) 00:13:14.385 fused_ordering(969) 00:13:14.385 fused_ordering(970) 00:13:14.385 fused_ordering(971) 00:13:14.385 fused_ordering(972) 00:13:14.385 fused_ordering(973) 00:13:14.385 fused_ordering(974) 00:13:14.385 fused_ordering(975) 00:13:14.385 fused_ordering(976) 00:13:14.385 fused_ordering(977) 00:13:14.385 fused_ordering(978) 00:13:14.385 fused_ordering(979) 00:13:14.385 fused_ordering(980) 00:13:14.385 fused_ordering(981) 00:13:14.385 fused_ordering(982) 00:13:14.385 fused_ordering(983) 00:13:14.385 fused_ordering(984) 00:13:14.385 fused_ordering(985) 00:13:14.385 fused_ordering(986) 00:13:14.385 fused_ordering(987) 00:13:14.385 fused_ordering(988) 00:13:14.385 fused_ordering(989) 00:13:14.385 fused_ordering(990) 00:13:14.385 fused_ordering(991) 00:13:14.385 fused_ordering(992) 00:13:14.385 fused_ordering(993) 00:13:14.385 fused_ordering(994) 00:13:14.385 fused_ordering(995) 00:13:14.385 fused_ordering(996) 00:13:14.385 fused_ordering(997) 00:13:14.385 fused_ordering(998) 00:13:14.385 fused_ordering(999) 00:13:14.385 fused_ordering(1000) 00:13:14.385 fused_ordering(1001) 00:13:14.385 fused_ordering(1002) 00:13:14.385 fused_ordering(1003) 00:13:14.385 fused_ordering(1004) 00:13:14.385 fused_ordering(1005) 00:13:14.385 fused_ordering(1006) 00:13:14.385 fused_ordering(1007) 00:13:14.385 fused_ordering(1008) 00:13:14.385 fused_ordering(1009) 00:13:14.385 fused_ordering(1010) 00:13:14.385 fused_ordering(1011) 00:13:14.385 fused_ordering(1012) 00:13:14.385 fused_ordering(1013) 00:13:14.385 fused_ordering(1014) 00:13:14.385 fused_ordering(1015) 00:13:14.385 fused_ordering(1016) 00:13:14.385 fused_ordering(1017) 00:13:14.385 fused_ordering(1018) 00:13:14.385 fused_ordering(1019) 00:13:14.385 fused_ordering(1020) 00:13:14.385 fused_ordering(1021) 00:13:14.385 fused_ordering(1022) 00:13:14.385 fused_ordering(1023) 00:13:14.385 15:37:05 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:14.385 15:37:05 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:14.385 15:37:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:14.385 15:37:05 -- nvmf/common.sh@116 -- # sync 00:13:14.385 15:37:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:14.385 15:37:05 -- nvmf/common.sh@119 -- # set +e 00:13:14.385 15:37:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:14.385 15:37:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:14.385 rmmod nvme_tcp 00:13:14.385 rmmod nvme_fabrics 00:13:14.385 rmmod nvme_keyring 00:13:14.385 15:37:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:14.385 15:37:05 -- nvmf/common.sh@123 -- # set -e 00:13:14.385 15:37:05 -- nvmf/common.sh@124 -- # return 0 00:13:14.385 15:37:05 -- nvmf/common.sh@477 -- # '[' -n 835936 ']' 00:13:14.385 15:37:05 -- nvmf/common.sh@478 -- # killprocess 835936 00:13:14.385 15:37:05 -- common/autotest_common.sh@936 -- # '[' -z 835936 ']' 00:13:14.385 15:37:05 -- common/autotest_common.sh@940 -- # kill -0 835936 00:13:14.385 15:37:05 -- common/autotest_common.sh@941 -- # uname 00:13:14.385 15:37:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:14.385 15:37:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 835936 00:13:14.385 15:37:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:14.385 15:37:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:14.385 15:37:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 835936' 00:13:14.385 killing process with pid 835936 00:13:14.385 15:37:05 -- common/autotest_common.sh@955 -- # kill 835936 00:13:14.385 15:37:05 -- common/autotest_common.sh@960 -- # wait 835936 00:13:14.645 15:37:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:14.645 15:37:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:14.645 15:37:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:14.646 15:37:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:14.646 15:37:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:14.646 15:37:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:14.646 15:37:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:14.646 15:37:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:16.552 15:37:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:16.552 00:13:16.552 real 0m8.437s 00:13:16.552 user 0m6.293s 00:13:16.552 sys 0m3.357s 00:13:16.552 15:37:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:16.552 15:37:07 -- common/autotest_common.sh@10 -- # set +x 00:13:16.552 ************************************ 00:13:16.552 END TEST nvmf_fused_ordering 00:13:16.552 ************************************ 00:13:16.552 15:37:07 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:16.552 15:37:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:16.552 15:37:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:16.552 15:37:07 -- common/autotest_common.sh@10 -- # set +x 00:13:16.552 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:13:16.552 ************************************ 00:13:16.552 START TEST nvmf_delete_subsystem 00:13:16.552 ************************************ 00:13:16.552 15:37:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:16.552 * Looking for test storage... 00:13:16.552 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:16.552 15:37:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:16.552 15:37:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:16.552 15:37:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:16.813 15:37:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:16.813 15:37:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:16.813 15:37:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:16.813 15:37:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:16.813 15:37:08 -- scripts/common.sh@335 -- # IFS=.-: 00:13:16.813 15:37:08 -- scripts/common.sh@335 -- # read -ra ver1 00:13:16.813 15:37:08 -- scripts/common.sh@336 -- # IFS=.-: 00:13:16.813 15:37:08 -- scripts/common.sh@336 -- # read -ra ver2 00:13:16.813 15:37:08 -- scripts/common.sh@337 -- # local 'op=<' 00:13:16.813 15:37:08 -- scripts/common.sh@339 -- # ver1_l=2 00:13:16.813 15:37:08 -- scripts/common.sh@340 -- # ver2_l=1 00:13:16.813 15:37:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:16.813 15:37:08 -- scripts/common.sh@343 -- # case "$op" in 00:13:16.813 15:37:08 -- scripts/common.sh@344 -- # : 1 00:13:16.813 15:37:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:16.813 15:37:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:16.813 15:37:08 -- scripts/common.sh@364 -- # decimal 1 00:13:16.813 15:37:08 -- scripts/common.sh@352 -- # local d=1 00:13:16.813 15:37:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:16.813 15:37:08 -- scripts/common.sh@354 -- # echo 1 00:13:16.813 15:37:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:16.813 15:37:08 -- scripts/common.sh@365 -- # decimal 2 00:13:16.813 15:37:08 -- scripts/common.sh@352 -- # local d=2 00:13:16.813 15:37:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:16.813 15:37:08 -- scripts/common.sh@354 -- # echo 2 00:13:16.813 15:37:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:16.813 15:37:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:16.813 15:37:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:16.813 15:37:08 -- scripts/common.sh@367 -- # return 0 00:13:16.813 15:37:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:16.813 15:37:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:16.813 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:16.813 --rc genhtml_branch_coverage=1 00:13:16.813 --rc genhtml_function_coverage=1 00:13:16.813 --rc genhtml_legend=1 00:13:16.813 --rc geninfo_all_blocks=1 00:13:16.813 --rc geninfo_unexecuted_blocks=1 00:13:16.813 00:13:16.813 ' 00:13:16.813 15:37:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:16.813 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:16.813 --rc genhtml_branch_coverage=1 00:13:16.813 --rc genhtml_function_coverage=1 00:13:16.813 --rc genhtml_legend=1 00:13:16.813 --rc geninfo_all_blocks=1 00:13:16.813 --rc geninfo_unexecuted_blocks=1 00:13:16.813 00:13:16.813 ' 00:13:16.813 15:37:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:16.813 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:16.813 --rc genhtml_branch_coverage=1 00:13:16.813 --rc genhtml_function_coverage=1 00:13:16.813 --rc genhtml_legend=1 00:13:16.813 --rc geninfo_all_blocks=1 00:13:16.813 --rc geninfo_unexecuted_blocks=1 00:13:16.813 00:13:16.813 ' 00:13:16.813 15:37:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:16.813 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:16.813 --rc genhtml_branch_coverage=1 00:13:16.813 --rc genhtml_function_coverage=1 00:13:16.813 --rc genhtml_legend=1 00:13:16.813 --rc geninfo_all_blocks=1 00:13:16.813 --rc geninfo_unexecuted_blocks=1 00:13:16.813 00:13:16.813 ' 00:13:16.813 15:37:08 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:16.813 15:37:08 -- nvmf/common.sh@7 -- # uname -s 00:13:16.813 15:37:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:16.813 15:37:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:16.813 15:37:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:16.813 15:37:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:16.813 15:37:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:16.813 15:37:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:16.813 15:37:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:16.813 15:37:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:16.813 15:37:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:16.813 15:37:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:16.813 15:37:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:16.813 15:37:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:16.813 15:37:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:16.813 15:37:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:16.813 15:37:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:16.813 15:37:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:16.813 15:37:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:16.813 15:37:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:16.813 15:37:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:16.814 15:37:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:16.814 15:37:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:16.814 15:37:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:16.814 15:37:08 -- paths/export.sh@5 -- # export PATH 00:13:16.814 15:37:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:16.814 15:37:08 -- nvmf/common.sh@46 -- # : 0 00:13:16.814 15:37:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:16.814 15:37:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:16.814 15:37:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:16.814 15:37:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:16.814 15:37:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:16.814 15:37:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:16.814 15:37:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:16.814 15:37:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:16.814 15:37:08 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:16.814 15:37:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:16.814 15:37:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:16.814 15:37:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:16.814 15:37:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:16.814 15:37:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:16.814 15:37:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:16.814 15:37:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:16.814 15:37:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:16.814 15:37:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:16.814 15:37:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:16.814 15:37:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:16.814 15:37:08 -- common/autotest_common.sh@10 -- # set +x 00:13:18.718 15:37:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:18.718 15:37:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:18.718 15:37:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:18.718 15:37:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:18.718 15:37:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:18.718 15:37:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:18.718 15:37:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:18.718 15:37:10 -- nvmf/common.sh@294 -- # net_devs=() 00:13:18.718 15:37:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:18.977 15:37:10 -- nvmf/common.sh@295 -- # e810=() 00:13:18.978 15:37:10 -- nvmf/common.sh@295 -- # local -ga e810 00:13:18.978 15:37:10 -- nvmf/common.sh@296 -- # x722=() 00:13:18.978 15:37:10 -- nvmf/common.sh@296 -- # local -ga x722 00:13:18.978 15:37:10 -- nvmf/common.sh@297 -- # mlx=() 00:13:18.978 15:37:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:18.978 15:37:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:18.978 15:37:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:18.978 15:37:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:18.978 15:37:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:18.978 15:37:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:18.978 15:37:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:18.978 15:37:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:18.978 15:37:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:18.978 15:37:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:18.978 15:37:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:18.978 15:37:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:18.978 15:37:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:18.978 15:37:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:18.978 15:37:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:18.978 15:37:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:18.978 15:37:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:18.978 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:18.978 15:37:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:18.978 15:37:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:18.978 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:18.978 15:37:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:18.978 15:37:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:18.978 15:37:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:18.978 15:37:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:18.978 15:37:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:18.978 15:37:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:18.978 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:18.978 15:37:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:18.978 15:37:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:18.978 15:37:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:18.978 15:37:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:18.978 15:37:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:18.978 15:37:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:18.978 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:18.978 15:37:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:18.978 15:37:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:18.978 15:37:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:18.978 15:37:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:18.978 15:37:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:18.978 15:37:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:18.978 15:37:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:18.978 15:37:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:18.978 15:37:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:18.978 15:37:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:18.978 15:37:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:18.978 15:37:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:18.978 15:37:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:18.978 15:37:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:18.978 15:37:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:18.978 15:37:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:18.978 15:37:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:18.978 15:37:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:18.978 15:37:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:18.978 15:37:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:18.978 15:37:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:18.978 15:37:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:18.978 15:37:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:18.978 15:37:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:18.978 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:18.978 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.309 ms 00:13:18.978 00:13:18.978 --- 10.0.0.2 ping statistics --- 00:13:18.978 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:18.978 rtt min/avg/max/mdev = 0.309/0.309/0.309/0.000 ms 00:13:18.978 15:37:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:18.978 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:18.978 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.140 ms 00:13:18.978 00:13:18.978 --- 10.0.0.1 ping statistics --- 00:13:18.978 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:18.978 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:13:18.978 15:37:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:18.978 15:37:10 -- nvmf/common.sh@410 -- # return 0 00:13:18.978 15:37:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:18.978 15:37:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:18.978 15:37:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:18.978 15:37:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:18.978 15:37:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:18.978 15:37:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:18.978 15:37:10 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:18.978 15:37:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:18.978 15:37:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:18.978 15:37:10 -- common/autotest_common.sh@10 -- # set +x 00:13:18.978 15:37:10 -- nvmf/common.sh@469 -- # nvmfpid=838391 00:13:18.978 15:37:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:18.978 15:37:10 -- nvmf/common.sh@470 -- # waitforlisten 838391 00:13:18.978 15:37:10 -- common/autotest_common.sh@829 -- # '[' -z 838391 ']' 00:13:18.978 15:37:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:18.978 15:37:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:18.978 15:37:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:18.978 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:18.978 15:37:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:18.978 15:37:10 -- common/autotest_common.sh@10 -- # set +x 00:13:18.978 [2024-11-26 15:37:10.376286] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:18.979 [2024-11-26 15:37:10.376353] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:18.979 EAL: No free 2048 kB hugepages reported on node 1 00:13:19.237 [2024-11-26 15:37:10.441198] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:19.237 [2024-11-26 15:37:10.554445] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:19.237 [2024-11-26 15:37:10.554627] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:19.237 [2024-11-26 15:37:10.554658] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:19.237 [2024-11-26 15:37:10.554682] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:19.237 [2024-11-26 15:37:10.554771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:19.237 [2024-11-26 15:37:10.554782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:20.172 15:37:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:20.172 15:37:11 -- common/autotest_common.sh@862 -- # return 0 00:13:20.172 15:37:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:20.172 15:37:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:20.172 15:37:11 -- common/autotest_common.sh@10 -- # set +x 00:13:20.172 15:37:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:20.172 15:37:11 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:20.172 15:37:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.172 15:37:11 -- common/autotest_common.sh@10 -- # set +x 00:13:20.172 [2024-11-26 15:37:11.346309] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:20.172 15:37:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.173 15:37:11 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:20.173 15:37:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.173 15:37:11 -- common/autotest_common.sh@10 -- # set +x 00:13:20.173 15:37:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.173 15:37:11 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:20.173 15:37:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.173 15:37:11 -- common/autotest_common.sh@10 -- # set +x 00:13:20.173 [2024-11-26 15:37:11.362517] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:20.173 15:37:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.173 15:37:11 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:20.173 15:37:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.173 15:37:11 -- common/autotest_common.sh@10 -- # set +x 00:13:20.173 NULL1 00:13:20.173 15:37:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.173 15:37:11 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:20.173 15:37:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.173 15:37:11 -- common/autotest_common.sh@10 -- # set +x 00:13:20.173 Delay0 00:13:20.173 15:37:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.173 15:37:11 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:20.173 15:37:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.173 15:37:11 -- common/autotest_common.sh@10 -- # set +x 00:13:20.173 15:37:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.173 15:37:11 -- target/delete_subsystem.sh@28 -- # perf_pid=838542 00:13:20.173 15:37:11 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:20.173 15:37:11 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:20.173 EAL: No free 2048 kB hugepages reported on node 1 00:13:20.173 [2024-11-26 15:37:11.437172] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:22.079 15:37:13 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:22.079 15:37:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.079 15:37:13 -- common/autotest_common.sh@10 -- # set +x 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 starting I/O failed: -6 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 starting I/O failed: -6 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 starting I/O failed: -6 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 starting I/O failed: -6 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 starting I/O failed: -6 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 starting I/O failed: -6 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 starting I/O failed: -6 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 starting I/O failed: -6 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 starting I/O failed: -6 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 [2024-11-26 15:37:13.647735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f33bc000c00 is same with the state(5) to be set 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 starting I/O failed: -6 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 Write completed with error (sct=0, sc=8) 00:13:22.340 Read completed with error (sct=0, sc=8) 00:13:22.340 starting I/O failed: -6 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 starting I/O failed: -6 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 starting I/O failed: -6 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 starting I/O failed: -6 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 starting I/O failed: -6 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 starting I/O failed: -6 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 starting I/O failed: -6 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 starting I/O failed: -6 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 starting I/O failed: -6 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Read completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 Write completed with error (sct=0, sc=8) 00:13:22.341 starting I/O failed: -6 00:13:22.341 starting I/O failed: -6 00:13:22.341 starting I/O failed: -6 00:13:22.341 starting I/O failed: -6 00:13:22.341 starting I/O failed: -6 00:13:22.341 starting I/O failed: -6 00:13:23.281 [2024-11-26 15:37:14.615173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x210d960 is same with the state(5) to be set 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 [2024-11-26 15:37:14.647804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f33bc00c1d0 is same with the state(5) to be set 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 [2024-11-26 15:37:14.651057] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20f44c0 is same with the state(5) to be set 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 [2024-11-26 15:37:14.651278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20f4a20 is same with the state(5) to be set 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 Write completed with error (sct=0, sc=8) 00:13:23.281 Read completed with error (sct=0, sc=8) 00:13:23.281 [2024-11-26 15:37:14.651479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21143d0 is same with the state(5) to be set 00:13:23.281 [2024-11-26 15:37:14.652153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x210d960 (9): Bad file descriptor 00:13:23.281 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:23.281 15:37:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.281 15:37:14 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:23.281 15:37:14 -- target/delete_subsystem.sh@35 -- # kill -0 838542 00:13:23.281 15:37:14 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:23.281 Initializing NVMe Controllers 00:13:23.281 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:23.281 Controller IO queue size 128, less than required. 00:13:23.281 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:23.281 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:23.281 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:23.281 Initialization complete. Launching workers. 00:13:23.281 ======================================================== 00:13:23.281 Latency(us) 00:13:23.281 Device Information : IOPS MiB/s Average min max 00:13:23.281 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 172.71 0.08 1034253.86 698.84 2003838.24 00:13:23.281 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 151.87 0.07 891541.64 549.51 1011495.11 00:13:23.281 ======================================================== 00:13:23.281 Total : 324.58 0.16 967480.25 549.51 2003838.24 00:13:23.281 00:13:23.851 15:37:15 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:23.851 15:37:15 -- target/delete_subsystem.sh@35 -- # kill -0 838542 00:13:23.851 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (838542) - No such process 00:13:23.851 15:37:15 -- target/delete_subsystem.sh@45 -- # NOT wait 838542 00:13:23.851 15:37:15 -- common/autotest_common.sh@650 -- # local es=0 00:13:23.851 15:37:15 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 838542 00:13:23.851 15:37:15 -- common/autotest_common.sh@638 -- # local arg=wait 00:13:23.851 15:37:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:23.851 15:37:15 -- common/autotest_common.sh@642 -- # type -t wait 00:13:23.851 15:37:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:23.851 15:37:15 -- common/autotest_common.sh@653 -- # wait 838542 00:13:23.851 15:37:15 -- common/autotest_common.sh@653 -- # es=1 00:13:23.851 15:37:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:23.851 15:37:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:23.851 15:37:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:23.851 15:37:15 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:23.851 15:37:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.851 15:37:15 -- common/autotest_common.sh@10 -- # set +x 00:13:23.851 15:37:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.852 15:37:15 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:23.852 15:37:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.852 15:37:15 -- common/autotest_common.sh@10 -- # set +x 00:13:23.852 [2024-11-26 15:37:15.177321] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:23.852 15:37:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.852 15:37:15 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:23.852 15:37:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.852 15:37:15 -- common/autotest_common.sh@10 -- # set +x 00:13:23.852 15:37:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.852 15:37:15 -- target/delete_subsystem.sh@54 -- # perf_pid=838937 00:13:23.852 15:37:15 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:23.852 15:37:15 -- target/delete_subsystem.sh@57 -- # kill -0 838937 00:13:23.852 15:37:15 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:23.852 15:37:15 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:23.852 EAL: No free 2048 kB hugepages reported on node 1 00:13:23.852 [2024-11-26 15:37:15.239842] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:24.420 15:37:15 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:24.420 15:37:15 -- target/delete_subsystem.sh@57 -- # kill -0 838937 00:13:24.420 15:37:15 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:24.989 15:37:16 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:24.989 15:37:16 -- target/delete_subsystem.sh@57 -- # kill -0 838937 00:13:24.989 15:37:16 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:25.559 15:37:16 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:25.559 15:37:16 -- target/delete_subsystem.sh@57 -- # kill -0 838937 00:13:25.559 15:37:16 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:25.818 15:37:17 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:25.818 15:37:17 -- target/delete_subsystem.sh@57 -- # kill -0 838937 00:13:25.818 15:37:17 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:26.388 15:37:17 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:26.388 15:37:17 -- target/delete_subsystem.sh@57 -- # kill -0 838937 00:13:26.388 15:37:17 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:26.958 15:37:18 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:26.958 15:37:18 -- target/delete_subsystem.sh@57 -- # kill -0 838937 00:13:26.958 15:37:18 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:26.958 Initializing NVMe Controllers 00:13:26.958 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:26.958 Controller IO queue size 128, less than required. 00:13:26.958 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:26.958 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:26.958 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:26.958 Initialization complete. Launching workers. 00:13:26.958 ======================================================== 00:13:26.958 Latency(us) 00:13:26.958 Device Information : IOPS MiB/s Average min max 00:13:26.958 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1006443.02 1000186.64 1044779.25 00:13:26.958 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004473.21 1000260.15 1011777.06 00:13:26.958 ======================================================== 00:13:26.958 Total : 256.00 0.12 1005458.11 1000186.64 1044779.25 00:13:26.958 00:13:27.527 15:37:18 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:27.527 15:37:18 -- target/delete_subsystem.sh@57 -- # kill -0 838937 00:13:27.527 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (838937) - No such process 00:13:27.527 15:37:18 -- target/delete_subsystem.sh@67 -- # wait 838937 00:13:27.527 15:37:18 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:27.527 15:37:18 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:27.527 15:37:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:27.527 15:37:18 -- nvmf/common.sh@116 -- # sync 00:13:27.527 15:37:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:27.527 15:37:18 -- nvmf/common.sh@119 -- # set +e 00:13:27.527 15:37:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:27.527 15:37:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:27.527 rmmod nvme_tcp 00:13:27.527 rmmod nvme_fabrics 00:13:27.527 rmmod nvme_keyring 00:13:27.527 15:37:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:27.527 15:37:18 -- nvmf/common.sh@123 -- # set -e 00:13:27.527 15:37:18 -- nvmf/common.sh@124 -- # return 0 00:13:27.527 15:37:18 -- nvmf/common.sh@477 -- # '[' -n 838391 ']' 00:13:27.527 15:37:18 -- nvmf/common.sh@478 -- # killprocess 838391 00:13:27.527 15:37:18 -- common/autotest_common.sh@936 -- # '[' -z 838391 ']' 00:13:27.527 15:37:18 -- common/autotest_common.sh@940 -- # kill -0 838391 00:13:27.527 15:37:18 -- common/autotest_common.sh@941 -- # uname 00:13:27.527 15:37:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:27.527 15:37:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 838391 00:13:27.527 15:37:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:27.527 15:37:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:27.527 15:37:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 838391' 00:13:27.527 killing process with pid 838391 00:13:27.527 15:37:18 -- common/autotest_common.sh@955 -- # kill 838391 00:13:27.527 15:37:18 -- common/autotest_common.sh@960 -- # wait 838391 00:13:27.787 15:37:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:27.788 15:37:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:27.788 15:37:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:27.788 15:37:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:27.788 15:37:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:27.788 15:37:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:27.788 15:37:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:27.788 15:37:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:29.696 15:37:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:29.696 00:13:29.696 real 0m13.174s 00:13:29.696 user 0m29.483s 00:13:29.696 sys 0m3.022s 00:13:29.696 15:37:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:29.696 15:37:21 -- common/autotest_common.sh@10 -- # set +x 00:13:29.696 ************************************ 00:13:29.696 END TEST nvmf_delete_subsystem 00:13:29.696 ************************************ 00:13:29.696 15:37:21 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:13:29.696 15:37:21 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:29.696 15:37:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:29.696 15:37:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:29.696 15:37:21 -- common/autotest_common.sh@10 -- # set +x 00:13:29.696 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:13:29.696 ************************************ 00:13:29.696 START TEST nvmf_nvme_cli 00:13:29.696 ************************************ 00:13:29.696 15:37:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:29.955 * Looking for test storage... 00:13:29.955 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:29.955 15:37:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:29.955 15:37:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:29.955 15:37:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:29.955 15:37:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:29.955 15:37:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:29.955 15:37:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:29.955 15:37:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:29.955 15:37:21 -- scripts/common.sh@335 -- # IFS=.-: 00:13:29.955 15:37:21 -- scripts/common.sh@335 -- # read -ra ver1 00:13:29.956 15:37:21 -- scripts/common.sh@336 -- # IFS=.-: 00:13:29.956 15:37:21 -- scripts/common.sh@336 -- # read -ra ver2 00:13:29.956 15:37:21 -- scripts/common.sh@337 -- # local 'op=<' 00:13:29.956 15:37:21 -- scripts/common.sh@339 -- # ver1_l=2 00:13:29.956 15:37:21 -- scripts/common.sh@340 -- # ver2_l=1 00:13:29.956 15:37:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:29.956 15:37:21 -- scripts/common.sh@343 -- # case "$op" in 00:13:29.956 15:37:21 -- scripts/common.sh@344 -- # : 1 00:13:29.956 15:37:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:29.956 15:37:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:29.956 15:37:21 -- scripts/common.sh@364 -- # decimal 1 00:13:29.956 15:37:21 -- scripts/common.sh@352 -- # local d=1 00:13:29.956 15:37:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:29.956 15:37:21 -- scripts/common.sh@354 -- # echo 1 00:13:29.956 15:37:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:29.956 15:37:21 -- scripts/common.sh@365 -- # decimal 2 00:13:29.956 15:37:21 -- scripts/common.sh@352 -- # local d=2 00:13:29.956 15:37:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:29.956 15:37:21 -- scripts/common.sh@354 -- # echo 2 00:13:29.956 15:37:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:29.956 15:37:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:29.956 15:37:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:29.956 15:37:21 -- scripts/common.sh@367 -- # return 0 00:13:29.956 15:37:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:29.956 15:37:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:29.956 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:29.956 --rc genhtml_branch_coverage=1 00:13:29.956 --rc genhtml_function_coverage=1 00:13:29.956 --rc genhtml_legend=1 00:13:29.956 --rc geninfo_all_blocks=1 00:13:29.956 --rc geninfo_unexecuted_blocks=1 00:13:29.956 00:13:29.956 ' 00:13:29.956 15:37:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:29.956 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:29.956 --rc genhtml_branch_coverage=1 00:13:29.956 --rc genhtml_function_coverage=1 00:13:29.956 --rc genhtml_legend=1 00:13:29.956 --rc geninfo_all_blocks=1 00:13:29.956 --rc geninfo_unexecuted_blocks=1 00:13:29.956 00:13:29.956 ' 00:13:29.956 15:37:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:29.956 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:29.956 --rc genhtml_branch_coverage=1 00:13:29.956 --rc genhtml_function_coverage=1 00:13:29.956 --rc genhtml_legend=1 00:13:29.956 --rc geninfo_all_blocks=1 00:13:29.956 --rc geninfo_unexecuted_blocks=1 00:13:29.956 00:13:29.956 ' 00:13:29.956 15:37:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:29.956 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:29.956 --rc genhtml_branch_coverage=1 00:13:29.956 --rc genhtml_function_coverage=1 00:13:29.956 --rc genhtml_legend=1 00:13:29.956 --rc geninfo_all_blocks=1 00:13:29.956 --rc geninfo_unexecuted_blocks=1 00:13:29.956 00:13:29.956 ' 00:13:29.956 15:37:21 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:29.956 15:37:21 -- nvmf/common.sh@7 -- # uname -s 00:13:29.956 15:37:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:29.956 15:37:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:29.956 15:37:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:29.956 15:37:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:29.956 15:37:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:29.956 15:37:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:29.956 15:37:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:29.956 15:37:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:29.956 15:37:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:29.956 15:37:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:29.956 15:37:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:29.956 15:37:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:29.956 15:37:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:29.956 15:37:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:29.956 15:37:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:29.956 15:37:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:29.956 15:37:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:29.956 15:37:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:29.956 15:37:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:29.956 15:37:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.956 15:37:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.956 15:37:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.956 15:37:21 -- paths/export.sh@5 -- # export PATH 00:13:29.956 15:37:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.956 15:37:21 -- nvmf/common.sh@46 -- # : 0 00:13:29.956 15:37:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:29.956 15:37:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:29.956 15:37:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:29.956 15:37:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:29.956 15:37:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:29.956 15:37:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:29.956 15:37:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:29.956 15:37:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:29.956 15:37:21 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:29.956 15:37:21 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:29.956 15:37:21 -- target/nvme_cli.sh@14 -- # devs=() 00:13:29.956 15:37:21 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:13:29.956 15:37:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:29.956 15:37:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:29.956 15:37:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:29.956 15:37:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:29.956 15:37:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:29.956 15:37:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:29.956 15:37:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:29.956 15:37:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:29.956 15:37:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:29.956 15:37:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:29.956 15:37:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:29.956 15:37:21 -- common/autotest_common.sh@10 -- # set +x 00:13:32.493 15:37:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:32.493 15:37:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:32.493 15:37:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:32.493 15:37:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:32.493 15:37:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:32.493 15:37:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:32.493 15:37:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:32.493 15:37:23 -- nvmf/common.sh@294 -- # net_devs=() 00:13:32.493 15:37:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:32.493 15:37:23 -- nvmf/common.sh@295 -- # e810=() 00:13:32.493 15:37:23 -- nvmf/common.sh@295 -- # local -ga e810 00:13:32.493 15:37:23 -- nvmf/common.sh@296 -- # x722=() 00:13:32.493 15:37:23 -- nvmf/common.sh@296 -- # local -ga x722 00:13:32.493 15:37:23 -- nvmf/common.sh@297 -- # mlx=() 00:13:32.493 15:37:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:32.493 15:37:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:32.493 15:37:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:32.493 15:37:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:32.493 15:37:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:32.493 15:37:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:32.493 15:37:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:32.493 15:37:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:32.493 15:37:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:32.493 15:37:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:32.493 15:37:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:32.493 15:37:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:32.493 15:37:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:32.493 15:37:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:32.493 15:37:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:32.493 15:37:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:32.493 15:37:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:32.493 15:37:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:32.493 15:37:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:32.493 15:37:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:32.493 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:32.493 15:37:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:32.493 15:37:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:32.493 15:37:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:32.493 15:37:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:32.493 15:37:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:32.494 15:37:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:32.494 15:37:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:32.494 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:32.494 15:37:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:32.494 15:37:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:32.494 15:37:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:32.494 15:37:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:32.494 15:37:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:32.494 15:37:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:32.494 15:37:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:32.494 15:37:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:32.494 15:37:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:32.494 15:37:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:32.494 15:37:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:32.494 15:37:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:32.494 15:37:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:32.494 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:32.494 15:37:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:32.494 15:37:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:32.494 15:37:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:32.494 15:37:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:32.494 15:37:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:32.494 15:37:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:32.494 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:32.494 15:37:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:32.494 15:37:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:32.494 15:37:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:32.494 15:37:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:32.494 15:37:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:32.494 15:37:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:32.494 15:37:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:32.494 15:37:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:32.494 15:37:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:32.494 15:37:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:32.494 15:37:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:32.494 15:37:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:32.494 15:37:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:32.494 15:37:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:32.494 15:37:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:32.494 15:37:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:32.494 15:37:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:32.494 15:37:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:32.494 15:37:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:32.494 15:37:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:32.494 15:37:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:32.494 15:37:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:32.494 15:37:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:32.494 15:37:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:32.494 15:37:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:32.494 15:37:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:32.494 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:32.494 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:13:32.494 00:13:32.494 --- 10.0.0.2 ping statistics --- 00:13:32.494 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:32.494 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:13:32.494 15:37:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:32.494 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:32.494 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:13:32.494 00:13:32.494 --- 10.0.0.1 ping statistics --- 00:13:32.494 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:32.494 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:13:32.494 15:37:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:32.494 15:37:23 -- nvmf/common.sh@410 -- # return 0 00:13:32.494 15:37:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:32.494 15:37:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:32.494 15:37:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:32.494 15:37:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:32.494 15:37:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:32.494 15:37:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:32.494 15:37:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:32.494 15:37:23 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:13:32.494 15:37:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:32.494 15:37:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:32.494 15:37:23 -- common/autotest_common.sh@10 -- # set +x 00:13:32.494 15:37:23 -- nvmf/common.sh@469 -- # nvmfpid=841381 00:13:32.494 15:37:23 -- nvmf/common.sh@470 -- # waitforlisten 841381 00:13:32.494 15:37:23 -- common/autotest_common.sh@829 -- # '[' -z 841381 ']' 00:13:32.494 15:37:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:32.494 15:37:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:32.494 15:37:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:32.494 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:32.494 15:37:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:32.494 15:37:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:32.494 15:37:23 -- common/autotest_common.sh@10 -- # set +x 00:13:32.494 [2024-11-26 15:37:23.665145] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:32.494 [2024-11-26 15:37:23.665221] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:32.494 EAL: No free 2048 kB hugepages reported on node 1 00:13:32.494 [2024-11-26 15:37:23.733470] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:32.494 [2024-11-26 15:37:23.848742] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:32.494 [2024-11-26 15:37:23.848926] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:32.494 [2024-11-26 15:37:23.848955] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:32.494 [2024-11-26 15:37:23.848977] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:32.494 [2024-11-26 15:37:23.849073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:32.494 [2024-11-26 15:37:23.849145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:32.494 [2024-11-26 15:37:23.849180] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:32.494 [2024-11-26 15:37:23.849187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:33.434 15:37:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:33.434 15:37:24 -- common/autotest_common.sh@862 -- # return 0 00:13:33.434 15:37:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:33.434 15:37:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:33.434 15:37:24 -- common/autotest_common.sh@10 -- # set +x 00:13:33.434 15:37:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:33.434 15:37:24 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:33.434 15:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.434 15:37:24 -- common/autotest_common.sh@10 -- # set +x 00:13:33.434 [2024-11-26 15:37:24.655248] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:33.434 15:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.434 15:37:24 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:33.434 15:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.434 15:37:24 -- common/autotest_common.sh@10 -- # set +x 00:13:33.434 Malloc0 00:13:33.434 15:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.434 15:37:24 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:33.434 15:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.434 15:37:24 -- common/autotest_common.sh@10 -- # set +x 00:13:33.434 Malloc1 00:13:33.434 15:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.434 15:37:24 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:13:33.434 15:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.434 15:37:24 -- common/autotest_common.sh@10 -- # set +x 00:13:33.434 15:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.434 15:37:24 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:33.435 15:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.435 15:37:24 -- common/autotest_common.sh@10 -- # set +x 00:13:33.435 15:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.435 15:37:24 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:33.435 15:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.435 15:37:24 -- common/autotest_common.sh@10 -- # set +x 00:13:33.435 15:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.435 15:37:24 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:33.435 15:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.435 15:37:24 -- common/autotest_common.sh@10 -- # set +x 00:13:33.435 [2024-11-26 15:37:24.741323] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:33.435 15:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.435 15:37:24 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:33.435 15:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.435 15:37:24 -- common/autotest_common.sh@10 -- # set +x 00:13:33.435 15:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.435 15:37:24 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:13:33.435 00:13:33.435 Discovery Log Number of Records 2, Generation counter 2 00:13:33.435 =====Discovery Log Entry 0====== 00:13:33.435 trtype: tcp 00:13:33.435 adrfam: ipv4 00:13:33.435 subtype: current discovery subsystem 00:13:33.435 treq: not required 00:13:33.435 portid: 0 00:13:33.435 trsvcid: 4420 00:13:33.435 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:13:33.435 traddr: 10.0.0.2 00:13:33.435 eflags: explicit discovery connections, duplicate discovery information 00:13:33.435 sectype: none 00:13:33.435 =====Discovery Log Entry 1====== 00:13:33.435 trtype: tcp 00:13:33.435 adrfam: ipv4 00:13:33.435 subtype: nvme subsystem 00:13:33.435 treq: not required 00:13:33.435 portid: 0 00:13:33.435 trsvcid: 4420 00:13:33.435 subnqn: nqn.2016-06.io.spdk:cnode1 00:13:33.435 traddr: 10.0.0.2 00:13:33.435 eflags: none 00:13:33.435 sectype: none 00:13:33.435 15:37:24 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:13:33.435 15:37:24 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:13:33.435 15:37:24 -- nvmf/common.sh@510 -- # local dev _ 00:13:33.435 15:37:24 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:33.435 15:37:24 -- nvmf/common.sh@509 -- # nvme list 00:13:33.694 15:37:24 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:33.694 15:37:24 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:33.694 15:37:24 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:33.695 15:37:24 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:33.695 15:37:24 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:13:33.695 15:37:24 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:34.263 15:37:25 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:13:34.264 15:37:25 -- common/autotest_common.sh@1187 -- # local i=0 00:13:34.264 15:37:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:34.264 15:37:25 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:13:34.264 15:37:25 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:13:34.264 15:37:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:36.170 15:37:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:36.170 15:37:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:36.170 15:37:27 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:36.170 15:37:27 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:13:36.170 15:37:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:36.170 15:37:27 -- common/autotest_common.sh@1197 -- # return 0 00:13:36.170 15:37:27 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:13:36.170 15:37:27 -- nvmf/common.sh@510 -- # local dev _ 00:13:36.170 15:37:27 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.170 15:37:27 -- nvmf/common.sh@509 -- # nvme list 00:13:36.170 15:37:27 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:36.170 15:37:27 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.170 15:37:27 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:36.170 15:37:27 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.170 15:37:27 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:36.170 15:37:27 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:36.170 15:37:27 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.170 15:37:27 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:36.170 15:37:27 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:36.170 15:37:27 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.170 15:37:27 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:13:36.170 /dev/nvme0n2 ]] 00:13:36.170 15:37:27 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:13:36.170 15:37:27 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:13:36.170 15:37:27 -- nvmf/common.sh@510 -- # local dev _ 00:13:36.170 15:37:27 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.170 15:37:27 -- nvmf/common.sh@509 -- # nvme list 00:13:36.170 15:37:27 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:36.170 15:37:27 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.170 15:37:27 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:36.170 15:37:27 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.170 15:37:27 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:36.170 15:37:27 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:36.170 15:37:27 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.171 15:37:27 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:36.171 15:37:27 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:36.171 15:37:27 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.171 15:37:27 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:13:36.171 15:37:27 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:36.429 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:36.429 15:37:27 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:36.429 15:37:27 -- common/autotest_common.sh@1208 -- # local i=0 00:13:36.429 15:37:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:36.429 15:37:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:36.429 15:37:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:36.429 15:37:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:36.429 15:37:27 -- common/autotest_common.sh@1220 -- # return 0 00:13:36.429 15:37:27 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:13:36.429 15:37:27 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:36.429 15:37:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.429 15:37:27 -- common/autotest_common.sh@10 -- # set +x 00:13:36.429 15:37:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.429 15:37:27 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:36.429 15:37:27 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:13:36.429 15:37:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:36.429 15:37:27 -- nvmf/common.sh@116 -- # sync 00:13:36.429 15:37:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:36.429 15:37:27 -- nvmf/common.sh@119 -- # set +e 00:13:36.429 15:37:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:36.429 15:37:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:36.429 rmmod nvme_tcp 00:13:36.429 rmmod nvme_fabrics 00:13:36.429 rmmod nvme_keyring 00:13:36.429 15:37:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:36.429 15:37:27 -- nvmf/common.sh@123 -- # set -e 00:13:36.429 15:37:27 -- nvmf/common.sh@124 -- # return 0 00:13:36.430 15:37:27 -- nvmf/common.sh@477 -- # '[' -n 841381 ']' 00:13:36.430 15:37:27 -- nvmf/common.sh@478 -- # killprocess 841381 00:13:36.430 15:37:27 -- common/autotest_common.sh@936 -- # '[' -z 841381 ']' 00:13:36.430 15:37:27 -- common/autotest_common.sh@940 -- # kill -0 841381 00:13:36.430 15:37:27 -- common/autotest_common.sh@941 -- # uname 00:13:36.430 15:37:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:36.430 15:37:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 841381 00:13:36.430 15:37:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:36.430 15:37:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:36.430 15:37:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 841381' 00:13:36.430 killing process with pid 841381 00:13:36.430 15:37:27 -- common/autotest_common.sh@955 -- # kill 841381 00:13:36.430 15:37:27 -- common/autotest_common.sh@960 -- # wait 841381 00:13:36.689 15:37:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:36.689 15:37:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:36.689 15:37:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:36.689 15:37:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:36.689 15:37:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:36.689 15:37:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:36.689 15:37:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:36.689 15:37:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:39.227 15:37:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:39.227 00:13:39.227 real 0m8.985s 00:13:39.227 user 0m17.489s 00:13:39.227 sys 0m2.384s 00:13:39.227 15:37:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:39.227 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:13:39.227 ************************************ 00:13:39.227 END TEST nvmf_nvme_cli 00:13:39.227 ************************************ 00:13:39.227 15:37:30 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:13:39.227 15:37:30 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:39.227 15:37:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:39.227 15:37:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:39.227 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:13:39.227 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:13:39.227 ************************************ 00:13:39.227 START TEST nvmf_host_management 00:13:39.227 ************************************ 00:13:39.227 15:37:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:39.227 * Looking for test storage... 00:13:39.227 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:39.227 15:37:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:39.227 15:37:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:39.227 15:37:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:39.227 15:37:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:39.227 15:37:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:39.227 15:37:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:39.227 15:37:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:39.227 15:37:30 -- scripts/common.sh@335 -- # IFS=.-: 00:13:39.227 15:37:30 -- scripts/common.sh@335 -- # read -ra ver1 00:13:39.227 15:37:30 -- scripts/common.sh@336 -- # IFS=.-: 00:13:39.227 15:37:30 -- scripts/common.sh@336 -- # read -ra ver2 00:13:39.227 15:37:30 -- scripts/common.sh@337 -- # local 'op=<' 00:13:39.227 15:37:30 -- scripts/common.sh@339 -- # ver1_l=2 00:13:39.227 15:37:30 -- scripts/common.sh@340 -- # ver2_l=1 00:13:39.227 15:37:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:39.227 15:37:30 -- scripts/common.sh@343 -- # case "$op" in 00:13:39.227 15:37:30 -- scripts/common.sh@344 -- # : 1 00:13:39.227 15:37:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:39.227 15:37:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:39.227 15:37:30 -- scripts/common.sh@364 -- # decimal 1 00:13:39.227 15:37:30 -- scripts/common.sh@352 -- # local d=1 00:13:39.227 15:37:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:39.227 15:37:30 -- scripts/common.sh@354 -- # echo 1 00:13:39.227 15:37:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:39.227 15:37:30 -- scripts/common.sh@365 -- # decimal 2 00:13:39.227 15:37:30 -- scripts/common.sh@352 -- # local d=2 00:13:39.227 15:37:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:39.227 15:37:30 -- scripts/common.sh@354 -- # echo 2 00:13:39.227 15:37:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:39.227 15:37:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:39.227 15:37:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:39.227 15:37:30 -- scripts/common.sh@367 -- # return 0 00:13:39.227 15:37:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:39.227 15:37:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:39.227 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.227 --rc genhtml_branch_coverage=1 00:13:39.227 --rc genhtml_function_coverage=1 00:13:39.227 --rc genhtml_legend=1 00:13:39.227 --rc geninfo_all_blocks=1 00:13:39.227 --rc geninfo_unexecuted_blocks=1 00:13:39.227 00:13:39.227 ' 00:13:39.227 15:37:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:39.227 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.227 --rc genhtml_branch_coverage=1 00:13:39.227 --rc genhtml_function_coverage=1 00:13:39.227 --rc genhtml_legend=1 00:13:39.227 --rc geninfo_all_blocks=1 00:13:39.228 --rc geninfo_unexecuted_blocks=1 00:13:39.228 00:13:39.228 ' 00:13:39.228 15:37:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:39.228 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.228 --rc genhtml_branch_coverage=1 00:13:39.228 --rc genhtml_function_coverage=1 00:13:39.228 --rc genhtml_legend=1 00:13:39.228 --rc geninfo_all_blocks=1 00:13:39.228 --rc geninfo_unexecuted_blocks=1 00:13:39.228 00:13:39.228 ' 00:13:39.228 15:37:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:39.228 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.228 --rc genhtml_branch_coverage=1 00:13:39.228 --rc genhtml_function_coverage=1 00:13:39.228 --rc genhtml_legend=1 00:13:39.228 --rc geninfo_all_blocks=1 00:13:39.228 --rc geninfo_unexecuted_blocks=1 00:13:39.228 00:13:39.228 ' 00:13:39.228 15:37:30 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:39.228 15:37:30 -- nvmf/common.sh@7 -- # uname -s 00:13:39.228 15:37:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:39.228 15:37:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:39.228 15:37:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:39.228 15:37:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:39.228 15:37:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:39.228 15:37:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:39.228 15:37:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:39.228 15:37:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:39.228 15:37:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:39.228 15:37:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:39.228 15:37:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:39.228 15:37:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:39.228 15:37:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:39.228 15:37:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:39.228 15:37:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:39.228 15:37:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:39.228 15:37:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:39.228 15:37:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:39.228 15:37:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:39.228 15:37:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.228 15:37:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.228 15:37:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.228 15:37:30 -- paths/export.sh@5 -- # export PATH 00:13:39.228 15:37:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.228 15:37:30 -- nvmf/common.sh@46 -- # : 0 00:13:39.228 15:37:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:39.228 15:37:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:39.228 15:37:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:39.228 15:37:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:39.228 15:37:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:39.228 15:37:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:39.228 15:37:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:39.228 15:37:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:39.228 15:37:30 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:39.228 15:37:30 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:39.228 15:37:30 -- target/host_management.sh@104 -- # nvmftestinit 00:13:39.228 15:37:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:39.228 15:37:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:39.228 15:37:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:39.228 15:37:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:39.228 15:37:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:39.228 15:37:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:39.228 15:37:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:39.228 15:37:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:39.228 15:37:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:39.228 15:37:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:39.228 15:37:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:39.228 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:13:41.135 15:37:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:41.135 15:37:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:41.135 15:37:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:41.135 15:37:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:41.135 15:37:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:41.135 15:37:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:41.135 15:37:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:41.135 15:37:32 -- nvmf/common.sh@294 -- # net_devs=() 00:13:41.135 15:37:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:41.135 15:37:32 -- nvmf/common.sh@295 -- # e810=() 00:13:41.135 15:37:32 -- nvmf/common.sh@295 -- # local -ga e810 00:13:41.135 15:37:32 -- nvmf/common.sh@296 -- # x722=() 00:13:41.135 15:37:32 -- nvmf/common.sh@296 -- # local -ga x722 00:13:41.135 15:37:32 -- nvmf/common.sh@297 -- # mlx=() 00:13:41.135 15:37:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:41.135 15:37:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:41.135 15:37:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:41.135 15:37:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:41.135 15:37:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:41.135 15:37:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:41.135 15:37:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:41.135 15:37:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:41.135 15:37:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:41.135 15:37:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:41.135 15:37:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:41.135 15:37:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:41.135 15:37:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:41.135 15:37:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:41.135 15:37:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:41.135 15:37:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:41.135 15:37:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:41.135 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:41.135 15:37:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:41.135 15:37:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:41.135 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:41.135 15:37:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:41.135 15:37:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:41.135 15:37:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:41.135 15:37:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:41.135 15:37:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:41.135 15:37:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:41.135 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:41.135 15:37:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:41.135 15:37:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:41.135 15:37:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:41.135 15:37:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:41.135 15:37:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:41.135 15:37:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:41.135 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:41.135 15:37:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:41.135 15:37:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:41.135 15:37:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:41.135 15:37:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:41.135 15:37:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:41.135 15:37:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:41.135 15:37:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:41.135 15:37:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:41.135 15:37:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:41.135 15:37:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:41.135 15:37:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:41.135 15:37:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:41.135 15:37:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:41.135 15:37:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:41.135 15:37:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:41.135 15:37:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:41.135 15:37:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:41.135 15:37:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:41.135 15:37:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:41.135 15:37:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:41.135 15:37:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:41.135 15:37:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:41.135 15:37:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:41.135 15:37:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:41.135 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:41.135 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.266 ms 00:13:41.135 00:13:41.135 --- 10.0.0.2 ping statistics --- 00:13:41.135 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:41.135 rtt min/avg/max/mdev = 0.266/0.266/0.266/0.000 ms 00:13:41.135 15:37:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:41.135 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:41.135 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:13:41.135 00:13:41.135 --- 10.0.0.1 ping statistics --- 00:13:41.135 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:41.135 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:13:41.135 15:37:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:41.135 15:37:32 -- nvmf/common.sh@410 -- # return 0 00:13:41.135 15:37:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:41.135 15:37:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:41.135 15:37:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:41.135 15:37:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:41.135 15:37:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:41.135 15:37:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:41.135 15:37:32 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:13:41.135 15:37:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:13:41.135 15:37:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:41.135 15:37:32 -- common/autotest_common.sh@10 -- # set +x 00:13:41.135 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:13:41.135 ************************************ 00:13:41.135 START TEST nvmf_host_management 00:13:41.135 ************************************ 00:13:41.135 15:37:32 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:13:41.135 15:37:32 -- target/host_management.sh@69 -- # starttarget 00:13:41.135 15:37:32 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:13:41.135 15:37:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:41.135 15:37:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:41.135 15:37:32 -- common/autotest_common.sh@10 -- # set +x 00:13:41.135 15:37:32 -- nvmf/common.sh@469 -- # nvmfpid=843869 00:13:41.135 15:37:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:13:41.135 15:37:32 -- nvmf/common.sh@470 -- # waitforlisten 843869 00:13:41.135 15:37:32 -- common/autotest_common.sh@829 -- # '[' -z 843869 ']' 00:13:41.135 15:37:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:41.135 15:37:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:41.135 15:37:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:41.135 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:41.135 15:37:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:41.135 15:37:32 -- common/autotest_common.sh@10 -- # set +x 00:13:41.395 [2024-11-26 15:37:32.618588] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:41.395 [2024-11-26 15:37:32.618668] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:41.395 EAL: No free 2048 kB hugepages reported on node 1 00:13:41.395 [2024-11-26 15:37:32.684752] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:41.395 [2024-11-26 15:37:32.799691] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:41.395 [2024-11-26 15:37:32.799867] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:41.395 [2024-11-26 15:37:32.799889] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:41.395 [2024-11-26 15:37:32.799904] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:41.395 [2024-11-26 15:37:32.800013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:41.395 [2024-11-26 15:37:32.800111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:41.395 [2024-11-26 15:37:32.800182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:41.395 [2024-11-26 15:37:32.800180] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:13:42.330 15:37:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:42.330 15:37:33 -- common/autotest_common.sh@862 -- # return 0 00:13:42.330 15:37:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:42.330 15:37:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:42.330 15:37:33 -- common/autotest_common.sh@10 -- # set +x 00:13:42.330 15:37:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:42.330 15:37:33 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:42.330 15:37:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.330 15:37:33 -- common/autotest_common.sh@10 -- # set +x 00:13:42.330 [2024-11-26 15:37:33.599201] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:42.330 15:37:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.330 15:37:33 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:13:42.330 15:37:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:42.330 15:37:33 -- common/autotest_common.sh@10 -- # set +x 00:13:42.330 15:37:33 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:42.330 15:37:33 -- target/host_management.sh@23 -- # cat 00:13:42.330 15:37:33 -- target/host_management.sh@30 -- # rpc_cmd 00:13:42.330 15:37:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.330 15:37:33 -- common/autotest_common.sh@10 -- # set +x 00:13:42.330 Malloc0 00:13:42.330 [2024-11-26 15:37:33.658355] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:42.330 15:37:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.330 15:37:33 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:13:42.330 15:37:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:42.331 15:37:33 -- common/autotest_common.sh@10 -- # set +x 00:13:42.331 15:37:33 -- target/host_management.sh@73 -- # perfpid=844044 00:13:42.331 15:37:33 -- target/host_management.sh@74 -- # waitforlisten 844044 /var/tmp/bdevperf.sock 00:13:42.331 15:37:33 -- common/autotest_common.sh@829 -- # '[' -z 844044 ']' 00:13:42.331 15:37:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:42.331 15:37:33 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:13:42.331 15:37:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:42.331 15:37:33 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:13:42.331 15:37:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:42.331 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:42.331 15:37:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:42.331 15:37:33 -- nvmf/common.sh@520 -- # config=() 00:13:42.331 15:37:33 -- common/autotest_common.sh@10 -- # set +x 00:13:42.331 15:37:33 -- nvmf/common.sh@520 -- # local subsystem config 00:13:42.331 15:37:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:42.331 15:37:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:42.331 { 00:13:42.331 "params": { 00:13:42.331 "name": "Nvme$subsystem", 00:13:42.331 "trtype": "$TEST_TRANSPORT", 00:13:42.331 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:42.331 "adrfam": "ipv4", 00:13:42.331 "trsvcid": "$NVMF_PORT", 00:13:42.331 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:42.331 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:42.331 "hdgst": ${hdgst:-false}, 00:13:42.331 "ddgst": ${ddgst:-false} 00:13:42.331 }, 00:13:42.331 "method": "bdev_nvme_attach_controller" 00:13:42.331 } 00:13:42.331 EOF 00:13:42.331 )") 00:13:42.331 15:37:33 -- nvmf/common.sh@542 -- # cat 00:13:42.331 15:37:33 -- nvmf/common.sh@544 -- # jq . 00:13:42.331 15:37:33 -- nvmf/common.sh@545 -- # IFS=, 00:13:42.331 15:37:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:42.331 "params": { 00:13:42.331 "name": "Nvme0", 00:13:42.331 "trtype": "tcp", 00:13:42.331 "traddr": "10.0.0.2", 00:13:42.331 "adrfam": "ipv4", 00:13:42.331 "trsvcid": "4420", 00:13:42.331 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:42.331 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:42.331 "hdgst": false, 00:13:42.331 "ddgst": false 00:13:42.331 }, 00:13:42.331 "method": "bdev_nvme_attach_controller" 00:13:42.331 }' 00:13:42.331 [2024-11-26 15:37:33.731915] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:42.331 [2024-11-26 15:37:33.732017] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid844044 ] 00:13:42.331 EAL: No free 2048 kB hugepages reported on node 1 00:13:42.590 [2024-11-26 15:37:33.793784] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:42.590 [2024-11-26 15:37:33.901481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:42.851 Running I/O for 10 seconds... 00:13:43.422 15:37:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:43.422 15:37:34 -- common/autotest_common.sh@862 -- # return 0 00:13:43.422 15:37:34 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:13:43.422 15:37:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.422 15:37:34 -- common/autotest_common.sh@10 -- # set +x 00:13:43.422 15:37:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.422 15:37:34 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:43.422 15:37:34 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:13:43.422 15:37:34 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:13:43.422 15:37:34 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:13:43.422 15:37:34 -- target/host_management.sh@52 -- # local ret=1 00:13:43.422 15:37:34 -- target/host_management.sh@53 -- # local i 00:13:43.422 15:37:34 -- target/host_management.sh@54 -- # (( i = 10 )) 00:13:43.422 15:37:34 -- target/host_management.sh@54 -- # (( i != 0 )) 00:13:43.422 15:37:34 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:13:43.422 15:37:34 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:13:43.422 15:37:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.422 15:37:34 -- common/autotest_common.sh@10 -- # set +x 00:13:43.422 15:37:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.422 15:37:34 -- target/host_management.sh@55 -- # read_io_count=1779 00:13:43.422 15:37:34 -- target/host_management.sh@58 -- # '[' 1779 -ge 100 ']' 00:13:43.422 15:37:34 -- target/host_management.sh@59 -- # ret=0 00:13:43.422 15:37:34 -- target/host_management.sh@60 -- # break 00:13:43.422 15:37:34 -- target/host_management.sh@64 -- # return 0 00:13:43.422 15:37:34 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:43.422 15:37:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.422 15:37:34 -- common/autotest_common.sh@10 -- # set +x 00:13:43.422 [2024-11-26 15:37:34.742092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.422 [2024-11-26 15:37:34.742444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.742810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe03e60 is same with the state(5) to be set 00:13:43.423 [2024-11-26 15:37:34.743070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:116608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:116992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:117120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:117248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:117376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:111232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:111360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:111488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:117504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:117632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:117760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:117888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:118016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:118144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:112128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:112256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.743950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.743987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:118272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.744012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.744039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:118400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.744065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.744093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:112384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.744116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.744146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:118528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.744172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.744220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:118656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.744245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.744272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:118784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.744295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.744322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:112768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.744345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.744371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:118912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.744394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.744421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:119040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.744444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.423 [2024-11-26 15:37:34.744471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:119168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.423 [2024-11-26 15:37:34.744493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.744520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:119296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.744543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.744569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:113024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.744592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.744618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:119424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.744641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.744681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:119552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.744714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.744740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:113408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.744766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.744792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:113792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.744818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.744844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:119680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.744875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.744902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:119808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.744927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.744953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:119936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.744995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:120064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:120192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:120320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:120448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:120576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:120704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:120832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:114176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:120960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:121088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:114432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:121216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:121344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:114688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:115072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:115200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:121472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:115456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.745956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:121600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.745981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.746013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:121728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.746036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.746062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:121856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.746089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.746114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:121984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.746146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.746175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:122112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.746206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.746233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:115968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.746257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.746284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:116224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.746307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.746335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:122240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.746358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.746385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:122368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.746407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 15:37:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.424 [2024-11-26 15:37:34.746435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:116352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.746462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.746490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:116480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:43.424 [2024-11-26 15:37:34.746512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:43.424 [2024-11-26 15:37:34.746537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22ed030 is same with the state(5) to be set 00:13:43.424 15:37:34 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:43.425 [2024-11-26 15:37:34.746630] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x22ed030 was disconnected and freed. reset controller. 00:13:43.425 15:37:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.425 15:37:34 -- common/autotest_common.sh@10 -- # set +x 00:13:43.425 [2024-11-26 15:37:34.748067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:13:43.425 task offset: 116608 on job bdev=Nvme0n1 fails 00:13:43.425 00:13:43.425 Latency(us) 00:13:43.425 [2024-11-26T14:37:34.878Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:43.425 [2024-11-26T14:37:34.878Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:43.425 [2024-11-26T14:37:34.878Z] Job: Nvme0n1 ended in about 0.50 seconds with error 00:13:43.425 Verification LBA range: start 0x0 length 0x400 00:13:43.425 Nvme0n1 : 0.50 3819.65 238.73 127.52 0.00 15942.24 4296.25 21359.88 00:13:43.425 [2024-11-26T14:37:34.878Z] =================================================================================================================== 00:13:43.425 [2024-11-26T14:37:34.878Z] Total : 3819.65 238.73 127.52 0.00 15942.24 4296.25 21359.88 00:13:43.425 [2024-11-26 15:37:34.750305] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:13:43.425 [2024-11-26 15:37:34.750343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22ef160 (9): Bad file descriptor 00:13:43.425 15:37:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.425 15:37:34 -- target/host_management.sh@87 -- # sleep 1 00:13:43.425 [2024-11-26 15:37:34.795254] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:13:44.365 15:37:35 -- target/host_management.sh@91 -- # kill -9 844044 00:13:44.365 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (844044) - No such process 00:13:44.365 15:37:35 -- target/host_management.sh@91 -- # true 00:13:44.365 15:37:35 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:13:44.365 15:37:35 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:13:44.365 15:37:35 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:13:44.365 15:37:35 -- nvmf/common.sh@520 -- # config=() 00:13:44.365 15:37:35 -- nvmf/common.sh@520 -- # local subsystem config 00:13:44.365 15:37:35 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:44.365 15:37:35 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:44.365 { 00:13:44.365 "params": { 00:13:44.365 "name": "Nvme$subsystem", 00:13:44.365 "trtype": "$TEST_TRANSPORT", 00:13:44.365 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:44.365 "adrfam": "ipv4", 00:13:44.365 "trsvcid": "$NVMF_PORT", 00:13:44.365 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:44.365 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:44.365 "hdgst": ${hdgst:-false}, 00:13:44.365 "ddgst": ${ddgst:-false} 00:13:44.365 }, 00:13:44.365 "method": "bdev_nvme_attach_controller" 00:13:44.365 } 00:13:44.365 EOF 00:13:44.365 )") 00:13:44.365 15:37:35 -- nvmf/common.sh@542 -- # cat 00:13:44.365 15:37:35 -- nvmf/common.sh@544 -- # jq . 00:13:44.365 15:37:35 -- nvmf/common.sh@545 -- # IFS=, 00:13:44.365 15:37:35 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:44.365 "params": { 00:13:44.365 "name": "Nvme0", 00:13:44.365 "trtype": "tcp", 00:13:44.365 "traddr": "10.0.0.2", 00:13:44.365 "adrfam": "ipv4", 00:13:44.365 "trsvcid": "4420", 00:13:44.365 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:44.365 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:44.365 "hdgst": false, 00:13:44.365 "ddgst": false 00:13:44.365 }, 00:13:44.365 "method": "bdev_nvme_attach_controller" 00:13:44.365 }' 00:13:44.365 [2024-11-26 15:37:35.800432] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:44.365 [2024-11-26 15:37:35.800510] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid844210 ] 00:13:44.622 EAL: No free 2048 kB hugepages reported on node 1 00:13:44.622 [2024-11-26 15:37:35.865067] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:44.622 [2024-11-26 15:37:35.971588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:44.880 Running I/O for 1 seconds... 00:13:46.259 00:13:46.259 Latency(us) 00:13:46.259 [2024-11-26T14:37:37.712Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:46.259 [2024-11-26T14:37:37.712Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:46.259 Verification LBA range: start 0x0 length 0x400 00:13:46.259 Nvme0n1 : 1.01 3685.19 230.32 0.00 0.00 17112.86 2002.49 21262.79 00:13:46.259 [2024-11-26T14:37:37.712Z] =================================================================================================================== 00:13:46.259 [2024-11-26T14:37:37.712Z] Total : 3685.19 230.32 0.00 0.00 17112.86 2002.49 21262.79 00:13:46.259 15:37:37 -- target/host_management.sh@101 -- # stoptarget 00:13:46.259 15:37:37 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:13:46.259 15:37:37 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:13:46.259 15:37:37 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:46.259 15:37:37 -- target/host_management.sh@40 -- # nvmftestfini 00:13:46.259 15:37:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:46.259 15:37:37 -- nvmf/common.sh@116 -- # sync 00:13:46.259 15:37:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:46.259 15:37:37 -- nvmf/common.sh@119 -- # set +e 00:13:46.259 15:37:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:46.259 15:37:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:46.259 rmmod nvme_tcp 00:13:46.259 rmmod nvme_fabrics 00:13:46.259 rmmod nvme_keyring 00:13:46.259 15:37:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:46.259 15:37:37 -- nvmf/common.sh@123 -- # set -e 00:13:46.259 15:37:37 -- nvmf/common.sh@124 -- # return 0 00:13:46.259 15:37:37 -- nvmf/common.sh@477 -- # '[' -n 843869 ']' 00:13:46.259 15:37:37 -- nvmf/common.sh@478 -- # killprocess 843869 00:13:46.259 15:37:37 -- common/autotest_common.sh@936 -- # '[' -z 843869 ']' 00:13:46.259 15:37:37 -- common/autotest_common.sh@940 -- # kill -0 843869 00:13:46.259 15:37:37 -- common/autotest_common.sh@941 -- # uname 00:13:46.259 15:37:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:46.259 15:37:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 843869 00:13:46.259 15:37:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:46.259 15:37:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:46.259 15:37:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 843869' 00:13:46.259 killing process with pid 843869 00:13:46.259 15:37:37 -- common/autotest_common.sh@955 -- # kill 843869 00:13:46.259 15:37:37 -- common/autotest_common.sh@960 -- # wait 843869 00:13:46.518 [2024-11-26 15:37:37.902263] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:13:46.518 15:37:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:46.518 15:37:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:46.518 15:37:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:46.518 15:37:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:46.518 15:37:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:46.518 15:37:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:46.518 15:37:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:46.518 15:37:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:49.053 15:37:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:49.053 00:13:49.053 real 0m7.401s 00:13:49.053 user 0m23.115s 00:13:49.053 sys 0m1.323s 00:13:49.053 15:37:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:49.053 15:37:39 -- common/autotest_common.sh@10 -- # set +x 00:13:49.053 ************************************ 00:13:49.053 END TEST nvmf_host_management 00:13:49.053 ************************************ 00:13:49.053 15:37:40 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:13:49.053 00:13:49.053 real 0m9.853s 00:13:49.053 user 0m23.990s 00:13:49.053 sys 0m2.817s 00:13:49.053 15:37:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:49.053 15:37:40 -- common/autotest_common.sh@10 -- # set +x 00:13:49.053 ************************************ 00:13:49.053 END TEST nvmf_host_management 00:13:49.053 ************************************ 00:13:49.053 15:37:40 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:49.053 15:37:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:49.053 15:37:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:49.053 15:37:40 -- common/autotest_common.sh@10 -- # set +x 00:13:49.054 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:13:49.054 ************************************ 00:13:49.054 START TEST nvmf_lvol 00:13:49.054 ************************************ 00:13:49.054 15:37:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:49.054 * Looking for test storage... 00:13:49.054 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:49.054 15:37:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:49.054 15:37:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:49.054 15:37:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:49.054 15:37:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:49.054 15:37:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:49.054 15:37:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:49.054 15:37:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:49.054 15:37:40 -- scripts/common.sh@335 -- # IFS=.-: 00:13:49.054 15:37:40 -- scripts/common.sh@335 -- # read -ra ver1 00:13:49.054 15:37:40 -- scripts/common.sh@336 -- # IFS=.-: 00:13:49.054 15:37:40 -- scripts/common.sh@336 -- # read -ra ver2 00:13:49.054 15:37:40 -- scripts/common.sh@337 -- # local 'op=<' 00:13:49.054 15:37:40 -- scripts/common.sh@339 -- # ver1_l=2 00:13:49.054 15:37:40 -- scripts/common.sh@340 -- # ver2_l=1 00:13:49.054 15:37:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:49.054 15:37:40 -- scripts/common.sh@343 -- # case "$op" in 00:13:49.054 15:37:40 -- scripts/common.sh@344 -- # : 1 00:13:49.054 15:37:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:49.054 15:37:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:49.054 15:37:40 -- scripts/common.sh@364 -- # decimal 1 00:13:49.054 15:37:40 -- scripts/common.sh@352 -- # local d=1 00:13:49.054 15:37:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:49.054 15:37:40 -- scripts/common.sh@354 -- # echo 1 00:13:49.054 15:37:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:49.054 15:37:40 -- scripts/common.sh@365 -- # decimal 2 00:13:49.054 15:37:40 -- scripts/common.sh@352 -- # local d=2 00:13:49.054 15:37:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:49.054 15:37:40 -- scripts/common.sh@354 -- # echo 2 00:13:49.054 15:37:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:49.054 15:37:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:49.054 15:37:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:49.054 15:37:40 -- scripts/common.sh@367 -- # return 0 00:13:49.054 15:37:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:49.054 15:37:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:49.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:49.054 --rc genhtml_branch_coverage=1 00:13:49.054 --rc genhtml_function_coverage=1 00:13:49.054 --rc genhtml_legend=1 00:13:49.054 --rc geninfo_all_blocks=1 00:13:49.054 --rc geninfo_unexecuted_blocks=1 00:13:49.054 00:13:49.054 ' 00:13:49.054 15:37:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:49.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:49.054 --rc genhtml_branch_coverage=1 00:13:49.054 --rc genhtml_function_coverage=1 00:13:49.054 --rc genhtml_legend=1 00:13:49.054 --rc geninfo_all_blocks=1 00:13:49.054 --rc geninfo_unexecuted_blocks=1 00:13:49.054 00:13:49.054 ' 00:13:49.054 15:37:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:49.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:49.054 --rc genhtml_branch_coverage=1 00:13:49.054 --rc genhtml_function_coverage=1 00:13:49.054 --rc genhtml_legend=1 00:13:49.054 --rc geninfo_all_blocks=1 00:13:49.054 --rc geninfo_unexecuted_blocks=1 00:13:49.054 00:13:49.054 ' 00:13:49.054 15:37:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:49.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:49.054 --rc genhtml_branch_coverage=1 00:13:49.054 --rc genhtml_function_coverage=1 00:13:49.054 --rc genhtml_legend=1 00:13:49.054 --rc geninfo_all_blocks=1 00:13:49.054 --rc geninfo_unexecuted_blocks=1 00:13:49.054 00:13:49.054 ' 00:13:49.054 15:37:40 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:49.054 15:37:40 -- nvmf/common.sh@7 -- # uname -s 00:13:49.054 15:37:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:49.054 15:37:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:49.054 15:37:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:49.054 15:37:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:49.054 15:37:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:49.054 15:37:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:49.054 15:37:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:49.054 15:37:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:49.054 15:37:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:49.054 15:37:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:49.054 15:37:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:49.054 15:37:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:49.054 15:37:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:49.054 15:37:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:49.054 15:37:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:49.054 15:37:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:49.054 15:37:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:49.054 15:37:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:49.054 15:37:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:49.054 15:37:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:49.054 15:37:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:49.054 15:37:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:49.054 15:37:40 -- paths/export.sh@5 -- # export PATH 00:13:49.054 15:37:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:49.054 15:37:40 -- nvmf/common.sh@46 -- # : 0 00:13:49.054 15:37:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:49.054 15:37:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:49.054 15:37:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:49.054 15:37:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:49.054 15:37:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:49.054 15:37:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:49.054 15:37:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:49.054 15:37:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:49.054 15:37:40 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:49.054 15:37:40 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:49.054 15:37:40 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:13:49.054 15:37:40 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:13:49.054 15:37:40 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:49.054 15:37:40 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:13:49.054 15:37:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:49.054 15:37:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:49.054 15:37:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:49.054 15:37:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:49.054 15:37:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:49.054 15:37:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:49.054 15:37:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:49.054 15:37:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:49.054 15:37:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:49.054 15:37:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:49.054 15:37:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:49.054 15:37:40 -- common/autotest_common.sh@10 -- # set +x 00:13:50.962 15:37:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:50.962 15:37:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:50.962 15:37:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:50.962 15:37:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:50.962 15:37:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:50.962 15:37:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:50.962 15:37:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:50.962 15:37:42 -- nvmf/common.sh@294 -- # net_devs=() 00:13:50.962 15:37:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:50.962 15:37:42 -- nvmf/common.sh@295 -- # e810=() 00:13:50.962 15:37:42 -- nvmf/common.sh@295 -- # local -ga e810 00:13:50.962 15:37:42 -- nvmf/common.sh@296 -- # x722=() 00:13:50.962 15:37:42 -- nvmf/common.sh@296 -- # local -ga x722 00:13:50.962 15:37:42 -- nvmf/common.sh@297 -- # mlx=() 00:13:50.962 15:37:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:50.962 15:37:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:50.962 15:37:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:50.962 15:37:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:50.962 15:37:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:50.962 15:37:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:50.962 15:37:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:50.962 15:37:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:50.962 15:37:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:50.962 15:37:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:50.962 15:37:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:50.962 15:37:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:50.962 15:37:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:50.962 15:37:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:50.962 15:37:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:50.962 15:37:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:50.962 15:37:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:50.962 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:50.962 15:37:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:50.962 15:37:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:50.962 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:50.962 15:37:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:50.962 15:37:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:50.962 15:37:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:50.962 15:37:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:50.962 15:37:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:50.962 15:37:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:50.962 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:50.962 15:37:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:50.962 15:37:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:50.962 15:37:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:50.962 15:37:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:50.962 15:37:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:50.962 15:37:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:50.962 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:50.962 15:37:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:50.962 15:37:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:50.962 15:37:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:50.962 15:37:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:50.962 15:37:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:50.962 15:37:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:50.962 15:37:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:50.962 15:37:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:50.962 15:37:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:50.962 15:37:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:50.962 15:37:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:50.962 15:37:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:50.962 15:37:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:50.962 15:37:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:50.962 15:37:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:50.962 15:37:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:50.962 15:37:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:50.962 15:37:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:50.962 15:37:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:50.962 15:37:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:50.962 15:37:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:50.962 15:37:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:50.962 15:37:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:50.962 15:37:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:50.962 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:50.962 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:13:50.962 00:13:50.962 --- 10.0.0.2 ping statistics --- 00:13:50.962 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:50.962 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:13:50.962 15:37:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:50.962 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:50.962 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:13:50.962 00:13:50.962 --- 10.0.0.1 ping statistics --- 00:13:50.962 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:50.962 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:13:50.962 15:37:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:50.962 15:37:42 -- nvmf/common.sh@410 -- # return 0 00:13:50.962 15:37:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:50.962 15:37:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:50.962 15:37:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:50.962 15:37:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:50.962 15:37:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:50.962 15:37:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:50.962 15:37:42 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:13:50.962 15:37:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:50.962 15:37:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:50.962 15:37:42 -- common/autotest_common.sh@10 -- # set +x 00:13:50.962 15:37:42 -- nvmf/common.sh@469 -- # nvmfpid=846394 00:13:50.962 15:37:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:13:50.962 15:37:42 -- nvmf/common.sh@470 -- # waitforlisten 846394 00:13:50.962 15:37:42 -- common/autotest_common.sh@829 -- # '[' -z 846394 ']' 00:13:50.962 15:37:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:50.962 15:37:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:50.962 15:37:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:50.962 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:50.962 15:37:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:50.962 15:37:42 -- common/autotest_common.sh@10 -- # set +x 00:13:50.962 [2024-11-26 15:37:42.351848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:50.962 [2024-11-26 15:37:42.351922] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:50.962 EAL: No free 2048 kB hugepages reported on node 1 00:13:51.221 [2024-11-26 15:37:42.418827] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:51.221 [2024-11-26 15:37:42.532279] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:51.221 [2024-11-26 15:37:42.532431] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:51.221 [2024-11-26 15:37:42.532457] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:51.221 [2024-11-26 15:37:42.532471] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:51.221 [2024-11-26 15:37:42.532556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:51.221 [2024-11-26 15:37:42.532624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:51.222 [2024-11-26 15:37:42.532627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:52.158 15:37:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:52.158 15:37:43 -- common/autotest_common.sh@862 -- # return 0 00:13:52.158 15:37:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:52.158 15:37:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:52.158 15:37:43 -- common/autotest_common.sh@10 -- # set +x 00:13:52.158 15:37:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:52.158 15:37:43 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:52.158 [2024-11-26 15:37:43.549886] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:52.158 15:37:43 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:52.418 15:37:43 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:13:52.418 15:37:43 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:52.987 15:37:44 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:13:52.987 15:37:44 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:13:52.987 15:37:44 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:13:53.246 15:37:44 -- target/nvmf_lvol.sh@29 -- # lvs=6ce22a60-3e79-4b72-8dec-095075bfebb3 00:13:53.246 15:37:44 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 6ce22a60-3e79-4b72-8dec-095075bfebb3 lvol 20 00:13:53.504 15:37:44 -- target/nvmf_lvol.sh@32 -- # lvol=b9cb4fc2-ec3e-4cbc-b69e-491bcf86f08a 00:13:53.504 15:37:44 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:53.762 15:37:45 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 b9cb4fc2-ec3e-4cbc-b69e-491bcf86f08a 00:13:54.021 15:37:45 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:54.279 [2024-11-26 15:37:45.652264] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:54.280 15:37:45 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:54.539 15:37:45 -- target/nvmf_lvol.sh@42 -- # perf_pid=846856 00:13:54.539 15:37:45 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:13:54.539 15:37:45 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:13:54.539 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.478 15:37:46 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot b9cb4fc2-ec3e-4cbc-b69e-491bcf86f08a MY_SNAPSHOT 00:13:56.047 15:37:47 -- target/nvmf_lvol.sh@47 -- # snapshot=f7e422ce-e050-41a8-8d7c-4a1083c5e7ea 00:13:56.048 15:37:47 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize b9cb4fc2-ec3e-4cbc-b69e-491bcf86f08a 30 00:13:56.306 15:37:47 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone f7e422ce-e050-41a8-8d7c-4a1083c5e7ea MY_CLONE 00:13:56.565 15:37:47 -- target/nvmf_lvol.sh@49 -- # clone=c9584d1a-443e-482b-b713-ab252ed1a990 00:13:56.565 15:37:47 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate c9584d1a-443e-482b-b713-ab252ed1a990 00:13:57.134 15:37:48 -- target/nvmf_lvol.sh@53 -- # wait 846856 00:14:05.260 Initializing NVMe Controllers 00:14:05.260 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:05.260 Controller IO queue size 128, less than required. 00:14:05.260 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:05.260 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:05.260 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:05.260 Initialization complete. Launching workers. 00:14:05.260 ======================================================== 00:14:05.260 Latency(us) 00:14:05.260 Device Information : IOPS MiB/s Average min max 00:14:05.260 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 11038.50 43.12 11603.24 400.61 71920.41 00:14:05.260 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10913.20 42.63 11732.35 2379.02 67664.66 00:14:05.260 ======================================================== 00:14:05.260 Total : 21951.70 85.75 11667.43 400.61 71920.41 00:14:05.260 00:14:05.260 15:37:56 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:05.260 15:37:56 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b9cb4fc2-ec3e-4cbc-b69e-491bcf86f08a 00:14:05.518 15:37:56 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 6ce22a60-3e79-4b72-8dec-095075bfebb3 00:14:06.084 15:37:57 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:06.084 15:37:57 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:06.084 15:37:57 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:06.084 15:37:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:06.084 15:37:57 -- nvmf/common.sh@116 -- # sync 00:14:06.084 15:37:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:06.084 15:37:57 -- nvmf/common.sh@119 -- # set +e 00:14:06.084 15:37:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:06.084 15:37:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:06.084 rmmod nvme_tcp 00:14:06.084 rmmod nvme_fabrics 00:14:06.084 rmmod nvme_keyring 00:14:06.084 15:37:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:06.084 15:37:57 -- nvmf/common.sh@123 -- # set -e 00:14:06.084 15:37:57 -- nvmf/common.sh@124 -- # return 0 00:14:06.084 15:37:57 -- nvmf/common.sh@477 -- # '[' -n 846394 ']' 00:14:06.084 15:37:57 -- nvmf/common.sh@478 -- # killprocess 846394 00:14:06.084 15:37:57 -- common/autotest_common.sh@936 -- # '[' -z 846394 ']' 00:14:06.084 15:37:57 -- common/autotest_common.sh@940 -- # kill -0 846394 00:14:06.084 15:37:57 -- common/autotest_common.sh@941 -- # uname 00:14:06.084 15:37:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:06.084 15:37:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 846394 00:14:06.084 15:37:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:06.084 15:37:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:06.084 15:37:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 846394' 00:14:06.084 killing process with pid 846394 00:14:06.084 15:37:57 -- common/autotest_common.sh@955 -- # kill 846394 00:14:06.084 15:37:57 -- common/autotest_common.sh@960 -- # wait 846394 00:14:06.342 15:37:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:06.342 15:37:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:06.342 15:37:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:06.342 15:37:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:06.342 15:37:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:06.342 15:37:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:06.342 15:37:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:06.342 15:37:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:08.913 15:37:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:08.913 00:14:08.913 real 0m19.678s 00:14:08.913 user 1m6.494s 00:14:08.913 sys 0m5.638s 00:14:08.913 15:37:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:08.913 15:37:59 -- common/autotest_common.sh@10 -- # set +x 00:14:08.913 ************************************ 00:14:08.913 END TEST nvmf_lvol 00:14:08.913 ************************************ 00:14:08.913 15:37:59 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:08.913 15:37:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:08.913 15:37:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:08.913 15:37:59 -- common/autotest_common.sh@10 -- # set +x 00:14:08.913 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:14:08.913 ************************************ 00:14:08.913 START TEST nvmf_lvs_grow 00:14:08.913 ************************************ 00:14:08.914 15:37:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:08.914 * Looking for test storage... 00:14:08.914 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:08.914 15:37:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:08.914 15:37:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:08.914 15:37:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:08.914 15:37:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:08.914 15:37:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:08.914 15:37:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:08.914 15:37:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:08.914 15:37:59 -- scripts/common.sh@335 -- # IFS=.-: 00:14:08.914 15:37:59 -- scripts/common.sh@335 -- # read -ra ver1 00:14:08.914 15:37:59 -- scripts/common.sh@336 -- # IFS=.-: 00:14:08.914 15:37:59 -- scripts/common.sh@336 -- # read -ra ver2 00:14:08.914 15:37:59 -- scripts/common.sh@337 -- # local 'op=<' 00:14:08.914 15:37:59 -- scripts/common.sh@339 -- # ver1_l=2 00:14:08.914 15:37:59 -- scripts/common.sh@340 -- # ver2_l=1 00:14:08.914 15:37:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:08.914 15:37:59 -- scripts/common.sh@343 -- # case "$op" in 00:14:08.914 15:37:59 -- scripts/common.sh@344 -- # : 1 00:14:08.914 15:37:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:08.914 15:37:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:08.914 15:37:59 -- scripts/common.sh@364 -- # decimal 1 00:14:08.914 15:37:59 -- scripts/common.sh@352 -- # local d=1 00:14:08.914 15:37:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:08.914 15:37:59 -- scripts/common.sh@354 -- # echo 1 00:14:08.914 15:37:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:08.914 15:37:59 -- scripts/common.sh@365 -- # decimal 2 00:14:08.914 15:37:59 -- scripts/common.sh@352 -- # local d=2 00:14:08.914 15:37:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:08.914 15:37:59 -- scripts/common.sh@354 -- # echo 2 00:14:08.914 15:37:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:08.914 15:37:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:08.914 15:37:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:08.914 15:37:59 -- scripts/common.sh@367 -- # return 0 00:14:08.914 15:37:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:08.914 15:37:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:08.914 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.914 --rc genhtml_branch_coverage=1 00:14:08.914 --rc genhtml_function_coverage=1 00:14:08.914 --rc genhtml_legend=1 00:14:08.914 --rc geninfo_all_blocks=1 00:14:08.914 --rc geninfo_unexecuted_blocks=1 00:14:08.914 00:14:08.914 ' 00:14:08.914 15:37:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:08.914 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.914 --rc genhtml_branch_coverage=1 00:14:08.914 --rc genhtml_function_coverage=1 00:14:08.914 --rc genhtml_legend=1 00:14:08.914 --rc geninfo_all_blocks=1 00:14:08.914 --rc geninfo_unexecuted_blocks=1 00:14:08.914 00:14:08.914 ' 00:14:08.914 15:37:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:08.914 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.914 --rc genhtml_branch_coverage=1 00:14:08.914 --rc genhtml_function_coverage=1 00:14:08.914 --rc genhtml_legend=1 00:14:08.914 --rc geninfo_all_blocks=1 00:14:08.914 --rc geninfo_unexecuted_blocks=1 00:14:08.914 00:14:08.914 ' 00:14:08.914 15:37:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:08.914 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.914 --rc genhtml_branch_coverage=1 00:14:08.914 --rc genhtml_function_coverage=1 00:14:08.914 --rc genhtml_legend=1 00:14:08.914 --rc geninfo_all_blocks=1 00:14:08.914 --rc geninfo_unexecuted_blocks=1 00:14:08.914 00:14:08.914 ' 00:14:08.914 15:37:59 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:08.914 15:37:59 -- nvmf/common.sh@7 -- # uname -s 00:14:08.914 15:37:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:08.914 15:37:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:08.914 15:37:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:08.914 15:37:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:08.914 15:37:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:08.914 15:37:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:08.914 15:37:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:08.914 15:37:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:08.914 15:37:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:08.914 15:37:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:08.914 15:37:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:08.914 15:37:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:08.914 15:37:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:08.914 15:37:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:08.914 15:37:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:08.914 15:37:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:08.914 15:37:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:08.914 15:37:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:08.914 15:37:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:08.914 15:37:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.914 15:37:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.914 15:37:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.914 15:37:59 -- paths/export.sh@5 -- # export PATH 00:14:08.914 15:37:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.914 15:37:59 -- nvmf/common.sh@46 -- # : 0 00:14:08.914 15:37:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:08.914 15:37:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:08.914 15:37:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:08.914 15:37:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:08.914 15:37:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:08.914 15:37:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:08.914 15:37:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:08.914 15:37:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:08.914 15:37:59 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:08.914 15:37:59 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:08.914 15:37:59 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:08.914 15:37:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:08.914 15:37:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:08.914 15:37:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:08.914 15:37:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:08.914 15:37:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:08.914 15:37:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:08.914 15:37:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:08.914 15:37:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:08.914 15:37:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:08.914 15:37:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:08.914 15:37:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:08.914 15:37:59 -- common/autotest_common.sh@10 -- # set +x 00:14:10.388 15:38:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:10.388 15:38:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:10.388 15:38:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:10.388 15:38:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:10.388 15:38:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:10.388 15:38:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:10.388 15:38:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:10.388 15:38:01 -- nvmf/common.sh@294 -- # net_devs=() 00:14:10.388 15:38:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:10.388 15:38:01 -- nvmf/common.sh@295 -- # e810=() 00:14:10.388 15:38:01 -- nvmf/common.sh@295 -- # local -ga e810 00:14:10.388 15:38:01 -- nvmf/common.sh@296 -- # x722=() 00:14:10.388 15:38:01 -- nvmf/common.sh@296 -- # local -ga x722 00:14:10.388 15:38:01 -- nvmf/common.sh@297 -- # mlx=() 00:14:10.388 15:38:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:10.388 15:38:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:10.388 15:38:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:10.388 15:38:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:10.388 15:38:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:10.388 15:38:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:10.388 15:38:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:10.388 15:38:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:10.388 15:38:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:10.388 15:38:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:10.388 15:38:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:10.388 15:38:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:10.388 15:38:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:10.388 15:38:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:10.388 15:38:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:10.388 15:38:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:10.388 15:38:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:10.388 15:38:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:10.388 15:38:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:10.388 15:38:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:10.389 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:10.389 15:38:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:10.389 15:38:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:10.389 15:38:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:10.389 15:38:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:10.389 15:38:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:10.389 15:38:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:10.389 15:38:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:10.389 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:10.389 15:38:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:10.389 15:38:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:10.389 15:38:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:10.389 15:38:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:10.389 15:38:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:10.389 15:38:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:10.389 15:38:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:10.389 15:38:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:10.389 15:38:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:10.389 15:38:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:10.389 15:38:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:10.389 15:38:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:10.389 15:38:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:10.389 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:10.389 15:38:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:10.389 15:38:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:10.389 15:38:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:10.389 15:38:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:10.389 15:38:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:10.389 15:38:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:10.389 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:10.389 15:38:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:10.389 15:38:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:10.389 15:38:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:10.389 15:38:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:10.389 15:38:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:10.389 15:38:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:10.389 15:38:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:10.389 15:38:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:10.389 15:38:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:10.389 15:38:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:10.389 15:38:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:10.389 15:38:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:10.389 15:38:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:10.389 15:38:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:10.389 15:38:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:10.389 15:38:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:10.389 15:38:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:10.389 15:38:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:10.389 15:38:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:10.647 15:38:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:10.647 15:38:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:10.647 15:38:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:10.647 15:38:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:10.647 15:38:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:10.647 15:38:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:10.647 15:38:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:10.647 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:10.647 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:14:10.647 00:14:10.647 --- 10.0.0.2 ping statistics --- 00:14:10.647 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:10.647 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:14:10.647 15:38:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:10.647 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:10.647 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:14:10.647 00:14:10.647 --- 10.0.0.1 ping statistics --- 00:14:10.647 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:10.647 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:14:10.647 15:38:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:10.647 15:38:01 -- nvmf/common.sh@410 -- # return 0 00:14:10.647 15:38:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:10.647 15:38:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:10.647 15:38:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:10.647 15:38:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:10.647 15:38:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:10.647 15:38:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:10.647 15:38:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:10.647 15:38:01 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:10.647 15:38:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:10.647 15:38:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:10.647 15:38:01 -- common/autotest_common.sh@10 -- # set +x 00:14:10.647 15:38:01 -- nvmf/common.sh@469 -- # nvmfpid=850165 00:14:10.647 15:38:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:10.647 15:38:01 -- nvmf/common.sh@470 -- # waitforlisten 850165 00:14:10.647 15:38:01 -- common/autotest_common.sh@829 -- # '[' -z 850165 ']' 00:14:10.647 15:38:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:10.647 15:38:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:10.647 15:38:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:10.647 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:10.647 15:38:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:10.647 15:38:01 -- common/autotest_common.sh@10 -- # set +x 00:14:10.647 [2024-11-26 15:38:02.012514] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:10.647 [2024-11-26 15:38:02.012582] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:10.647 EAL: No free 2048 kB hugepages reported on node 1 00:14:10.647 [2024-11-26 15:38:02.079674] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:10.907 [2024-11-26 15:38:02.193472] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:10.907 [2024-11-26 15:38:02.193644] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:10.907 [2024-11-26 15:38:02.193664] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:10.907 [2024-11-26 15:38:02.193678] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:10.907 [2024-11-26 15:38:02.193731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:11.845 15:38:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:11.845 15:38:03 -- common/autotest_common.sh@862 -- # return 0 00:14:11.845 15:38:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:11.845 15:38:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:11.845 15:38:03 -- common/autotest_common.sh@10 -- # set +x 00:14:11.845 15:38:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:11.846 15:38:03 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:12.104 [2024-11-26 15:38:03.300125] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:12.104 15:38:03 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:12.104 15:38:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:12.104 15:38:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:12.104 15:38:03 -- common/autotest_common.sh@10 -- # set +x 00:14:12.104 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:14:12.104 ************************************ 00:14:12.104 START TEST lvs_grow_clean 00:14:12.104 ************************************ 00:14:12.104 15:38:03 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:12.104 15:38:03 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:12.104 15:38:03 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:12.104 15:38:03 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:12.104 15:38:03 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:12.104 15:38:03 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:12.104 15:38:03 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:12.104 15:38:03 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:12.104 15:38:03 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:12.104 15:38:03 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:12.363 15:38:03 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:12.363 15:38:03 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:12.622 15:38:03 -- target/nvmf_lvs_grow.sh@28 -- # lvs=65963e10-dd02-4cf1-b88f-2e720d9f1b4e 00:14:12.622 15:38:03 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 65963e10-dd02-4cf1-b88f-2e720d9f1b4e 00:14:12.622 15:38:03 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:12.881 15:38:04 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:12.881 15:38:04 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:12.881 15:38:04 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 65963e10-dd02-4cf1-b88f-2e720d9f1b4e lvol 150 00:14:13.140 15:38:04 -- target/nvmf_lvs_grow.sh@33 -- # lvol=4032fbd8-1bc3-4b05-bdc7-a4d6ad4526d2 00:14:13.140 15:38:04 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:13.141 15:38:04 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:13.399 [2024-11-26 15:38:04.723188] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:13.399 [2024-11-26 15:38:04.723281] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:13.399 true 00:14:13.399 15:38:04 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 65963e10-dd02-4cf1-b88f-2e720d9f1b4e 00:14:13.399 15:38:04 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:13.657 15:38:04 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:13.658 15:38:04 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:13.917 15:38:05 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 4032fbd8-1bc3-4b05-bdc7-a4d6ad4526d2 00:14:14.177 15:38:05 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:14.438 [2024-11-26 15:38:05.738373] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:14.438 15:38:05 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:14.697 15:38:06 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=850601 00:14:14.697 15:38:06 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:14.697 15:38:06 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:14.697 15:38:06 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 850601 /var/tmp/bdevperf.sock 00:14:14.697 15:38:06 -- common/autotest_common.sh@829 -- # '[' -z 850601 ']' 00:14:14.697 15:38:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:14.697 15:38:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:14.697 15:38:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:14.697 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:14.697 15:38:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:14.697 15:38:06 -- common/autotest_common.sh@10 -- # set +x 00:14:14.697 [2024-11-26 15:38:06.045185] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:14.697 [2024-11-26 15:38:06.045274] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid850601 ] 00:14:14.697 EAL: No free 2048 kB hugepages reported on node 1 00:14:14.697 [2024-11-26 15:38:06.105795] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:14.957 [2024-11-26 15:38:06.222981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:15.895 15:38:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:15.895 15:38:07 -- common/autotest_common.sh@862 -- # return 0 00:14:15.895 15:38:07 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:16.153 Nvme0n1 00:14:16.153 15:38:07 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:16.411 [ 00:14:16.411 { 00:14:16.411 "name": "Nvme0n1", 00:14:16.411 "aliases": [ 00:14:16.411 "4032fbd8-1bc3-4b05-bdc7-a4d6ad4526d2" 00:14:16.411 ], 00:14:16.411 "product_name": "NVMe disk", 00:14:16.411 "block_size": 4096, 00:14:16.411 "num_blocks": 38912, 00:14:16.411 "uuid": "4032fbd8-1bc3-4b05-bdc7-a4d6ad4526d2", 00:14:16.411 "assigned_rate_limits": { 00:14:16.411 "rw_ios_per_sec": 0, 00:14:16.411 "rw_mbytes_per_sec": 0, 00:14:16.411 "r_mbytes_per_sec": 0, 00:14:16.411 "w_mbytes_per_sec": 0 00:14:16.411 }, 00:14:16.411 "claimed": false, 00:14:16.411 "zoned": false, 00:14:16.411 "supported_io_types": { 00:14:16.411 "read": true, 00:14:16.411 "write": true, 00:14:16.411 "unmap": true, 00:14:16.411 "write_zeroes": true, 00:14:16.411 "flush": true, 00:14:16.411 "reset": true, 00:14:16.411 "compare": true, 00:14:16.411 "compare_and_write": true, 00:14:16.411 "abort": true, 00:14:16.411 "nvme_admin": true, 00:14:16.411 "nvme_io": true 00:14:16.411 }, 00:14:16.411 "driver_specific": { 00:14:16.411 "nvme": [ 00:14:16.411 { 00:14:16.411 "trid": { 00:14:16.411 "trtype": "TCP", 00:14:16.411 "adrfam": "IPv4", 00:14:16.411 "traddr": "10.0.0.2", 00:14:16.411 "trsvcid": "4420", 00:14:16.411 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:16.411 }, 00:14:16.411 "ctrlr_data": { 00:14:16.411 "cntlid": 1, 00:14:16.411 "vendor_id": "0x8086", 00:14:16.411 "model_number": "SPDK bdev Controller", 00:14:16.411 "serial_number": "SPDK0", 00:14:16.411 "firmware_revision": "24.01.1", 00:14:16.411 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:16.411 "oacs": { 00:14:16.411 "security": 0, 00:14:16.411 "format": 0, 00:14:16.411 "firmware": 0, 00:14:16.411 "ns_manage": 0 00:14:16.411 }, 00:14:16.411 "multi_ctrlr": true, 00:14:16.411 "ana_reporting": false 00:14:16.411 }, 00:14:16.411 "vs": { 00:14:16.411 "nvme_version": "1.3" 00:14:16.411 }, 00:14:16.411 "ns_data": { 00:14:16.411 "id": 1, 00:14:16.411 "can_share": true 00:14:16.411 } 00:14:16.411 } 00:14:16.411 ], 00:14:16.411 "mp_policy": "active_passive" 00:14:16.411 } 00:14:16.411 } 00:14:16.411 ] 00:14:16.411 15:38:07 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=850874 00:14:16.411 15:38:07 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:16.411 15:38:07 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:16.671 Running I/O for 10 seconds... 00:14:17.612 Latency(us) 00:14:17.612 [2024-11-26T14:38:09.065Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:17.612 [2024-11-26T14:38:09.065Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:17.612 Nvme0n1 : 1.00 14944.00 58.38 0.00 0.00 0.00 0.00 0.00 00:14:17.612 [2024-11-26T14:38:09.065Z] =================================================================================================================== 00:14:17.612 [2024-11-26T14:38:09.065Z] Total : 14944.00 58.38 0.00 0.00 0.00 0.00 0.00 00:14:17.612 00:14:18.548 15:38:09 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 65963e10-dd02-4cf1-b88f-2e720d9f1b4e 00:14:18.548 [2024-11-26T14:38:10.001Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:18.548 Nvme0n1 : 2.00 15202.50 59.38 0.00 0.00 0.00 0.00 0.00 00:14:18.548 [2024-11-26T14:38:10.001Z] =================================================================================================================== 00:14:18.548 [2024-11-26T14:38:10.001Z] Total : 15202.50 59.38 0.00 0.00 0.00 0.00 0.00 00:14:18.548 00:14:18.806 true 00:14:18.806 15:38:10 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 65963e10-dd02-4cf1-b88f-2e720d9f1b4e 00:14:18.806 15:38:10 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:19.066 15:38:10 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:19.066 15:38:10 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:19.066 15:38:10 -- target/nvmf_lvs_grow.sh@65 -- # wait 850874 00:14:19.634 [2024-11-26T14:38:11.087Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:19.634 Nvme0n1 : 3.00 15190.33 59.34 0.00 0.00 0.00 0.00 0.00 00:14:19.634 [2024-11-26T14:38:11.087Z] =================================================================================================================== 00:14:19.634 [2024-11-26T14:38:11.087Z] Total : 15190.33 59.34 0.00 0.00 0.00 0.00 0.00 00:14:19.634 00:14:20.573 [2024-11-26T14:38:12.026Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:20.573 Nvme0n1 : 4.00 15202.50 59.38 0.00 0.00 0.00 0.00 0.00 00:14:20.573 [2024-11-26T14:38:12.026Z] =================================================================================================================== 00:14:20.573 [2024-11-26T14:38:12.026Z] Total : 15202.50 59.38 0.00 0.00 0.00 0.00 0.00 00:14:20.573 00:14:21.510 [2024-11-26T14:38:12.963Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:21.510 Nvme0n1 : 5.00 15232.60 59.50 0.00 0.00 0.00 0.00 0.00 00:14:21.510 [2024-11-26T14:38:12.963Z] =================================================================================================================== 00:14:21.510 [2024-11-26T14:38:12.963Z] Total : 15232.60 59.50 0.00 0.00 0.00 0.00 0.00 00:14:21.510 00:14:22.450 [2024-11-26T14:38:13.903Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:22.450 Nvme0n1 : 6.00 15241.00 59.54 0.00 0.00 0.00 0.00 0.00 00:14:22.450 [2024-11-26T14:38:13.903Z] =================================================================================================================== 00:14:22.450 [2024-11-26T14:38:13.903Z] Total : 15241.00 59.54 0.00 0.00 0.00 0.00 0.00 00:14:22.450 00:14:23.832 [2024-11-26T14:38:15.285Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:23.832 Nvme0n1 : 7.00 15281.00 59.69 0.00 0.00 0.00 0.00 0.00 00:14:23.832 [2024-11-26T14:38:15.285Z] =================================================================================================================== 00:14:23.832 [2024-11-26T14:38:15.285Z] Total : 15281.00 59.69 0.00 0.00 0.00 0.00 0.00 00:14:23.832 00:14:24.773 [2024-11-26T14:38:16.226Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:24.773 Nvme0n1 : 8.00 15323.12 59.86 0.00 0.00 0.00 0.00 0.00 00:14:24.773 [2024-11-26T14:38:16.226Z] =================================================================================================================== 00:14:24.773 [2024-11-26T14:38:16.226Z] Total : 15323.12 59.86 0.00 0.00 0.00 0.00 0.00 00:14:24.773 00:14:25.710 [2024-11-26T14:38:17.163Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:25.710 Nvme0n1 : 9.00 15334.33 59.90 0.00 0.00 0.00 0.00 0.00 00:14:25.710 [2024-11-26T14:38:17.163Z] =================================================================================================================== 00:14:25.710 [2024-11-26T14:38:17.163Z] Total : 15334.33 59.90 0.00 0.00 0.00 0.00 0.00 00:14:25.710 00:14:26.648 [2024-11-26T14:38:18.101Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:26.648 Nvme0n1 : 10.00 15336.10 59.91 0.00 0.00 0.00 0.00 0.00 00:14:26.648 [2024-11-26T14:38:18.101Z] =================================================================================================================== 00:14:26.648 [2024-11-26T14:38:18.101Z] Total : 15336.10 59.91 0.00 0.00 0.00 0.00 0.00 00:14:26.648 00:14:26.648 00:14:26.648 Latency(us) 00:14:26.648 [2024-11-26T14:38:18.101Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:26.648 [2024-11-26T14:38:18.101Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:26.648 Nvme0n1 : 10.01 15339.25 59.92 0.00 0.00 8340.41 4053.52 15534.46 00:14:26.648 [2024-11-26T14:38:18.101Z] =================================================================================================================== 00:14:26.648 [2024-11-26T14:38:18.101Z] Total : 15339.25 59.92 0.00 0.00 8340.41 4053.52 15534.46 00:14:26.648 0 00:14:26.649 15:38:17 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 850601 00:14:26.649 15:38:17 -- common/autotest_common.sh@936 -- # '[' -z 850601 ']' 00:14:26.649 15:38:17 -- common/autotest_common.sh@940 -- # kill -0 850601 00:14:26.649 15:38:17 -- common/autotest_common.sh@941 -- # uname 00:14:26.649 15:38:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:26.649 15:38:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 850601 00:14:26.649 15:38:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:26.649 15:38:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:26.649 15:38:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 850601' 00:14:26.649 killing process with pid 850601 00:14:26.649 15:38:17 -- common/autotest_common.sh@955 -- # kill 850601 00:14:26.649 Received shutdown signal, test time was about 10.000000 seconds 00:14:26.649 00:14:26.649 Latency(us) 00:14:26.649 [2024-11-26T14:38:18.102Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:26.649 [2024-11-26T14:38:18.102Z] =================================================================================================================== 00:14:26.649 [2024-11-26T14:38:18.102Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:26.649 15:38:17 -- common/autotest_common.sh@960 -- # wait 850601 00:14:26.908 15:38:18 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:27.166 15:38:18 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 65963e10-dd02-4cf1-b88f-2e720d9f1b4e 00:14:27.166 15:38:18 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:27.425 15:38:18 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:27.425 15:38:18 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:27.425 15:38:18 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:27.684 [2024-11-26 15:38:18.988562] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:27.684 15:38:19 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 65963e10-dd02-4cf1-b88f-2e720d9f1b4e 00:14:27.684 15:38:19 -- common/autotest_common.sh@650 -- # local es=0 00:14:27.684 15:38:19 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 65963e10-dd02-4cf1-b88f-2e720d9f1b4e 00:14:27.684 15:38:19 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:27.685 15:38:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:27.685 15:38:19 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:27.685 15:38:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:27.685 15:38:19 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:27.685 15:38:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:27.685 15:38:19 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:27.685 15:38:19 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:27.685 15:38:19 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 65963e10-dd02-4cf1-b88f-2e720d9f1b4e 00:14:27.944 request: 00:14:27.944 { 00:14:27.944 "uuid": "65963e10-dd02-4cf1-b88f-2e720d9f1b4e", 00:14:27.944 "method": "bdev_lvol_get_lvstores", 00:14:27.944 "req_id": 1 00:14:27.944 } 00:14:27.944 Got JSON-RPC error response 00:14:27.944 response: 00:14:27.944 { 00:14:27.944 "code": -19, 00:14:27.944 "message": "No such device" 00:14:27.944 } 00:14:27.944 15:38:19 -- common/autotest_common.sh@653 -- # es=1 00:14:27.944 15:38:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:27.944 15:38:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:27.944 15:38:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:27.944 15:38:19 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:28.203 aio_bdev 00:14:28.203 15:38:19 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 4032fbd8-1bc3-4b05-bdc7-a4d6ad4526d2 00:14:28.203 15:38:19 -- common/autotest_common.sh@897 -- # local bdev_name=4032fbd8-1bc3-4b05-bdc7-a4d6ad4526d2 00:14:28.203 15:38:19 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:28.203 15:38:19 -- common/autotest_common.sh@899 -- # local i 00:14:28.203 15:38:19 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:28.203 15:38:19 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:28.203 15:38:19 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:28.461 15:38:19 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 4032fbd8-1bc3-4b05-bdc7-a4d6ad4526d2 -t 2000 00:14:28.722 [ 00:14:28.722 { 00:14:28.722 "name": "4032fbd8-1bc3-4b05-bdc7-a4d6ad4526d2", 00:14:28.722 "aliases": [ 00:14:28.722 "lvs/lvol" 00:14:28.722 ], 00:14:28.722 "product_name": "Logical Volume", 00:14:28.722 "block_size": 4096, 00:14:28.722 "num_blocks": 38912, 00:14:28.722 "uuid": "4032fbd8-1bc3-4b05-bdc7-a4d6ad4526d2", 00:14:28.722 "assigned_rate_limits": { 00:14:28.722 "rw_ios_per_sec": 0, 00:14:28.722 "rw_mbytes_per_sec": 0, 00:14:28.722 "r_mbytes_per_sec": 0, 00:14:28.722 "w_mbytes_per_sec": 0 00:14:28.722 }, 00:14:28.722 "claimed": false, 00:14:28.722 "zoned": false, 00:14:28.722 "supported_io_types": { 00:14:28.722 "read": true, 00:14:28.722 "write": true, 00:14:28.722 "unmap": true, 00:14:28.722 "write_zeroes": true, 00:14:28.722 "flush": false, 00:14:28.722 "reset": true, 00:14:28.722 "compare": false, 00:14:28.722 "compare_and_write": false, 00:14:28.722 "abort": false, 00:14:28.722 "nvme_admin": false, 00:14:28.722 "nvme_io": false 00:14:28.722 }, 00:14:28.722 "driver_specific": { 00:14:28.722 "lvol": { 00:14:28.722 "lvol_store_uuid": "65963e10-dd02-4cf1-b88f-2e720d9f1b4e", 00:14:28.722 "base_bdev": "aio_bdev", 00:14:28.722 "thin_provision": false, 00:14:28.722 "snapshot": false, 00:14:28.722 "clone": false, 00:14:28.722 "esnap_clone": false 00:14:28.722 } 00:14:28.722 } 00:14:28.722 } 00:14:28.722 ] 00:14:28.722 15:38:20 -- common/autotest_common.sh@905 -- # return 0 00:14:28.722 15:38:20 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 65963e10-dd02-4cf1-b88f-2e720d9f1b4e 00:14:28.722 15:38:20 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:28.983 15:38:20 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:28.983 15:38:20 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 65963e10-dd02-4cf1-b88f-2e720d9f1b4e 00:14:28.983 15:38:20 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:29.241 15:38:20 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:29.241 15:38:20 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 4032fbd8-1bc3-4b05-bdc7-a4d6ad4526d2 00:14:29.501 15:38:20 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 65963e10-dd02-4cf1-b88f-2e720d9f1b4e 00:14:29.759 15:38:21 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:30.017 15:38:21 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:30.018 00:14:30.018 real 0m18.042s 00:14:30.018 user 0m17.947s 00:14:30.018 sys 0m1.762s 00:14:30.018 15:38:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:30.018 15:38:21 -- common/autotest_common.sh@10 -- # set +x 00:14:30.018 ************************************ 00:14:30.018 END TEST lvs_grow_clean 00:14:30.018 ************************************ 00:14:30.018 15:38:21 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:30.018 15:38:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:30.018 15:38:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:30.018 15:38:21 -- common/autotest_common.sh@10 -- # set +x 00:14:30.018 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:14:30.018 ************************************ 00:14:30.018 START TEST lvs_grow_dirty 00:14:30.018 ************************************ 00:14:30.018 15:38:21 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:14:30.018 15:38:21 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:30.018 15:38:21 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:30.018 15:38:21 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:30.018 15:38:21 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:30.018 15:38:21 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:30.018 15:38:21 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:30.018 15:38:21 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:30.018 15:38:21 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:30.018 15:38:21 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:30.277 15:38:21 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:30.277 15:38:21 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:30.538 15:38:21 -- target/nvmf_lvs_grow.sh@28 -- # lvs=812c7273-0c13-4048-852e-ea1674b5649e 00:14:30.538 15:38:21 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 812c7273-0c13-4048-852e-ea1674b5649e 00:14:30.538 15:38:21 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:30.797 15:38:22 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:30.797 15:38:22 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:30.797 15:38:22 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 812c7273-0c13-4048-852e-ea1674b5649e lvol 150 00:14:31.056 15:38:22 -- target/nvmf_lvs_grow.sh@33 -- # lvol=ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b 00:14:31.056 15:38:22 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:31.056 15:38:22 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:31.315 [2024-11-26 15:38:22.708136] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:31.315 [2024-11-26 15:38:22.708230] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:31.315 true 00:14:31.315 15:38:22 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 812c7273-0c13-4048-852e-ea1674b5649e 00:14:31.315 15:38:22 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:31.574 15:38:22 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:31.574 15:38:22 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:31.832 15:38:23 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b 00:14:32.092 15:38:23 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:32.351 15:38:23 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:32.610 15:38:23 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=852744 00:14:32.610 15:38:23 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:32.610 15:38:23 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:32.610 15:38:23 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 852744 /var/tmp/bdevperf.sock 00:14:32.610 15:38:23 -- common/autotest_common.sh@829 -- # '[' -z 852744 ']' 00:14:32.610 15:38:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:32.610 15:38:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:32.610 15:38:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:32.610 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:32.610 15:38:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:32.610 15:38:23 -- common/autotest_common.sh@10 -- # set +x 00:14:32.610 [2024-11-26 15:38:24.019968] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:32.610 [2024-11-26 15:38:24.020068] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid852744 ] 00:14:32.610 EAL: No free 2048 kB hugepages reported on node 1 00:14:32.869 [2024-11-26 15:38:24.081623] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:32.869 [2024-11-26 15:38:24.197247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:33.823 15:38:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:33.823 15:38:24 -- common/autotest_common.sh@862 -- # return 0 00:14:33.823 15:38:24 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:34.087 Nvme0n1 00:14:34.087 15:38:25 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:34.347 [ 00:14:34.347 { 00:14:34.347 "name": "Nvme0n1", 00:14:34.347 "aliases": [ 00:14:34.347 "ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b" 00:14:34.347 ], 00:14:34.347 "product_name": "NVMe disk", 00:14:34.347 "block_size": 4096, 00:14:34.347 "num_blocks": 38912, 00:14:34.347 "uuid": "ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b", 00:14:34.347 "assigned_rate_limits": { 00:14:34.347 "rw_ios_per_sec": 0, 00:14:34.347 "rw_mbytes_per_sec": 0, 00:14:34.347 "r_mbytes_per_sec": 0, 00:14:34.347 "w_mbytes_per_sec": 0 00:14:34.347 }, 00:14:34.347 "claimed": false, 00:14:34.347 "zoned": false, 00:14:34.347 "supported_io_types": { 00:14:34.347 "read": true, 00:14:34.347 "write": true, 00:14:34.347 "unmap": true, 00:14:34.347 "write_zeroes": true, 00:14:34.347 "flush": true, 00:14:34.347 "reset": true, 00:14:34.347 "compare": true, 00:14:34.347 "compare_and_write": true, 00:14:34.347 "abort": true, 00:14:34.347 "nvme_admin": true, 00:14:34.347 "nvme_io": true 00:14:34.347 }, 00:14:34.347 "driver_specific": { 00:14:34.347 "nvme": [ 00:14:34.347 { 00:14:34.347 "trid": { 00:14:34.347 "trtype": "TCP", 00:14:34.347 "adrfam": "IPv4", 00:14:34.347 "traddr": "10.0.0.2", 00:14:34.347 "trsvcid": "4420", 00:14:34.347 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:34.347 }, 00:14:34.347 "ctrlr_data": { 00:14:34.347 "cntlid": 1, 00:14:34.347 "vendor_id": "0x8086", 00:14:34.347 "model_number": "SPDK bdev Controller", 00:14:34.347 "serial_number": "SPDK0", 00:14:34.347 "firmware_revision": "24.01.1", 00:14:34.347 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:34.347 "oacs": { 00:14:34.347 "security": 0, 00:14:34.347 "format": 0, 00:14:34.347 "firmware": 0, 00:14:34.347 "ns_manage": 0 00:14:34.347 }, 00:14:34.347 "multi_ctrlr": true, 00:14:34.347 "ana_reporting": false 00:14:34.347 }, 00:14:34.347 "vs": { 00:14:34.347 "nvme_version": "1.3" 00:14:34.347 }, 00:14:34.347 "ns_data": { 00:14:34.347 "id": 1, 00:14:34.347 "can_share": true 00:14:34.347 } 00:14:34.347 } 00:14:34.347 ], 00:14:34.347 "mp_policy": "active_passive" 00:14:34.347 } 00:14:34.347 } 00:14:34.347 ] 00:14:34.347 15:38:25 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=852911 00:14:34.347 15:38:25 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:34.347 15:38:25 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:34.347 Running I/O for 10 seconds... 00:14:35.283 Latency(us) 00:14:35.283 [2024-11-26T14:38:26.736Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:35.283 [2024-11-26T14:38:26.736Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:35.283 Nvme0n1 : 1.00 15133.00 59.11 0.00 0.00 0.00 0.00 0.00 00:14:35.283 [2024-11-26T14:38:26.736Z] =================================================================================================================== 00:14:35.283 [2024-11-26T14:38:26.736Z] Total : 15133.00 59.11 0.00 0.00 0.00 0.00 0.00 00:14:35.283 00:14:36.220 15:38:27 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 812c7273-0c13-4048-852e-ea1674b5649e 00:14:36.478 [2024-11-26T14:38:27.931Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:36.478 Nvme0n1 : 2.00 15079.00 58.90 0.00 0.00 0.00 0.00 0.00 00:14:36.478 [2024-11-26T14:38:27.931Z] =================================================================================================================== 00:14:36.478 [2024-11-26T14:38:27.931Z] Total : 15079.00 58.90 0.00 0.00 0.00 0.00 0.00 00:14:36.478 00:14:36.478 true 00:14:36.478 15:38:27 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 812c7273-0c13-4048-852e-ea1674b5649e 00:14:36.478 15:38:27 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:36.738 15:38:28 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:36.738 15:38:28 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:36.738 15:38:28 -- target/nvmf_lvs_grow.sh@65 -- # wait 852911 00:14:37.310 [2024-11-26T14:38:28.763Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:37.310 Nvme0n1 : 3.00 15126.67 59.09 0.00 0.00 0.00 0.00 0.00 00:14:37.310 [2024-11-26T14:38:28.763Z] =================================================================================================================== 00:14:37.310 [2024-11-26T14:38:28.763Z] Total : 15126.67 59.09 0.00 0.00 0.00 0.00 0.00 00:14:37.310 00:14:38.687 [2024-11-26T14:38:30.140Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:38.687 Nvme0n1 : 4.00 15139.50 59.14 0.00 0.00 0.00 0.00 0.00 00:14:38.687 [2024-11-26T14:38:30.140Z] =================================================================================================================== 00:14:38.687 [2024-11-26T14:38:30.140Z] Total : 15139.50 59.14 0.00 0.00 0.00 0.00 0.00 00:14:38.687 00:14:39.625 [2024-11-26T14:38:31.078Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:39.625 Nvme0n1 : 5.00 15168.60 59.25 0.00 0.00 0.00 0.00 0.00 00:14:39.625 [2024-11-26T14:38:31.078Z] =================================================================================================================== 00:14:39.625 [2024-11-26T14:38:31.078Z] Total : 15168.60 59.25 0.00 0.00 0.00 0.00 0.00 00:14:39.625 00:14:40.562 [2024-11-26T14:38:32.015Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:40.562 Nvme0n1 : 6.00 15210.00 59.41 0.00 0.00 0.00 0.00 0.00 00:14:40.562 [2024-11-26T14:38:32.015Z] =================================================================================================================== 00:14:40.562 [2024-11-26T14:38:32.015Z] Total : 15210.00 59.41 0.00 0.00 0.00 0.00 0.00 00:14:40.562 00:14:41.504 [2024-11-26T14:38:32.957Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:41.504 Nvme0n1 : 7.00 15231.86 59.50 0.00 0.00 0.00 0.00 0.00 00:14:41.504 [2024-11-26T14:38:32.957Z] =================================================================================================================== 00:14:41.504 [2024-11-26T14:38:32.957Z] Total : 15231.86 59.50 0.00 0.00 0.00 0.00 0.00 00:14:41.504 00:14:42.441 [2024-11-26T14:38:33.894Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:42.441 Nvme0n1 : 8.00 15242.88 59.54 0.00 0.00 0.00 0.00 0.00 00:14:42.441 [2024-11-26T14:38:33.894Z] =================================================================================================================== 00:14:42.441 [2024-11-26T14:38:33.894Z] Total : 15242.88 59.54 0.00 0.00 0.00 0.00 0.00 00:14:42.441 00:14:43.380 [2024-11-26T14:38:34.833Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:43.380 Nvme0n1 : 9.00 15284.11 59.70 0.00 0.00 0.00 0.00 0.00 00:14:43.380 [2024-11-26T14:38:34.833Z] =================================================================================================================== 00:14:43.380 [2024-11-26T14:38:34.833Z] Total : 15284.11 59.70 0.00 0.00 0.00 0.00 0.00 00:14:43.380 00:14:44.320 [2024-11-26T14:38:35.773Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:44.320 Nvme0n1 : 10.00 15324.70 59.86 0.00 0.00 0.00 0.00 0.00 00:14:44.320 [2024-11-26T14:38:35.773Z] =================================================================================================================== 00:14:44.320 [2024-11-26T14:38:35.773Z] Total : 15324.70 59.86 0.00 0.00 0.00 0.00 0.00 00:14:44.320 00:14:44.320 00:14:44.320 Latency(us) 00:14:44.320 [2024-11-26T14:38:35.773Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:44.320 [2024-11-26T14:38:35.773Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:44.320 Nvme0n1 : 10.01 15322.77 59.85 0.00 0.00 8347.89 4563.25 15437.37 00:14:44.320 [2024-11-26T14:38:35.773Z] =================================================================================================================== 00:14:44.320 [2024-11-26T14:38:35.773Z] Total : 15322.77 59.85 0.00 0.00 8347.89 4563.25 15437.37 00:14:44.320 0 00:14:44.320 15:38:35 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 852744 00:14:44.320 15:38:35 -- common/autotest_common.sh@936 -- # '[' -z 852744 ']' 00:14:44.320 15:38:35 -- common/autotest_common.sh@940 -- # kill -0 852744 00:14:44.320 15:38:35 -- common/autotest_common.sh@941 -- # uname 00:14:44.320 15:38:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:44.320 15:38:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 852744 00:14:44.579 15:38:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:44.579 15:38:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:44.579 15:38:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 852744' 00:14:44.579 killing process with pid 852744 00:14:44.579 15:38:35 -- common/autotest_common.sh@955 -- # kill 852744 00:14:44.579 Received shutdown signal, test time was about 10.000000 seconds 00:14:44.579 00:14:44.579 Latency(us) 00:14:44.579 [2024-11-26T14:38:36.032Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:44.579 [2024-11-26T14:38:36.032Z] =================================================================================================================== 00:14:44.579 [2024-11-26T14:38:36.032Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:44.579 15:38:35 -- common/autotest_common.sh@960 -- # wait 852744 00:14:44.838 15:38:36 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:45.096 15:38:36 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 812c7273-0c13-4048-852e-ea1674b5649e 00:14:45.096 15:38:36 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:45.354 15:38:36 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:45.354 15:38:36 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:14:45.354 15:38:36 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 850165 00:14:45.354 15:38:36 -- target/nvmf_lvs_grow.sh@74 -- # wait 850165 00:14:45.354 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 850165 Killed "${NVMF_APP[@]}" "$@" 00:14:45.354 15:38:36 -- target/nvmf_lvs_grow.sh@74 -- # true 00:14:45.354 15:38:36 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:14:45.354 15:38:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:45.354 15:38:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:45.354 15:38:36 -- common/autotest_common.sh@10 -- # set +x 00:14:45.354 15:38:36 -- nvmf/common.sh@469 -- # nvmfpid=854187 00:14:45.354 15:38:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:45.354 15:38:36 -- nvmf/common.sh@470 -- # waitforlisten 854187 00:14:45.354 15:38:36 -- common/autotest_common.sh@829 -- # '[' -z 854187 ']' 00:14:45.354 15:38:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:45.354 15:38:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:45.354 15:38:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:45.354 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:45.354 15:38:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:45.354 15:38:36 -- common/autotest_common.sh@10 -- # set +x 00:14:45.354 [2024-11-26 15:38:36.676805] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:45.354 [2024-11-26 15:38:36.676896] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:45.354 EAL: No free 2048 kB hugepages reported on node 1 00:14:45.354 [2024-11-26 15:38:36.749893] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:45.613 [2024-11-26 15:38:36.856294] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:45.613 [2024-11-26 15:38:36.856466] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:45.613 [2024-11-26 15:38:36.856484] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:45.613 [2024-11-26 15:38:36.856495] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:45.613 [2024-11-26 15:38:36.856530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:46.547 15:38:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:46.547 15:38:37 -- common/autotest_common.sh@862 -- # return 0 00:14:46.547 15:38:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:46.548 15:38:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:46.548 15:38:37 -- common/autotest_common.sh@10 -- # set +x 00:14:46.548 15:38:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:46.548 15:38:37 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:46.548 [2024-11-26 15:38:37.911840] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:14:46.548 [2024-11-26 15:38:37.911991] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:14:46.548 [2024-11-26 15:38:37.912047] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:14:46.548 15:38:37 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:14:46.548 15:38:37 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b 00:14:46.548 15:38:37 -- common/autotest_common.sh@897 -- # local bdev_name=ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b 00:14:46.548 15:38:37 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:46.548 15:38:37 -- common/autotest_common.sh@899 -- # local i 00:14:46.548 15:38:37 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:46.548 15:38:37 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:46.548 15:38:37 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:46.806 15:38:38 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b -t 2000 00:14:47.065 [ 00:14:47.065 { 00:14:47.065 "name": "ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b", 00:14:47.065 "aliases": [ 00:14:47.065 "lvs/lvol" 00:14:47.065 ], 00:14:47.065 "product_name": "Logical Volume", 00:14:47.065 "block_size": 4096, 00:14:47.065 "num_blocks": 38912, 00:14:47.065 "uuid": "ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b", 00:14:47.065 "assigned_rate_limits": { 00:14:47.065 "rw_ios_per_sec": 0, 00:14:47.065 "rw_mbytes_per_sec": 0, 00:14:47.065 "r_mbytes_per_sec": 0, 00:14:47.065 "w_mbytes_per_sec": 0 00:14:47.065 }, 00:14:47.065 "claimed": false, 00:14:47.065 "zoned": false, 00:14:47.065 "supported_io_types": { 00:14:47.065 "read": true, 00:14:47.065 "write": true, 00:14:47.065 "unmap": true, 00:14:47.065 "write_zeroes": true, 00:14:47.065 "flush": false, 00:14:47.065 "reset": true, 00:14:47.065 "compare": false, 00:14:47.065 "compare_and_write": false, 00:14:47.065 "abort": false, 00:14:47.065 "nvme_admin": false, 00:14:47.065 "nvme_io": false 00:14:47.065 }, 00:14:47.065 "driver_specific": { 00:14:47.065 "lvol": { 00:14:47.065 "lvol_store_uuid": "812c7273-0c13-4048-852e-ea1674b5649e", 00:14:47.065 "base_bdev": "aio_bdev", 00:14:47.065 "thin_provision": false, 00:14:47.065 "snapshot": false, 00:14:47.065 "clone": false, 00:14:47.065 "esnap_clone": false 00:14:47.065 } 00:14:47.065 } 00:14:47.065 } 00:14:47.065 ] 00:14:47.065 15:38:38 -- common/autotest_common.sh@905 -- # return 0 00:14:47.065 15:38:38 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 812c7273-0c13-4048-852e-ea1674b5649e 00:14:47.065 15:38:38 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:14:47.324 15:38:38 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:14:47.324 15:38:38 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 812c7273-0c13-4048-852e-ea1674b5649e 00:14:47.324 15:38:38 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:14:47.582 15:38:38 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:14:47.582 15:38:38 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:47.841 [2024-11-26 15:38:39.176815] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:47.841 15:38:39 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 812c7273-0c13-4048-852e-ea1674b5649e 00:14:47.841 15:38:39 -- common/autotest_common.sh@650 -- # local es=0 00:14:47.841 15:38:39 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 812c7273-0c13-4048-852e-ea1674b5649e 00:14:47.841 15:38:39 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:47.841 15:38:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:47.841 15:38:39 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:47.841 15:38:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:47.841 15:38:39 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:47.841 15:38:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:47.841 15:38:39 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:47.841 15:38:39 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:47.841 15:38:39 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 812c7273-0c13-4048-852e-ea1674b5649e 00:14:48.097 request: 00:14:48.097 { 00:14:48.097 "uuid": "812c7273-0c13-4048-852e-ea1674b5649e", 00:14:48.097 "method": "bdev_lvol_get_lvstores", 00:14:48.097 "req_id": 1 00:14:48.097 } 00:14:48.097 Got JSON-RPC error response 00:14:48.097 response: 00:14:48.097 { 00:14:48.097 "code": -19, 00:14:48.097 "message": "No such device" 00:14:48.097 } 00:14:48.097 15:38:39 -- common/autotest_common.sh@653 -- # es=1 00:14:48.097 15:38:39 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:48.097 15:38:39 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:48.097 15:38:39 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:48.097 15:38:39 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:48.355 aio_bdev 00:14:48.355 15:38:39 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b 00:14:48.355 15:38:39 -- common/autotest_common.sh@897 -- # local bdev_name=ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b 00:14:48.355 15:38:39 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:48.355 15:38:39 -- common/autotest_common.sh@899 -- # local i 00:14:48.355 15:38:39 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:48.355 15:38:39 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:48.355 15:38:39 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:48.614 15:38:39 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b -t 2000 00:14:48.872 [ 00:14:48.872 { 00:14:48.872 "name": "ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b", 00:14:48.872 "aliases": [ 00:14:48.872 "lvs/lvol" 00:14:48.872 ], 00:14:48.872 "product_name": "Logical Volume", 00:14:48.872 "block_size": 4096, 00:14:48.872 "num_blocks": 38912, 00:14:48.872 "uuid": "ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b", 00:14:48.872 "assigned_rate_limits": { 00:14:48.872 "rw_ios_per_sec": 0, 00:14:48.872 "rw_mbytes_per_sec": 0, 00:14:48.872 "r_mbytes_per_sec": 0, 00:14:48.872 "w_mbytes_per_sec": 0 00:14:48.872 }, 00:14:48.872 "claimed": false, 00:14:48.872 "zoned": false, 00:14:48.872 "supported_io_types": { 00:14:48.872 "read": true, 00:14:48.872 "write": true, 00:14:48.872 "unmap": true, 00:14:48.872 "write_zeroes": true, 00:14:48.872 "flush": false, 00:14:48.872 "reset": true, 00:14:48.872 "compare": false, 00:14:48.872 "compare_and_write": false, 00:14:48.872 "abort": false, 00:14:48.872 "nvme_admin": false, 00:14:48.872 "nvme_io": false 00:14:48.872 }, 00:14:48.872 "driver_specific": { 00:14:48.872 "lvol": { 00:14:48.872 "lvol_store_uuid": "812c7273-0c13-4048-852e-ea1674b5649e", 00:14:48.872 "base_bdev": "aio_bdev", 00:14:48.872 "thin_provision": false, 00:14:48.872 "snapshot": false, 00:14:48.872 "clone": false, 00:14:48.872 "esnap_clone": false 00:14:48.872 } 00:14:48.872 } 00:14:48.872 } 00:14:48.872 ] 00:14:48.872 15:38:40 -- common/autotest_common.sh@905 -- # return 0 00:14:48.872 15:38:40 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 812c7273-0c13-4048-852e-ea1674b5649e 00:14:48.872 15:38:40 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:49.130 15:38:40 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:49.130 15:38:40 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 812c7273-0c13-4048-852e-ea1674b5649e 00:14:49.130 15:38:40 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:49.388 15:38:40 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:49.388 15:38:40 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ed19a588-22d7-41ae-aa65-fbd4fd5bbb6b 00:14:49.647 15:38:40 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 812c7273-0c13-4048-852e-ea1674b5649e 00:14:49.905 15:38:41 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:50.164 15:38:41 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:50.164 00:14:50.164 real 0m20.137s 00:14:50.164 user 0m50.922s 00:14:50.164 sys 0m4.561s 00:14:50.164 15:38:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:50.164 15:38:41 -- common/autotest_common.sh@10 -- # set +x 00:14:50.164 ************************************ 00:14:50.164 END TEST lvs_grow_dirty 00:14:50.164 ************************************ 00:14:50.164 15:38:41 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:14:50.164 15:38:41 -- common/autotest_common.sh@806 -- # type=--id 00:14:50.164 15:38:41 -- common/autotest_common.sh@807 -- # id=0 00:14:50.164 15:38:41 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:14:50.164 15:38:41 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:14:50.164 15:38:41 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:14:50.164 15:38:41 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:14:50.164 15:38:41 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:14:50.164 15:38:41 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:14:50.164 nvmf_trace.0 00:14:50.164 15:38:41 -- common/autotest_common.sh@821 -- # return 0 00:14:50.164 15:38:41 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:14:50.164 15:38:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:50.164 15:38:41 -- nvmf/common.sh@116 -- # sync 00:14:50.164 15:38:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:50.164 15:38:41 -- nvmf/common.sh@119 -- # set +e 00:14:50.164 15:38:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:50.164 15:38:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:50.164 rmmod nvme_tcp 00:14:50.164 rmmod nvme_fabrics 00:14:50.422 rmmod nvme_keyring 00:14:50.422 15:38:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:50.422 15:38:41 -- nvmf/common.sh@123 -- # set -e 00:14:50.422 15:38:41 -- nvmf/common.sh@124 -- # return 0 00:14:50.422 15:38:41 -- nvmf/common.sh@477 -- # '[' -n 854187 ']' 00:14:50.422 15:38:41 -- nvmf/common.sh@478 -- # killprocess 854187 00:14:50.422 15:38:41 -- common/autotest_common.sh@936 -- # '[' -z 854187 ']' 00:14:50.422 15:38:41 -- common/autotest_common.sh@940 -- # kill -0 854187 00:14:50.422 15:38:41 -- common/autotest_common.sh@941 -- # uname 00:14:50.422 15:38:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:50.422 15:38:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 854187 00:14:50.422 15:38:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:50.422 15:38:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:50.422 15:38:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 854187' 00:14:50.422 killing process with pid 854187 00:14:50.422 15:38:41 -- common/autotest_common.sh@955 -- # kill 854187 00:14:50.422 15:38:41 -- common/autotest_common.sh@960 -- # wait 854187 00:14:50.682 15:38:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:50.682 15:38:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:50.682 15:38:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:50.682 15:38:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:50.682 15:38:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:50.682 15:38:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:50.682 15:38:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:50.682 15:38:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:52.587 15:38:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:52.587 00:14:52.587 real 0m44.237s 00:14:52.587 user 1m15.536s 00:14:52.587 sys 0m8.169s 00:14:52.587 15:38:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:52.587 15:38:43 -- common/autotest_common.sh@10 -- # set +x 00:14:52.587 ************************************ 00:14:52.587 END TEST nvmf_lvs_grow 00:14:52.587 ************************************ 00:14:52.587 15:38:43 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:14:52.587 15:38:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:52.587 15:38:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:52.587 15:38:43 -- common/autotest_common.sh@10 -- # set +x 00:14:52.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:14:52.588 ************************************ 00:14:52.588 START TEST nvmf_bdev_io_wait 00:14:52.588 ************************************ 00:14:52.588 15:38:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:14:52.847 * Looking for test storage... 00:14:52.847 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:52.847 15:38:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:52.847 15:38:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:52.847 15:38:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:52.847 15:38:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:52.847 15:38:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:52.847 15:38:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:52.847 15:38:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:52.847 15:38:44 -- scripts/common.sh@335 -- # IFS=.-: 00:14:52.847 15:38:44 -- scripts/common.sh@335 -- # read -ra ver1 00:14:52.847 15:38:44 -- scripts/common.sh@336 -- # IFS=.-: 00:14:52.847 15:38:44 -- scripts/common.sh@336 -- # read -ra ver2 00:14:52.847 15:38:44 -- scripts/common.sh@337 -- # local 'op=<' 00:14:52.847 15:38:44 -- scripts/common.sh@339 -- # ver1_l=2 00:14:52.847 15:38:44 -- scripts/common.sh@340 -- # ver2_l=1 00:14:52.847 15:38:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:52.847 15:38:44 -- scripts/common.sh@343 -- # case "$op" in 00:14:52.847 15:38:44 -- scripts/common.sh@344 -- # : 1 00:14:52.847 15:38:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:52.847 15:38:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:52.847 15:38:44 -- scripts/common.sh@364 -- # decimal 1 00:14:52.847 15:38:44 -- scripts/common.sh@352 -- # local d=1 00:14:52.847 15:38:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:52.847 15:38:44 -- scripts/common.sh@354 -- # echo 1 00:14:52.847 15:38:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:52.847 15:38:44 -- scripts/common.sh@365 -- # decimal 2 00:14:52.847 15:38:44 -- scripts/common.sh@352 -- # local d=2 00:14:52.847 15:38:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:52.847 15:38:44 -- scripts/common.sh@354 -- # echo 2 00:14:52.847 15:38:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:52.847 15:38:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:52.847 15:38:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:52.847 15:38:44 -- scripts/common.sh@367 -- # return 0 00:14:52.847 15:38:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:52.847 15:38:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:52.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.847 --rc genhtml_branch_coverage=1 00:14:52.847 --rc genhtml_function_coverage=1 00:14:52.847 --rc genhtml_legend=1 00:14:52.847 --rc geninfo_all_blocks=1 00:14:52.847 --rc geninfo_unexecuted_blocks=1 00:14:52.847 00:14:52.847 ' 00:14:52.847 15:38:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:52.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.847 --rc genhtml_branch_coverage=1 00:14:52.847 --rc genhtml_function_coverage=1 00:14:52.847 --rc genhtml_legend=1 00:14:52.847 --rc geninfo_all_blocks=1 00:14:52.847 --rc geninfo_unexecuted_blocks=1 00:14:52.847 00:14:52.847 ' 00:14:52.847 15:38:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:52.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.847 --rc genhtml_branch_coverage=1 00:14:52.847 --rc genhtml_function_coverage=1 00:14:52.847 --rc genhtml_legend=1 00:14:52.848 --rc geninfo_all_blocks=1 00:14:52.848 --rc geninfo_unexecuted_blocks=1 00:14:52.848 00:14:52.848 ' 00:14:52.848 15:38:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:52.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:52.848 --rc genhtml_branch_coverage=1 00:14:52.848 --rc genhtml_function_coverage=1 00:14:52.848 --rc genhtml_legend=1 00:14:52.848 --rc geninfo_all_blocks=1 00:14:52.848 --rc geninfo_unexecuted_blocks=1 00:14:52.848 00:14:52.848 ' 00:14:52.848 15:38:44 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:52.848 15:38:44 -- nvmf/common.sh@7 -- # uname -s 00:14:52.848 15:38:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:52.848 15:38:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:52.848 15:38:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:52.848 15:38:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:52.848 15:38:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:52.848 15:38:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:52.848 15:38:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:52.848 15:38:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:52.848 15:38:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:52.848 15:38:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:52.848 15:38:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:52.848 15:38:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:52.848 15:38:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:52.848 15:38:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:52.848 15:38:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:52.848 15:38:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:52.848 15:38:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:52.848 15:38:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:52.848 15:38:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:52.848 15:38:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.848 15:38:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.848 15:38:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.848 15:38:44 -- paths/export.sh@5 -- # export PATH 00:14:52.848 15:38:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:52.848 15:38:44 -- nvmf/common.sh@46 -- # : 0 00:14:52.848 15:38:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:52.848 15:38:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:52.848 15:38:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:52.848 15:38:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:52.848 15:38:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:52.848 15:38:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:52.848 15:38:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:52.848 15:38:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:52.848 15:38:44 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:52.848 15:38:44 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:52.848 15:38:44 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:14:52.848 15:38:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:52.848 15:38:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:52.848 15:38:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:52.848 15:38:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:52.848 15:38:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:52.848 15:38:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:52.848 15:38:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:52.848 15:38:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:52.848 15:38:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:52.848 15:38:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:52.848 15:38:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:52.848 15:38:44 -- common/autotest_common.sh@10 -- # set +x 00:14:54.749 15:38:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:54.749 15:38:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:54.749 15:38:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:54.749 15:38:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:54.749 15:38:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:54.749 15:38:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:54.749 15:38:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:54.749 15:38:46 -- nvmf/common.sh@294 -- # net_devs=() 00:14:54.749 15:38:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:54.750 15:38:46 -- nvmf/common.sh@295 -- # e810=() 00:14:54.750 15:38:46 -- nvmf/common.sh@295 -- # local -ga e810 00:14:54.750 15:38:46 -- nvmf/common.sh@296 -- # x722=() 00:14:54.750 15:38:46 -- nvmf/common.sh@296 -- # local -ga x722 00:14:54.750 15:38:46 -- nvmf/common.sh@297 -- # mlx=() 00:14:54.750 15:38:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:54.750 15:38:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:54.750 15:38:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:54.750 15:38:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:54.750 15:38:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:54.750 15:38:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:54.750 15:38:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:54.750 15:38:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:54.750 15:38:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:54.750 15:38:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:54.750 15:38:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:54.750 15:38:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:54.750 15:38:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:54.750 15:38:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:54.750 15:38:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:54.750 15:38:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:54.750 15:38:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:54.750 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:54.750 15:38:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:54.750 15:38:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:54.750 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:54.750 15:38:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:54.750 15:38:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:54.750 15:38:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:54.750 15:38:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:54.750 15:38:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:54.750 15:38:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:54.750 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:54.750 15:38:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:54.750 15:38:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:54.750 15:38:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:54.750 15:38:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:54.750 15:38:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:54.750 15:38:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:54.750 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:54.750 15:38:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:54.750 15:38:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:54.750 15:38:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:54.750 15:38:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:54.750 15:38:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:54.750 15:38:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:54.750 15:38:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:54.750 15:38:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:54.750 15:38:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:54.750 15:38:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:54.750 15:38:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:54.750 15:38:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:54.750 15:38:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:54.750 15:38:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:54.750 15:38:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:54.750 15:38:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:54.750 15:38:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:54.750 15:38:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:55.008 15:38:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:55.008 15:38:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:55.008 15:38:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:55.008 15:38:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:55.008 15:38:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:55.008 15:38:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:55.008 15:38:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:55.008 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:55.008 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.143 ms 00:14:55.008 00:14:55.008 --- 10.0.0.2 ping statistics --- 00:14:55.008 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:55.008 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:14:55.008 15:38:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:55.008 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:55.008 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:14:55.008 00:14:55.008 --- 10.0.0.1 ping statistics --- 00:14:55.008 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:55.008 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:14:55.008 15:38:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:55.008 15:38:46 -- nvmf/common.sh@410 -- # return 0 00:14:55.008 15:38:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:55.008 15:38:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:55.008 15:38:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:55.008 15:38:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:55.008 15:38:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:55.008 15:38:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:55.008 15:38:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:55.008 15:38:46 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:14:55.008 15:38:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:55.008 15:38:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:55.008 15:38:46 -- common/autotest_common.sh@10 -- # set +x 00:14:55.008 15:38:46 -- nvmf/common.sh@469 -- # nvmfpid=856815 00:14:55.008 15:38:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:14:55.008 15:38:46 -- nvmf/common.sh@470 -- # waitforlisten 856815 00:14:55.008 15:38:46 -- common/autotest_common.sh@829 -- # '[' -z 856815 ']' 00:14:55.008 15:38:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:55.008 15:38:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:55.008 15:38:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:55.008 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:55.008 15:38:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:55.008 15:38:46 -- common/autotest_common.sh@10 -- # set +x 00:14:55.008 [2024-11-26 15:38:46.336195] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:55.008 [2024-11-26 15:38:46.336265] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:55.009 EAL: No free 2048 kB hugepages reported on node 1 00:14:55.009 [2024-11-26 15:38:46.398729] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:55.267 [2024-11-26 15:38:46.505834] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:55.267 [2024-11-26 15:38:46.505978] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:55.267 [2024-11-26 15:38:46.506011] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:55.267 [2024-11-26 15:38:46.506027] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:55.267 [2024-11-26 15:38:46.506081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:55.267 [2024-11-26 15:38:46.506143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:55.267 [2024-11-26 15:38:46.506209] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:55.267 [2024-11-26 15:38:46.506215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:55.267 15:38:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:55.267 15:38:46 -- common/autotest_common.sh@862 -- # return 0 00:14:55.267 15:38:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:55.267 15:38:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:55.267 15:38:46 -- common/autotest_common.sh@10 -- # set +x 00:14:55.267 15:38:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:55.267 15:38:46 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:14:55.267 15:38:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.267 15:38:46 -- common/autotest_common.sh@10 -- # set +x 00:14:55.267 15:38:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.267 15:38:46 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:14:55.267 15:38:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.267 15:38:46 -- common/autotest_common.sh@10 -- # set +x 00:14:55.267 15:38:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.267 15:38:46 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:55.267 15:38:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.267 15:38:46 -- common/autotest_common.sh@10 -- # set +x 00:14:55.267 [2024-11-26 15:38:46.655800] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:55.267 15:38:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.267 15:38:46 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:55.267 15:38:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.267 15:38:46 -- common/autotest_common.sh@10 -- # set +x 00:14:55.267 Malloc0 00:14:55.267 15:38:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.267 15:38:46 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:55.267 15:38:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.267 15:38:46 -- common/autotest_common.sh@10 -- # set +x 00:14:55.267 15:38:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.267 15:38:46 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:55.267 15:38:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.267 15:38:46 -- common/autotest_common.sh@10 -- # set +x 00:14:55.267 15:38:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.267 15:38:46 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:55.267 15:38:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.267 15:38:46 -- common/autotest_common.sh@10 -- # set +x 00:14:55.526 [2024-11-26 15:38:46.717445] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:55.526 15:38:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.526 15:38:46 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=856839 00:14:55.526 15:38:46 -- target/bdev_io_wait.sh@30 -- # READ_PID=856840 00:14:55.526 15:38:46 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:14:55.526 15:38:46 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:14:55.526 15:38:46 -- nvmf/common.sh@520 -- # config=() 00:14:55.526 15:38:46 -- nvmf/common.sh@520 -- # local subsystem config 00:14:55.527 15:38:46 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=856843 00:14:55.527 15:38:46 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:14:55.527 15:38:46 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:14:55.527 15:38:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:55.527 15:38:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:55.527 { 00:14:55.527 "params": { 00:14:55.527 "name": "Nvme$subsystem", 00:14:55.527 "trtype": "$TEST_TRANSPORT", 00:14:55.527 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:55.527 "adrfam": "ipv4", 00:14:55.527 "trsvcid": "$NVMF_PORT", 00:14:55.527 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:55.527 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:55.527 "hdgst": ${hdgst:-false}, 00:14:55.527 "ddgst": ${ddgst:-false} 00:14:55.527 }, 00:14:55.527 "method": "bdev_nvme_attach_controller" 00:14:55.527 } 00:14:55.527 EOF 00:14:55.527 )") 00:14:55.527 15:38:46 -- nvmf/common.sh@520 -- # config=() 00:14:55.527 15:38:46 -- nvmf/common.sh@520 -- # local subsystem config 00:14:55.527 15:38:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:55.527 15:38:46 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=856845 00:14:55.527 15:38:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:55.527 { 00:14:55.527 "params": { 00:14:55.527 "name": "Nvme$subsystem", 00:14:55.527 "trtype": "$TEST_TRANSPORT", 00:14:55.527 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:55.527 "adrfam": "ipv4", 00:14:55.527 "trsvcid": "$NVMF_PORT", 00:14:55.527 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:55.527 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:55.527 "hdgst": ${hdgst:-false}, 00:14:55.527 "ddgst": ${ddgst:-false} 00:14:55.527 }, 00:14:55.527 "method": "bdev_nvme_attach_controller" 00:14:55.527 } 00:14:55.527 EOF 00:14:55.527 )") 00:14:55.527 15:38:46 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:14:55.527 15:38:46 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:14:55.527 15:38:46 -- target/bdev_io_wait.sh@35 -- # sync 00:14:55.527 15:38:46 -- nvmf/common.sh@520 -- # config=() 00:14:55.527 15:38:46 -- nvmf/common.sh@520 -- # local subsystem config 00:14:55.527 15:38:46 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:14:55.527 15:38:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:55.527 15:38:46 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:14:55.527 15:38:46 -- nvmf/common.sh@542 -- # cat 00:14:55.527 15:38:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:55.527 { 00:14:55.527 "params": { 00:14:55.527 "name": "Nvme$subsystem", 00:14:55.527 "trtype": "$TEST_TRANSPORT", 00:14:55.527 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:55.527 "adrfam": "ipv4", 00:14:55.527 "trsvcid": "$NVMF_PORT", 00:14:55.527 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:55.527 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:55.527 "hdgst": ${hdgst:-false}, 00:14:55.527 "ddgst": ${ddgst:-false} 00:14:55.527 }, 00:14:55.527 "method": "bdev_nvme_attach_controller" 00:14:55.527 } 00:14:55.527 EOF 00:14:55.527 )") 00:14:55.527 15:38:46 -- nvmf/common.sh@520 -- # config=() 00:14:55.527 15:38:46 -- nvmf/common.sh@520 -- # local subsystem config 00:14:55.527 15:38:46 -- nvmf/common.sh@542 -- # cat 00:14:55.527 15:38:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:55.527 15:38:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:55.527 { 00:14:55.527 "params": { 00:14:55.527 "name": "Nvme$subsystem", 00:14:55.527 "trtype": "$TEST_TRANSPORT", 00:14:55.527 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:55.527 "adrfam": "ipv4", 00:14:55.527 "trsvcid": "$NVMF_PORT", 00:14:55.527 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:55.527 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:55.527 "hdgst": ${hdgst:-false}, 00:14:55.527 "ddgst": ${ddgst:-false} 00:14:55.527 }, 00:14:55.527 "method": "bdev_nvme_attach_controller" 00:14:55.527 } 00:14:55.527 EOF 00:14:55.527 )") 00:14:55.527 15:38:46 -- nvmf/common.sh@542 -- # cat 00:14:55.527 15:38:46 -- target/bdev_io_wait.sh@37 -- # wait 856839 00:14:55.527 15:38:46 -- nvmf/common.sh@542 -- # cat 00:14:55.527 15:38:46 -- nvmf/common.sh@544 -- # jq . 00:14:55.527 15:38:46 -- nvmf/common.sh@544 -- # jq . 00:14:55.527 15:38:46 -- nvmf/common.sh@544 -- # jq . 00:14:55.527 15:38:46 -- nvmf/common.sh@545 -- # IFS=, 00:14:55.527 15:38:46 -- nvmf/common.sh@544 -- # jq . 00:14:55.527 15:38:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:55.527 "params": { 00:14:55.527 "name": "Nvme1", 00:14:55.527 "trtype": "tcp", 00:14:55.527 "traddr": "10.0.0.2", 00:14:55.527 "adrfam": "ipv4", 00:14:55.527 "trsvcid": "4420", 00:14:55.527 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:55.527 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:55.527 "hdgst": false, 00:14:55.527 "ddgst": false 00:14:55.527 }, 00:14:55.527 "method": "bdev_nvme_attach_controller" 00:14:55.527 }' 00:14:55.527 15:38:46 -- nvmf/common.sh@545 -- # IFS=, 00:14:55.527 15:38:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:55.527 "params": { 00:14:55.527 "name": "Nvme1", 00:14:55.527 "trtype": "tcp", 00:14:55.527 "traddr": "10.0.0.2", 00:14:55.527 "adrfam": "ipv4", 00:14:55.527 "trsvcid": "4420", 00:14:55.527 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:55.527 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:55.527 "hdgst": false, 00:14:55.527 "ddgst": false 00:14:55.527 }, 00:14:55.527 "method": "bdev_nvme_attach_controller" 00:14:55.527 }' 00:14:55.527 15:38:46 -- nvmf/common.sh@545 -- # IFS=, 00:14:55.527 15:38:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:55.527 "params": { 00:14:55.527 "name": "Nvme1", 00:14:55.527 "trtype": "tcp", 00:14:55.527 "traddr": "10.0.0.2", 00:14:55.527 "adrfam": "ipv4", 00:14:55.527 "trsvcid": "4420", 00:14:55.527 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:55.527 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:55.527 "hdgst": false, 00:14:55.527 "ddgst": false 00:14:55.527 }, 00:14:55.527 "method": "bdev_nvme_attach_controller" 00:14:55.527 }' 00:14:55.527 15:38:46 -- nvmf/common.sh@545 -- # IFS=, 00:14:55.527 15:38:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:55.527 "params": { 00:14:55.527 "name": "Nvme1", 00:14:55.527 "trtype": "tcp", 00:14:55.527 "traddr": "10.0.0.2", 00:14:55.527 "adrfam": "ipv4", 00:14:55.527 "trsvcid": "4420", 00:14:55.527 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:55.527 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:55.527 "hdgst": false, 00:14:55.527 "ddgst": false 00:14:55.527 }, 00:14:55.527 "method": "bdev_nvme_attach_controller" 00:14:55.527 }' 00:14:55.527 [2024-11-26 15:38:46.761344] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:55.527 [2024-11-26 15:38:46.761428] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:14:55.527 [2024-11-26 15:38:46.761871] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:55.527 [2024-11-26 15:38:46.761867] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:55.527 [2024-11-26 15:38:46.761867] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:55.527 [2024-11-26 15:38:46.761949] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-26 15:38:46.761949] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-26 15:38:46.761950] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:14:55.527 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:14:55.527 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:14:55.527 EAL: No free 2048 kB hugepages reported on node 1 00:14:55.527 EAL: No free 2048 kB hugepages reported on node 1 00:14:55.527 [2024-11-26 15:38:46.932075] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:55.786 EAL: No free 2048 kB hugepages reported on node 1 00:14:55.786 [2024-11-26 15:38:47.026038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:14:55.786 [2024-11-26 15:38:47.030616] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:55.786 EAL: No free 2048 kB hugepages reported on node 1 00:14:55.786 [2024-11-26 15:38:47.127923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:14:55.786 [2024-11-26 15:38:47.132770] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:55.786 [2024-11-26 15:38:47.203260] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:55.786 [2024-11-26 15:38:47.229921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:56.044 [2024-11-26 15:38:47.295173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:14:56.044 Running I/O for 1 seconds... 00:14:56.044 Running I/O for 1 seconds... 00:14:56.044 Running I/O for 1 seconds... 00:14:56.302 Running I/O for 1 seconds... 00:14:57.235 00:14:57.235 Latency(us) 00:14:57.235 [2024-11-26T14:38:48.688Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:57.235 [2024-11-26T14:38:48.688Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:14:57.235 Nvme1n1 : 1.02 6603.30 25.79 0.00 0.00 19251.98 8301.23 30098.01 00:14:57.235 [2024-11-26T14:38:48.688Z] =================================================================================================================== 00:14:57.235 [2024-11-26T14:38:48.688Z] Total : 6603.30 25.79 0.00 0.00 19251.98 8301.23 30098.01 00:14:57.235 00:14:57.235 Latency(us) 00:14:57.235 [2024-11-26T14:38:48.689Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:57.236 [2024-11-26T14:38:48.689Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:14:57.236 Nvme1n1 : 1.00 188677.96 737.02 0.00 0.00 675.82 280.65 892.02 00:14:57.236 [2024-11-26T14:38:48.689Z] =================================================================================================================== 00:14:57.236 [2024-11-26T14:38:48.689Z] Total : 188677.96 737.02 0.00 0.00 675.82 280.65 892.02 00:14:57.236 00:14:57.236 Latency(us) 00:14:57.236 [2024-11-26T14:38:48.689Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:57.236 [2024-11-26T14:38:48.689Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:14:57.236 Nvme1n1 : 1.01 6463.45 25.25 0.00 0.00 19737.52 6019.60 37865.24 00:14:57.236 [2024-11-26T14:38:48.689Z] =================================================================================================================== 00:14:57.236 [2024-11-26T14:38:48.689Z] Total : 6463.45 25.25 0.00 0.00 19737.52 6019.60 37865.24 00:14:57.236 00:14:57.236 Latency(us) 00:14:57.236 [2024-11-26T14:38:48.689Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:57.236 [2024-11-26T14:38:48.689Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:14:57.236 Nvme1n1 : 1.01 10837.78 42.34 0.00 0.00 11765.42 6116.69 21942.42 00:14:57.236 [2024-11-26T14:38:48.689Z] =================================================================================================================== 00:14:57.236 [2024-11-26T14:38:48.689Z] Total : 10837.78 42.34 0.00 0.00 11765.42 6116.69 21942.42 00:14:57.494 15:38:48 -- target/bdev_io_wait.sh@38 -- # wait 856840 00:14:57.494 15:38:48 -- target/bdev_io_wait.sh@39 -- # wait 856843 00:14:57.494 15:38:48 -- target/bdev_io_wait.sh@40 -- # wait 856845 00:14:57.753 15:38:48 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:57.753 15:38:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.753 15:38:48 -- common/autotest_common.sh@10 -- # set +x 00:14:57.753 15:38:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.753 15:38:48 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:14:57.753 15:38:48 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:14:57.753 15:38:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:57.753 15:38:48 -- nvmf/common.sh@116 -- # sync 00:14:57.753 15:38:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:57.753 15:38:48 -- nvmf/common.sh@119 -- # set +e 00:14:57.753 15:38:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:57.753 15:38:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:57.753 rmmod nvme_tcp 00:14:57.753 rmmod nvme_fabrics 00:14:57.753 rmmod nvme_keyring 00:14:57.753 15:38:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:57.753 15:38:49 -- nvmf/common.sh@123 -- # set -e 00:14:57.753 15:38:49 -- nvmf/common.sh@124 -- # return 0 00:14:57.753 15:38:49 -- nvmf/common.sh@477 -- # '[' -n 856815 ']' 00:14:57.753 15:38:49 -- nvmf/common.sh@478 -- # killprocess 856815 00:14:57.753 15:38:49 -- common/autotest_common.sh@936 -- # '[' -z 856815 ']' 00:14:57.753 15:38:49 -- common/autotest_common.sh@940 -- # kill -0 856815 00:14:57.753 15:38:49 -- common/autotest_common.sh@941 -- # uname 00:14:57.753 15:38:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:57.753 15:38:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 856815 00:14:57.753 15:38:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:57.753 15:38:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:57.753 15:38:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 856815' 00:14:57.753 killing process with pid 856815 00:14:57.753 15:38:49 -- common/autotest_common.sh@955 -- # kill 856815 00:14:57.753 15:38:49 -- common/autotest_common.sh@960 -- # wait 856815 00:14:58.010 15:38:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:58.010 15:38:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:58.010 15:38:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:58.010 15:38:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:58.010 15:38:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:58.010 15:38:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:58.010 15:38:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:58.010 15:38:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:59.915 15:38:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:59.915 00:14:59.915 real 0m7.355s 00:14:59.915 user 0m16.881s 00:14:59.915 sys 0m3.580s 00:14:59.915 15:38:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:59.915 15:38:51 -- common/autotest_common.sh@10 -- # set +x 00:14:59.915 ************************************ 00:14:59.915 END TEST nvmf_bdev_io_wait 00:14:59.915 ************************************ 00:15:00.175 15:38:51 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:00.175 15:38:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:00.175 15:38:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:00.175 15:38:51 -- common/autotest_common.sh@10 -- # set +x 00:15:00.175 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:15:00.175 ************************************ 00:15:00.175 START TEST nvmf_queue_depth 00:15:00.175 ************************************ 00:15:00.175 15:38:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:00.175 * Looking for test storage... 00:15:00.175 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:00.175 15:38:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:00.175 15:38:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:00.175 15:38:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:00.175 15:38:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:00.175 15:38:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:00.175 15:38:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:00.175 15:38:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:00.175 15:38:51 -- scripts/common.sh@335 -- # IFS=.-: 00:15:00.175 15:38:51 -- scripts/common.sh@335 -- # read -ra ver1 00:15:00.175 15:38:51 -- scripts/common.sh@336 -- # IFS=.-: 00:15:00.175 15:38:51 -- scripts/common.sh@336 -- # read -ra ver2 00:15:00.175 15:38:51 -- scripts/common.sh@337 -- # local 'op=<' 00:15:00.175 15:38:51 -- scripts/common.sh@339 -- # ver1_l=2 00:15:00.175 15:38:51 -- scripts/common.sh@340 -- # ver2_l=1 00:15:00.175 15:38:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:00.175 15:38:51 -- scripts/common.sh@343 -- # case "$op" in 00:15:00.175 15:38:51 -- scripts/common.sh@344 -- # : 1 00:15:00.175 15:38:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:00.175 15:38:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:00.175 15:38:51 -- scripts/common.sh@364 -- # decimal 1 00:15:00.175 15:38:51 -- scripts/common.sh@352 -- # local d=1 00:15:00.175 15:38:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:00.175 15:38:51 -- scripts/common.sh@354 -- # echo 1 00:15:00.175 15:38:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:00.175 15:38:51 -- scripts/common.sh@365 -- # decimal 2 00:15:00.175 15:38:51 -- scripts/common.sh@352 -- # local d=2 00:15:00.175 15:38:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:00.175 15:38:51 -- scripts/common.sh@354 -- # echo 2 00:15:00.175 15:38:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:00.175 15:38:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:00.175 15:38:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:00.175 15:38:51 -- scripts/common.sh@367 -- # return 0 00:15:00.175 15:38:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:00.175 15:38:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:00.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:00.175 --rc genhtml_branch_coverage=1 00:15:00.175 --rc genhtml_function_coverage=1 00:15:00.175 --rc genhtml_legend=1 00:15:00.175 --rc geninfo_all_blocks=1 00:15:00.175 --rc geninfo_unexecuted_blocks=1 00:15:00.175 00:15:00.175 ' 00:15:00.175 15:38:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:00.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:00.175 --rc genhtml_branch_coverage=1 00:15:00.175 --rc genhtml_function_coverage=1 00:15:00.175 --rc genhtml_legend=1 00:15:00.175 --rc geninfo_all_blocks=1 00:15:00.175 --rc geninfo_unexecuted_blocks=1 00:15:00.175 00:15:00.175 ' 00:15:00.175 15:38:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:00.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:00.175 --rc genhtml_branch_coverage=1 00:15:00.175 --rc genhtml_function_coverage=1 00:15:00.175 --rc genhtml_legend=1 00:15:00.175 --rc geninfo_all_blocks=1 00:15:00.175 --rc geninfo_unexecuted_blocks=1 00:15:00.175 00:15:00.175 ' 00:15:00.175 15:38:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:00.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:00.175 --rc genhtml_branch_coverage=1 00:15:00.175 --rc genhtml_function_coverage=1 00:15:00.175 --rc genhtml_legend=1 00:15:00.175 --rc geninfo_all_blocks=1 00:15:00.175 --rc geninfo_unexecuted_blocks=1 00:15:00.175 00:15:00.175 ' 00:15:00.175 15:38:51 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:00.175 15:38:51 -- nvmf/common.sh@7 -- # uname -s 00:15:00.175 15:38:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:00.175 15:38:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:00.175 15:38:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:00.175 15:38:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:00.175 15:38:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:00.175 15:38:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:00.175 15:38:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:00.175 15:38:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:00.175 15:38:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:00.175 15:38:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:00.175 15:38:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:00.175 15:38:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:00.175 15:38:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:00.175 15:38:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:00.175 15:38:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:00.175 15:38:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:00.175 15:38:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:00.175 15:38:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:00.175 15:38:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:00.175 15:38:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.175 15:38:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.175 15:38:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.175 15:38:51 -- paths/export.sh@5 -- # export PATH 00:15:00.175 15:38:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.175 15:38:51 -- nvmf/common.sh@46 -- # : 0 00:15:00.175 15:38:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:00.175 15:38:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:00.175 15:38:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:00.175 15:38:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:00.175 15:38:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:00.175 15:38:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:00.175 15:38:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:00.175 15:38:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:00.175 15:38:51 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:00.175 15:38:51 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:00.175 15:38:51 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:00.175 15:38:51 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:00.175 15:38:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:00.175 15:38:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:00.175 15:38:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:00.175 15:38:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:00.175 15:38:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:00.175 15:38:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:00.175 15:38:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:00.175 15:38:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:00.175 15:38:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:00.175 15:38:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:00.175 15:38:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:00.175 15:38:51 -- common/autotest_common.sh@10 -- # set +x 00:15:02.080 15:38:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:02.080 15:38:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:02.080 15:38:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:02.080 15:38:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:02.080 15:38:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:02.080 15:38:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:02.080 15:38:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:02.080 15:38:53 -- nvmf/common.sh@294 -- # net_devs=() 00:15:02.080 15:38:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:02.080 15:38:53 -- nvmf/common.sh@295 -- # e810=() 00:15:02.080 15:38:53 -- nvmf/common.sh@295 -- # local -ga e810 00:15:02.080 15:38:53 -- nvmf/common.sh@296 -- # x722=() 00:15:02.080 15:38:53 -- nvmf/common.sh@296 -- # local -ga x722 00:15:02.080 15:38:53 -- nvmf/common.sh@297 -- # mlx=() 00:15:02.080 15:38:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:02.080 15:38:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:02.080 15:38:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:02.080 15:38:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:02.080 15:38:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:02.080 15:38:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:02.080 15:38:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:02.080 15:38:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:02.080 15:38:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:02.080 15:38:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:02.080 15:38:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:02.080 15:38:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:02.080 15:38:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:02.080 15:38:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:02.080 15:38:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:02.080 15:38:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:02.080 15:38:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:02.080 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:02.080 15:38:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:02.080 15:38:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:02.080 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:02.080 15:38:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:02.080 15:38:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:02.080 15:38:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:02.080 15:38:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:02.080 15:38:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:02.080 15:38:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:02.080 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:02.080 15:38:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:02.080 15:38:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:02.080 15:38:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:02.080 15:38:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:02.080 15:38:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:02.080 15:38:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:02.080 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:02.080 15:38:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:02.080 15:38:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:02.080 15:38:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:02.080 15:38:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:02.080 15:38:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:02.080 15:38:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:02.080 15:38:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:02.080 15:38:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:02.080 15:38:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:02.080 15:38:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:02.080 15:38:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:02.080 15:38:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:02.080 15:38:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:02.080 15:38:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:02.080 15:38:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:02.080 15:38:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:02.080 15:38:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:02.080 15:38:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:02.339 15:38:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:02.339 15:38:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:02.339 15:38:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:02.339 15:38:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:02.339 15:38:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:02.339 15:38:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:02.339 15:38:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:02.339 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:02.339 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:15:02.339 00:15:02.339 --- 10.0.0.2 ping statistics --- 00:15:02.339 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:02.339 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:15:02.339 15:38:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:02.339 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:02.339 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:15:02.339 00:15:02.339 --- 10.0.0.1 ping statistics --- 00:15:02.339 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:02.339 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:15:02.339 15:38:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:02.339 15:38:53 -- nvmf/common.sh@410 -- # return 0 00:15:02.339 15:38:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:02.339 15:38:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:02.339 15:38:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:02.339 15:38:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:02.339 15:38:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:02.339 15:38:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:02.339 15:38:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:02.339 15:38:53 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:02.339 15:38:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:02.339 15:38:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:02.339 15:38:53 -- common/autotest_common.sh@10 -- # set +x 00:15:02.339 15:38:53 -- nvmf/common.sh@469 -- # nvmfpid=859046 00:15:02.339 15:38:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:02.339 15:38:53 -- nvmf/common.sh@470 -- # waitforlisten 859046 00:15:02.339 15:38:53 -- common/autotest_common.sh@829 -- # '[' -z 859046 ']' 00:15:02.339 15:38:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:02.340 15:38:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:02.340 15:38:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:02.340 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:02.340 15:38:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:02.340 15:38:53 -- common/autotest_common.sh@10 -- # set +x 00:15:02.340 [2024-11-26 15:38:53.668163] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:02.340 [2024-11-26 15:38:53.668235] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:02.340 EAL: No free 2048 kB hugepages reported on node 1 00:15:02.340 [2024-11-26 15:38:53.736061] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:02.599 [2024-11-26 15:38:53.855211] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:02.599 [2024-11-26 15:38:53.855366] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:02.599 [2024-11-26 15:38:53.855385] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:02.599 [2024-11-26 15:38:53.855397] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:02.599 [2024-11-26 15:38:53.855424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:03.533 15:38:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:03.533 15:38:54 -- common/autotest_common.sh@862 -- # return 0 00:15:03.533 15:38:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:03.533 15:38:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:03.533 15:38:54 -- common/autotest_common.sh@10 -- # set +x 00:15:03.533 15:38:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:03.533 15:38:54 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:03.533 15:38:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.533 15:38:54 -- common/autotest_common.sh@10 -- # set +x 00:15:03.533 [2024-11-26 15:38:54.710797] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:03.533 15:38:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.533 15:38:54 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:03.533 15:38:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.533 15:38:54 -- common/autotest_common.sh@10 -- # set +x 00:15:03.533 Malloc0 00:15:03.533 15:38:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.533 15:38:54 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:03.533 15:38:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.533 15:38:54 -- common/autotest_common.sh@10 -- # set +x 00:15:03.533 15:38:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.533 15:38:54 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:03.533 15:38:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.533 15:38:54 -- common/autotest_common.sh@10 -- # set +x 00:15:03.533 15:38:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.533 15:38:54 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:03.533 15:38:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.533 15:38:54 -- common/autotest_common.sh@10 -- # set +x 00:15:03.533 [2024-11-26 15:38:54.771521] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:03.533 15:38:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.533 15:38:54 -- target/queue_depth.sh@30 -- # bdevperf_pid=859198 00:15:03.533 15:38:54 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:03.533 15:38:54 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:03.533 15:38:54 -- target/queue_depth.sh@33 -- # waitforlisten 859198 /var/tmp/bdevperf.sock 00:15:03.533 15:38:54 -- common/autotest_common.sh@829 -- # '[' -z 859198 ']' 00:15:03.533 15:38:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:03.533 15:38:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:03.533 15:38:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:03.533 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:03.533 15:38:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:03.533 15:38:54 -- common/autotest_common.sh@10 -- # set +x 00:15:03.533 [2024-11-26 15:38:54.814289] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:03.533 [2024-11-26 15:38:54.814364] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid859198 ] 00:15:03.533 EAL: No free 2048 kB hugepages reported on node 1 00:15:03.533 [2024-11-26 15:38:54.875747] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:03.792 [2024-11-26 15:38:54.991031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:04.726 15:38:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:04.726 15:38:55 -- common/autotest_common.sh@862 -- # return 0 00:15:04.726 15:38:55 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:04.726 15:38:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.726 15:38:55 -- common/autotest_common.sh@10 -- # set +x 00:15:04.726 NVMe0n1 00:15:04.726 15:38:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.726 15:38:55 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:04.726 Running I/O for 10 seconds... 00:15:14.732 00:15:14.732 Latency(us) 00:15:14.732 [2024-11-26T14:39:06.185Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:14.732 [2024-11-26T14:39:06.185Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:14.732 Verification LBA range: start 0x0 length 0x4000 00:15:14.732 NVMe0n1 : 10.07 12336.87 48.19 0.00 0.00 82672.28 14951.92 61361.11 00:15:14.732 [2024-11-26T14:39:06.185Z] =================================================================================================================== 00:15:14.732 [2024-11-26T14:39:06.185Z] Total : 12336.87 48.19 0.00 0.00 82672.28 14951.92 61361.11 00:15:14.732 0 00:15:14.732 15:39:06 -- target/queue_depth.sh@39 -- # killprocess 859198 00:15:14.732 15:39:06 -- common/autotest_common.sh@936 -- # '[' -z 859198 ']' 00:15:14.732 15:39:06 -- common/autotest_common.sh@940 -- # kill -0 859198 00:15:14.732 15:39:06 -- common/autotest_common.sh@941 -- # uname 00:15:15.016 15:39:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:15.016 15:39:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 859198 00:15:15.016 15:39:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:15.016 15:39:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:15.016 15:39:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 859198' 00:15:15.016 killing process with pid 859198 00:15:15.016 15:39:06 -- common/autotest_common.sh@955 -- # kill 859198 00:15:15.016 Received shutdown signal, test time was about 10.000000 seconds 00:15:15.016 00:15:15.016 Latency(us) 00:15:15.016 [2024-11-26T14:39:06.469Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:15.016 [2024-11-26T14:39:06.469Z] =================================================================================================================== 00:15:15.016 [2024-11-26T14:39:06.469Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:15.016 15:39:06 -- common/autotest_common.sh@960 -- # wait 859198 00:15:15.016 15:39:06 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:15.016 15:39:06 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:15.016 15:39:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:15.016 15:39:06 -- nvmf/common.sh@116 -- # sync 00:15:15.016 15:39:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:15.016 15:39:06 -- nvmf/common.sh@119 -- # set +e 00:15:15.016 15:39:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:15.016 15:39:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:15.016 rmmod nvme_tcp 00:15:15.276 rmmod nvme_fabrics 00:15:15.276 rmmod nvme_keyring 00:15:15.276 15:39:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:15.276 15:39:06 -- nvmf/common.sh@123 -- # set -e 00:15:15.276 15:39:06 -- nvmf/common.sh@124 -- # return 0 00:15:15.276 15:39:06 -- nvmf/common.sh@477 -- # '[' -n 859046 ']' 00:15:15.276 15:39:06 -- nvmf/common.sh@478 -- # killprocess 859046 00:15:15.276 15:39:06 -- common/autotest_common.sh@936 -- # '[' -z 859046 ']' 00:15:15.276 15:39:06 -- common/autotest_common.sh@940 -- # kill -0 859046 00:15:15.276 15:39:06 -- common/autotest_common.sh@941 -- # uname 00:15:15.276 15:39:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:15.276 15:39:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 859046 00:15:15.276 15:39:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:15.276 15:39:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:15.276 15:39:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 859046' 00:15:15.276 killing process with pid 859046 00:15:15.276 15:39:06 -- common/autotest_common.sh@955 -- # kill 859046 00:15:15.276 15:39:06 -- common/autotest_common.sh@960 -- # wait 859046 00:15:15.534 15:39:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:15.534 15:39:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:15.534 15:39:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:15.534 15:39:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:15.534 15:39:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:15.534 15:39:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:15.534 15:39:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:15.534 15:39:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:18.069 15:39:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:18.069 00:15:18.069 real 0m17.526s 00:15:18.069 user 0m25.178s 00:15:18.069 sys 0m3.179s 00:15:18.069 15:39:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:18.069 15:39:08 -- common/autotest_common.sh@10 -- # set +x 00:15:18.069 ************************************ 00:15:18.069 END TEST nvmf_queue_depth 00:15:18.069 ************************************ 00:15:18.069 15:39:08 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:18.069 15:39:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:18.069 15:39:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:18.069 15:39:08 -- common/autotest_common.sh@10 -- # set +x 00:15:18.069 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:15:18.069 ************************************ 00:15:18.069 START TEST nvmf_multipath 00:15:18.069 ************************************ 00:15:18.069 15:39:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:18.069 * Looking for test storage... 00:15:18.069 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:18.069 15:39:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:18.069 15:39:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:18.069 15:39:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:18.069 15:39:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:18.069 15:39:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:18.069 15:39:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:18.069 15:39:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:18.069 15:39:09 -- scripts/common.sh@335 -- # IFS=.-: 00:15:18.069 15:39:09 -- scripts/common.sh@335 -- # read -ra ver1 00:15:18.069 15:39:09 -- scripts/common.sh@336 -- # IFS=.-: 00:15:18.069 15:39:09 -- scripts/common.sh@336 -- # read -ra ver2 00:15:18.069 15:39:09 -- scripts/common.sh@337 -- # local 'op=<' 00:15:18.069 15:39:09 -- scripts/common.sh@339 -- # ver1_l=2 00:15:18.069 15:39:09 -- scripts/common.sh@340 -- # ver2_l=1 00:15:18.069 15:39:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:18.069 15:39:09 -- scripts/common.sh@343 -- # case "$op" in 00:15:18.069 15:39:09 -- scripts/common.sh@344 -- # : 1 00:15:18.069 15:39:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:18.069 15:39:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:18.069 15:39:09 -- scripts/common.sh@364 -- # decimal 1 00:15:18.069 15:39:09 -- scripts/common.sh@352 -- # local d=1 00:15:18.069 15:39:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:18.069 15:39:09 -- scripts/common.sh@354 -- # echo 1 00:15:18.069 15:39:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:18.069 15:39:09 -- scripts/common.sh@365 -- # decimal 2 00:15:18.069 15:39:09 -- scripts/common.sh@352 -- # local d=2 00:15:18.069 15:39:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:18.069 15:39:09 -- scripts/common.sh@354 -- # echo 2 00:15:18.069 15:39:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:18.069 15:39:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:18.069 15:39:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:18.069 15:39:09 -- scripts/common.sh@367 -- # return 0 00:15:18.069 15:39:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:18.069 15:39:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:18.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.069 --rc genhtml_branch_coverage=1 00:15:18.069 --rc genhtml_function_coverage=1 00:15:18.069 --rc genhtml_legend=1 00:15:18.069 --rc geninfo_all_blocks=1 00:15:18.069 --rc geninfo_unexecuted_blocks=1 00:15:18.069 00:15:18.069 ' 00:15:18.069 15:39:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:18.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.069 --rc genhtml_branch_coverage=1 00:15:18.069 --rc genhtml_function_coverage=1 00:15:18.069 --rc genhtml_legend=1 00:15:18.069 --rc geninfo_all_blocks=1 00:15:18.069 --rc geninfo_unexecuted_blocks=1 00:15:18.069 00:15:18.069 ' 00:15:18.069 15:39:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:18.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.069 --rc genhtml_branch_coverage=1 00:15:18.069 --rc genhtml_function_coverage=1 00:15:18.069 --rc genhtml_legend=1 00:15:18.069 --rc geninfo_all_blocks=1 00:15:18.069 --rc geninfo_unexecuted_blocks=1 00:15:18.069 00:15:18.069 ' 00:15:18.069 15:39:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:18.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.069 --rc genhtml_branch_coverage=1 00:15:18.069 --rc genhtml_function_coverage=1 00:15:18.069 --rc genhtml_legend=1 00:15:18.069 --rc geninfo_all_blocks=1 00:15:18.069 --rc geninfo_unexecuted_blocks=1 00:15:18.069 00:15:18.069 ' 00:15:18.069 15:39:09 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:18.069 15:39:09 -- nvmf/common.sh@7 -- # uname -s 00:15:18.069 15:39:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:18.069 15:39:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:18.069 15:39:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:18.069 15:39:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:18.069 15:39:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:18.069 15:39:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:18.069 15:39:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:18.069 15:39:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:18.069 15:39:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:18.069 15:39:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:18.070 15:39:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:18.070 15:39:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:18.070 15:39:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:18.070 15:39:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:18.070 15:39:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:18.070 15:39:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:18.070 15:39:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:18.070 15:39:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:18.070 15:39:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:18.070 15:39:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.070 15:39:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.070 15:39:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.070 15:39:09 -- paths/export.sh@5 -- # export PATH 00:15:18.070 15:39:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.070 15:39:09 -- nvmf/common.sh@46 -- # : 0 00:15:18.070 15:39:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:18.070 15:39:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:18.070 15:39:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:18.070 15:39:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:18.070 15:39:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:18.070 15:39:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:18.070 15:39:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:18.070 15:39:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:18.070 15:39:09 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:18.070 15:39:09 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:18.070 15:39:09 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:18.070 15:39:09 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:18.070 15:39:09 -- target/multipath.sh@43 -- # nvmftestinit 00:15:18.070 15:39:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:18.070 15:39:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:18.070 15:39:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:18.070 15:39:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:18.070 15:39:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:18.070 15:39:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:18.070 15:39:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:18.070 15:39:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:18.070 15:39:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:18.070 15:39:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:18.070 15:39:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:18.070 15:39:09 -- common/autotest_common.sh@10 -- # set +x 00:15:19.974 15:39:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:19.974 15:39:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:19.974 15:39:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:19.974 15:39:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:19.974 15:39:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:19.974 15:39:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:19.974 15:39:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:19.974 15:39:11 -- nvmf/common.sh@294 -- # net_devs=() 00:15:19.974 15:39:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:19.974 15:39:11 -- nvmf/common.sh@295 -- # e810=() 00:15:19.974 15:39:11 -- nvmf/common.sh@295 -- # local -ga e810 00:15:19.974 15:39:11 -- nvmf/common.sh@296 -- # x722=() 00:15:19.974 15:39:11 -- nvmf/common.sh@296 -- # local -ga x722 00:15:19.974 15:39:11 -- nvmf/common.sh@297 -- # mlx=() 00:15:19.974 15:39:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:19.974 15:39:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:19.974 15:39:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:19.974 15:39:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:19.974 15:39:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:19.974 15:39:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:19.974 15:39:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:19.974 15:39:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:19.974 15:39:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:19.974 15:39:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:19.974 15:39:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:19.974 15:39:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:19.974 15:39:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:19.974 15:39:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:19.974 15:39:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:19.974 15:39:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:19.974 15:39:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:19.974 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:19.974 15:39:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:19.974 15:39:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:19.974 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:19.974 15:39:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:19.974 15:39:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:19.974 15:39:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:19.974 15:39:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:19.974 15:39:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:19.974 15:39:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:19.974 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:19.974 15:39:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:19.974 15:39:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:19.974 15:39:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:19.974 15:39:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:19.974 15:39:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:19.974 15:39:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:19.974 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:19.974 15:39:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:19.974 15:39:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:19.974 15:39:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:19.974 15:39:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:19.974 15:39:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:19.974 15:39:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:19.974 15:39:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:19.974 15:39:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:19.974 15:39:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:19.974 15:39:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:19.974 15:39:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:19.974 15:39:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:19.974 15:39:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:19.974 15:39:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:19.974 15:39:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:19.974 15:39:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:19.974 15:39:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:19.974 15:39:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:19.974 15:39:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:19.974 15:39:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:19.974 15:39:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:19.974 15:39:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:19.974 15:39:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:19.974 15:39:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:19.974 15:39:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:19.974 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:19.974 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:15:19.974 00:15:19.975 --- 10.0.0.2 ping statistics --- 00:15:19.975 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:19.975 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:15:19.975 15:39:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:19.975 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:19.975 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:15:19.975 00:15:19.975 --- 10.0.0.1 ping statistics --- 00:15:19.975 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:19.975 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:15:19.975 15:39:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:19.975 15:39:11 -- nvmf/common.sh@410 -- # return 0 00:15:19.975 15:39:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:19.975 15:39:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:19.975 15:39:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:19.975 15:39:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:19.975 15:39:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:19.975 15:39:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:19.975 15:39:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:19.975 15:39:11 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:19.975 15:39:11 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:19.975 only one NIC for nvmf test 00:15:19.975 15:39:11 -- target/multipath.sh@47 -- # nvmftestfini 00:15:19.975 15:39:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:19.975 15:39:11 -- nvmf/common.sh@116 -- # sync 00:15:19.975 15:39:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:19.975 15:39:11 -- nvmf/common.sh@119 -- # set +e 00:15:19.975 15:39:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:19.975 15:39:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:19.975 rmmod nvme_tcp 00:15:19.975 rmmod nvme_fabrics 00:15:19.975 rmmod nvme_keyring 00:15:19.975 15:39:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:19.975 15:39:11 -- nvmf/common.sh@123 -- # set -e 00:15:19.975 15:39:11 -- nvmf/common.sh@124 -- # return 0 00:15:19.975 15:39:11 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:19.975 15:39:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:19.975 15:39:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:19.975 15:39:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:19.975 15:39:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:19.975 15:39:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:19.975 15:39:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:19.975 15:39:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:19.975 15:39:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:22.512 15:39:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:22.512 15:39:13 -- target/multipath.sh@48 -- # exit 0 00:15:22.512 15:39:13 -- target/multipath.sh@1 -- # nvmftestfini 00:15:22.512 15:39:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:22.512 15:39:13 -- nvmf/common.sh@116 -- # sync 00:15:22.512 15:39:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:22.512 15:39:13 -- nvmf/common.sh@119 -- # set +e 00:15:22.512 15:39:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:22.512 15:39:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:22.512 15:39:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:22.512 15:39:13 -- nvmf/common.sh@123 -- # set -e 00:15:22.512 15:39:13 -- nvmf/common.sh@124 -- # return 0 00:15:22.512 15:39:13 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:22.512 15:39:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:22.512 15:39:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:22.512 15:39:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:22.512 15:39:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:22.512 15:39:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:22.512 15:39:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:22.512 15:39:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:22.512 15:39:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:22.512 15:39:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:22.512 00:15:22.512 real 0m4.473s 00:15:22.512 user 0m0.844s 00:15:22.512 sys 0m1.628s 00:15:22.512 15:39:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:22.512 15:39:13 -- common/autotest_common.sh@10 -- # set +x 00:15:22.512 ************************************ 00:15:22.512 END TEST nvmf_multipath 00:15:22.512 ************************************ 00:15:22.512 15:39:13 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:22.512 15:39:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:22.512 15:39:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:22.512 15:39:13 -- common/autotest_common.sh@10 -- # set +x 00:15:22.512 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:15:22.512 ************************************ 00:15:22.512 START TEST nvmf_zcopy 00:15:22.512 ************************************ 00:15:22.512 15:39:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:22.512 * Looking for test storage... 00:15:22.512 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:22.512 15:39:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:22.512 15:39:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:22.512 15:39:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:22.512 15:39:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:22.512 15:39:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:22.512 15:39:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:22.512 15:39:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:22.512 15:39:13 -- scripts/common.sh@335 -- # IFS=.-: 00:15:22.512 15:39:13 -- scripts/common.sh@335 -- # read -ra ver1 00:15:22.512 15:39:13 -- scripts/common.sh@336 -- # IFS=.-: 00:15:22.512 15:39:13 -- scripts/common.sh@336 -- # read -ra ver2 00:15:22.512 15:39:13 -- scripts/common.sh@337 -- # local 'op=<' 00:15:22.512 15:39:13 -- scripts/common.sh@339 -- # ver1_l=2 00:15:22.512 15:39:13 -- scripts/common.sh@340 -- # ver2_l=1 00:15:22.512 15:39:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:22.512 15:39:13 -- scripts/common.sh@343 -- # case "$op" in 00:15:22.512 15:39:13 -- scripts/common.sh@344 -- # : 1 00:15:22.512 15:39:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:22.512 15:39:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:22.512 15:39:13 -- scripts/common.sh@364 -- # decimal 1 00:15:22.512 15:39:13 -- scripts/common.sh@352 -- # local d=1 00:15:22.512 15:39:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:22.512 15:39:13 -- scripts/common.sh@354 -- # echo 1 00:15:22.512 15:39:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:22.512 15:39:13 -- scripts/common.sh@365 -- # decimal 2 00:15:22.512 15:39:13 -- scripts/common.sh@352 -- # local d=2 00:15:22.512 15:39:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:22.512 15:39:13 -- scripts/common.sh@354 -- # echo 2 00:15:22.512 15:39:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:22.512 15:39:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:22.512 15:39:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:22.512 15:39:13 -- scripts/common.sh@367 -- # return 0 00:15:22.512 15:39:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:22.512 15:39:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:22.512 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.512 --rc genhtml_branch_coverage=1 00:15:22.512 --rc genhtml_function_coverage=1 00:15:22.512 --rc genhtml_legend=1 00:15:22.512 --rc geninfo_all_blocks=1 00:15:22.512 --rc geninfo_unexecuted_blocks=1 00:15:22.512 00:15:22.512 ' 00:15:22.512 15:39:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:22.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.513 --rc genhtml_branch_coverage=1 00:15:22.513 --rc genhtml_function_coverage=1 00:15:22.513 --rc genhtml_legend=1 00:15:22.513 --rc geninfo_all_blocks=1 00:15:22.513 --rc geninfo_unexecuted_blocks=1 00:15:22.513 00:15:22.513 ' 00:15:22.513 15:39:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:22.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.513 --rc genhtml_branch_coverage=1 00:15:22.513 --rc genhtml_function_coverage=1 00:15:22.513 --rc genhtml_legend=1 00:15:22.513 --rc geninfo_all_blocks=1 00:15:22.513 --rc geninfo_unexecuted_blocks=1 00:15:22.513 00:15:22.513 ' 00:15:22.513 15:39:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:22.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.513 --rc genhtml_branch_coverage=1 00:15:22.513 --rc genhtml_function_coverage=1 00:15:22.513 --rc genhtml_legend=1 00:15:22.513 --rc geninfo_all_blocks=1 00:15:22.513 --rc geninfo_unexecuted_blocks=1 00:15:22.513 00:15:22.513 ' 00:15:22.513 15:39:13 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:22.513 15:39:13 -- nvmf/common.sh@7 -- # uname -s 00:15:22.513 15:39:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:22.513 15:39:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:22.513 15:39:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:22.513 15:39:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:22.513 15:39:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:22.513 15:39:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:22.513 15:39:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:22.513 15:39:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:22.513 15:39:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:22.513 15:39:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:22.513 15:39:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:22.513 15:39:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:22.513 15:39:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:22.513 15:39:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:22.513 15:39:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:22.513 15:39:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:22.513 15:39:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:22.513 15:39:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:22.513 15:39:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:22.513 15:39:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.513 15:39:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.513 15:39:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.513 15:39:13 -- paths/export.sh@5 -- # export PATH 00:15:22.513 15:39:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.513 15:39:13 -- nvmf/common.sh@46 -- # : 0 00:15:22.513 15:39:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:22.513 15:39:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:22.513 15:39:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:22.513 15:39:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:22.513 15:39:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:22.513 15:39:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:22.513 15:39:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:22.513 15:39:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:22.513 15:39:13 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:22.513 15:39:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:22.513 15:39:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:22.513 15:39:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:22.513 15:39:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:22.513 15:39:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:22.513 15:39:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:22.513 15:39:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:22.513 15:39:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:22.513 15:39:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:22.513 15:39:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:22.513 15:39:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:22.513 15:39:13 -- common/autotest_common.sh@10 -- # set +x 00:15:24.417 15:39:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:24.417 15:39:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:24.417 15:39:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:24.417 15:39:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:24.417 15:39:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:24.417 15:39:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:24.417 15:39:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:24.417 15:39:15 -- nvmf/common.sh@294 -- # net_devs=() 00:15:24.417 15:39:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:24.417 15:39:15 -- nvmf/common.sh@295 -- # e810=() 00:15:24.417 15:39:15 -- nvmf/common.sh@295 -- # local -ga e810 00:15:24.417 15:39:15 -- nvmf/common.sh@296 -- # x722=() 00:15:24.417 15:39:15 -- nvmf/common.sh@296 -- # local -ga x722 00:15:24.417 15:39:15 -- nvmf/common.sh@297 -- # mlx=() 00:15:24.417 15:39:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:24.417 15:39:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:24.417 15:39:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:24.417 15:39:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:24.417 15:39:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:24.417 15:39:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:24.417 15:39:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:24.417 15:39:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:24.417 15:39:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:24.417 15:39:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:24.417 15:39:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:24.417 15:39:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:24.417 15:39:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:24.417 15:39:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:24.417 15:39:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:24.417 15:39:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:24.417 15:39:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:24.417 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:24.417 15:39:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:24.417 15:39:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:24.417 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:24.417 15:39:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:24.417 15:39:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:24.417 15:39:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:24.417 15:39:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:24.417 15:39:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:24.417 15:39:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:24.417 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:24.417 15:39:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:24.417 15:39:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:24.417 15:39:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:24.417 15:39:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:24.417 15:39:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:24.417 15:39:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:24.417 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:24.417 15:39:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:24.417 15:39:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:24.417 15:39:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:24.417 15:39:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:24.417 15:39:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:24.417 15:39:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:24.417 15:39:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:24.417 15:39:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:24.417 15:39:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:24.417 15:39:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:24.417 15:39:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:24.417 15:39:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:24.417 15:39:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:24.417 15:39:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:24.417 15:39:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:24.417 15:39:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:24.417 15:39:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:24.417 15:39:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:24.417 15:39:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:24.417 15:39:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:24.417 15:39:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:24.417 15:39:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:24.417 15:39:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:24.417 15:39:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:24.417 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:24.417 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:15:24.417 00:15:24.417 --- 10.0.0.2 ping statistics --- 00:15:24.417 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.417 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:15:24.417 15:39:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:24.417 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:24.417 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.136 ms 00:15:24.417 00:15:24.417 --- 10.0.0.1 ping statistics --- 00:15:24.417 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.417 rtt min/avg/max/mdev = 0.136/0.136/0.136/0.000 ms 00:15:24.417 15:39:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:24.417 15:39:15 -- nvmf/common.sh@410 -- # return 0 00:15:24.417 15:39:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:24.417 15:39:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:24.417 15:39:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:24.417 15:39:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:24.417 15:39:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:24.417 15:39:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:24.417 15:39:15 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:24.417 15:39:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:24.417 15:39:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:24.417 15:39:15 -- common/autotest_common.sh@10 -- # set +x 00:15:24.417 15:39:15 -- nvmf/common.sh@469 -- # nvmfpid=865076 00:15:24.417 15:39:15 -- nvmf/common.sh@470 -- # waitforlisten 865076 00:15:24.418 15:39:15 -- common/autotest_common.sh@829 -- # '[' -z 865076 ']' 00:15:24.418 15:39:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:24.418 15:39:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:24.418 15:39:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:24.418 15:39:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:24.418 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:24.418 15:39:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:24.418 15:39:15 -- common/autotest_common.sh@10 -- # set +x 00:15:24.676 [2024-11-26 15:39:15.865359] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:24.676 [2024-11-26 15:39:15.865435] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:24.676 EAL: No free 2048 kB hugepages reported on node 1 00:15:24.676 [2024-11-26 15:39:15.932106] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:24.676 [2024-11-26 15:39:16.048684] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:24.676 [2024-11-26 15:39:16.048865] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:24.676 [2024-11-26 15:39:16.048884] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:24.676 [2024-11-26 15:39:16.048899] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:24.676 [2024-11-26 15:39:16.048930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:25.612 15:39:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:25.612 15:39:16 -- common/autotest_common.sh@862 -- # return 0 00:15:25.612 15:39:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:25.612 15:39:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:25.612 15:39:16 -- common/autotest_common.sh@10 -- # set +x 00:15:25.612 15:39:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:25.612 15:39:16 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:25.612 15:39:16 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:25.612 15:39:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.612 15:39:16 -- common/autotest_common.sh@10 -- # set +x 00:15:25.612 [2024-11-26 15:39:16.840940] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:25.612 15:39:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.612 15:39:16 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:25.612 15:39:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.612 15:39:16 -- common/autotest_common.sh@10 -- # set +x 00:15:25.612 15:39:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.612 15:39:16 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:25.612 15:39:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.612 15:39:16 -- common/autotest_common.sh@10 -- # set +x 00:15:25.612 [2024-11-26 15:39:16.857118] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:25.612 15:39:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.612 15:39:16 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:25.612 15:39:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.612 15:39:16 -- common/autotest_common.sh@10 -- # set +x 00:15:25.612 15:39:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.612 15:39:16 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:25.612 15:39:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.612 15:39:16 -- common/autotest_common.sh@10 -- # set +x 00:15:25.612 malloc0 00:15:25.612 15:39:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.612 15:39:16 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:25.612 15:39:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.612 15:39:16 -- common/autotest_common.sh@10 -- # set +x 00:15:25.612 15:39:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.612 15:39:16 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:25.612 15:39:16 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:25.612 15:39:16 -- nvmf/common.sh@520 -- # config=() 00:15:25.612 15:39:16 -- nvmf/common.sh@520 -- # local subsystem config 00:15:25.612 15:39:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:25.612 15:39:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:25.612 { 00:15:25.612 "params": { 00:15:25.612 "name": "Nvme$subsystem", 00:15:25.612 "trtype": "$TEST_TRANSPORT", 00:15:25.612 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:25.612 "adrfam": "ipv4", 00:15:25.612 "trsvcid": "$NVMF_PORT", 00:15:25.612 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:25.612 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:25.612 "hdgst": ${hdgst:-false}, 00:15:25.612 "ddgst": ${ddgst:-false} 00:15:25.612 }, 00:15:25.612 "method": "bdev_nvme_attach_controller" 00:15:25.612 } 00:15:25.612 EOF 00:15:25.612 )") 00:15:25.612 15:39:16 -- nvmf/common.sh@542 -- # cat 00:15:25.612 15:39:16 -- nvmf/common.sh@544 -- # jq . 00:15:25.612 15:39:16 -- nvmf/common.sh@545 -- # IFS=, 00:15:25.612 15:39:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:25.612 "params": { 00:15:25.612 "name": "Nvme1", 00:15:25.612 "trtype": "tcp", 00:15:25.612 "traddr": "10.0.0.2", 00:15:25.612 "adrfam": "ipv4", 00:15:25.612 "trsvcid": "4420", 00:15:25.612 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:25.612 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:25.612 "hdgst": false, 00:15:25.612 "ddgst": false 00:15:25.612 }, 00:15:25.612 "method": "bdev_nvme_attach_controller" 00:15:25.612 }' 00:15:25.612 [2024-11-26 15:39:16.933633] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:25.612 [2024-11-26 15:39:16.933716] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid865228 ] 00:15:25.612 EAL: No free 2048 kB hugepages reported on node 1 00:15:25.612 [2024-11-26 15:39:16.994513] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:25.870 [2024-11-26 15:39:17.115613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:26.128 Running I/O for 10 seconds... 00:15:36.096 00:15:36.096 Latency(us) 00:15:36.096 [2024-11-26T14:39:27.549Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:36.096 [2024-11-26T14:39:27.549Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:15:36.096 Verification LBA range: start 0x0 length 0x1000 00:15:36.096 Nvme1n1 : 10.01 8730.00 68.20 0.00 0.00 14626.98 989.11 22136.60 00:15:36.096 [2024-11-26T14:39:27.549Z] =================================================================================================================== 00:15:36.096 [2024-11-26T14:39:27.549Z] Total : 8730.00 68.20 0.00 0.00 14626.98 989.11 22136.60 00:15:36.354 15:39:27 -- target/zcopy.sh@39 -- # perfpid=866397 00:15:36.354 15:39:27 -- target/zcopy.sh@41 -- # xtrace_disable 00:15:36.354 15:39:27 -- common/autotest_common.sh@10 -- # set +x 00:15:36.354 15:39:27 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:15:36.354 15:39:27 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:15:36.354 15:39:27 -- nvmf/common.sh@520 -- # config=() 00:15:36.354 15:39:27 -- nvmf/common.sh@520 -- # local subsystem config 00:15:36.354 15:39:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:36.354 15:39:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:36.354 { 00:15:36.354 "params": { 00:15:36.354 "name": "Nvme$subsystem", 00:15:36.354 "trtype": "$TEST_TRANSPORT", 00:15:36.354 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:36.354 "adrfam": "ipv4", 00:15:36.354 "trsvcid": "$NVMF_PORT", 00:15:36.354 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:36.354 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:36.354 "hdgst": ${hdgst:-false}, 00:15:36.354 "ddgst": ${ddgst:-false} 00:15:36.354 }, 00:15:36.354 "method": "bdev_nvme_attach_controller" 00:15:36.354 } 00:15:36.354 EOF 00:15:36.354 )") 00:15:36.354 15:39:27 -- nvmf/common.sh@542 -- # cat 00:15:36.354 15:39:27 -- nvmf/common.sh@544 -- # jq . 00:15:36.354 [2024-11-26 15:39:27.742346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.354 [2024-11-26 15:39:27.742396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.354 15:39:27 -- nvmf/common.sh@545 -- # IFS=, 00:15:36.354 15:39:27 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:36.354 "params": { 00:15:36.354 "name": "Nvme1", 00:15:36.354 "trtype": "tcp", 00:15:36.354 "traddr": "10.0.0.2", 00:15:36.354 "adrfam": "ipv4", 00:15:36.354 "trsvcid": "4420", 00:15:36.354 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:36.354 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:36.354 "hdgst": false, 00:15:36.354 "ddgst": false 00:15:36.354 }, 00:15:36.354 "method": "bdev_nvme_attach_controller" 00:15:36.354 }' 00:15:36.354 [2024-11-26 15:39:27.750294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.354 [2024-11-26 15:39:27.750320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.354 [2024-11-26 15:39:27.758313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.354 [2024-11-26 15:39:27.758339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.354 [2024-11-26 15:39:27.766334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.354 [2024-11-26 15:39:27.766359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.354 [2024-11-26 15:39:27.774357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.354 [2024-11-26 15:39:27.774382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.354 [2024-11-26 15:39:27.776352] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:36.354 [2024-11-26 15:39:27.776421] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid866397 ] 00:15:36.354 [2024-11-26 15:39:27.782378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.354 [2024-11-26 15:39:27.782403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.354 [2024-11-26 15:39:27.790402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.354 [2024-11-26 15:39:27.790426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.354 [2024-11-26 15:39:27.798428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.354 [2024-11-26 15:39:27.798453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.806451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.806478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 EAL: No free 2048 kB hugepages reported on node 1 00:15:36.614 [2024-11-26 15:39:27.814468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.814502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.822491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.822518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.830513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.830538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.838536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.838561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.846026] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:36.614 [2024-11-26 15:39:27.846559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.846583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.854618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.854659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.862627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.862663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.870627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.870653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.878654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.878679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.886673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.886709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.894706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.894730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.902731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.902757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.910782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.910814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.918805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.918842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.926795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.926820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.934814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.934839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.942990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.943017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.951009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.951033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.959032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.959057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.965889] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:36.614 [2024-11-26 15:39:27.967058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.967082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.975079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.975103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.983126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.983164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.991161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.991201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:27.999181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:27.999223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:28.007217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:28.007264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:28.015225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:28.015270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:28.023251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:28.023297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:28.031274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:28.031317] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:28.039261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:28.039285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:28.047315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:28.047355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.614 [2024-11-26 15:39:28.055342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.614 [2024-11-26 15:39:28.055384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.872 [2024-11-26 15:39:28.063351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.872 [2024-11-26 15:39:28.063384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.071357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.071382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.079377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.079401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.087419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.087450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.095471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.095498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.103497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.103524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.111521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.111560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.119539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.119564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.127560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.127584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.135583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.135608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.143604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.143628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.151678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.151716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.159684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.159719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.167713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.167739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.175732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.175757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.183759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.183783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.191774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.191798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.199798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.199822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.207830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.207858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.215846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.215872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.223869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.223893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.231891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.231914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.239914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.239938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.247942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.247968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.255966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.255992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.263989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.264013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.272010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.272035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.280034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.280058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.288056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.288080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.296078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.296103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.304119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.304144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 [2024-11-26 15:39:28.312129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.312159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:36.873 Running I/O for 5 seconds... 00:15:36.873 [2024-11-26 15:39:28.320154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:36.873 [2024-11-26 15:39:28.320179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.131 [2024-11-26 15:39:28.334104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.131 [2024-11-26 15:39:28.334136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.131 [2024-11-26 15:39:28.344813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.131 [2024-11-26 15:39:28.344844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.131 [2024-11-26 15:39:28.355021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.131 [2024-11-26 15:39:28.355053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.131 [2024-11-26 15:39:28.366170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.366202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.377169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.377200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.388161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.388193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.399398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.399428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.410576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.410606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.421976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.422007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.432993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.433024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.444006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.444036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.454533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.454564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.465402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.465432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.476389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.476419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.487148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.487179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.498303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.498333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.509273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.509304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.519970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.520001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.532651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.532682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.543127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.543158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.554444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.554474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.565321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.565350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.132 [2024-11-26 15:39:28.578663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.132 [2024-11-26 15:39:28.578701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.588645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.588676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.599952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.599982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.610459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.610489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.621543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.621574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.633740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.633771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.643193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.643223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.654172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.654211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.664780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.664810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.675724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.675754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.686249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.686279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.698970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.699000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.708794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.708824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.719475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.719504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.732512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.732542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.742326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.742356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.390 [2024-11-26 15:39:28.753047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.390 [2024-11-26 15:39:28.753077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.391 [2024-11-26 15:39:28.764297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.391 [2024-11-26 15:39:28.764326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.391 [2024-11-26 15:39:28.776013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.391 [2024-11-26 15:39:28.776043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.391 [2024-11-26 15:39:28.786527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.391 [2024-11-26 15:39:28.786558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.391 [2024-11-26 15:39:28.797659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.391 [2024-11-26 15:39:28.797700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.391 [2024-11-26 15:39:28.808831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.391 [2024-11-26 15:39:28.808861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.391 [2024-11-26 15:39:28.821989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.391 [2024-11-26 15:39:28.822020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.391 [2024-11-26 15:39:28.831965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.391 [2024-11-26 15:39:28.832005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.649 [2024-11-26 15:39:28.843439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.649 [2024-11-26 15:39:28.843469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.649 [2024-11-26 15:39:28.854610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.649 [2024-11-26 15:39:28.854640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.649 [2024-11-26 15:39:28.865477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.649 [2024-11-26 15:39:28.865515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.649 [2024-11-26 15:39:28.877617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.649 [2024-11-26 15:39:28.877647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.649 [2024-11-26 15:39:28.887182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.649 [2024-11-26 15:39:28.887212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.649 [2024-11-26 15:39:28.900225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.649 [2024-11-26 15:39:28.900255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.649 [2024-11-26 15:39:28.910925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.649 [2024-11-26 15:39:28.910956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.649 [2024-11-26 15:39:28.921681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.649 [2024-11-26 15:39:28.921719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.649 [2024-11-26 15:39:28.934538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.649 [2024-11-26 15:39:28.934568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.649 [2024-11-26 15:39:28.944351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.649 [2024-11-26 15:39:28.944380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.650 [2024-11-26 15:39:28.955351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.650 [2024-11-26 15:39:28.955393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.650 [2024-11-26 15:39:28.966542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.650 [2024-11-26 15:39:28.966572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.650 [2024-11-26 15:39:28.977522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.650 [2024-11-26 15:39:28.977552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.650 [2024-11-26 15:39:28.988496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.650 [2024-11-26 15:39:28.988527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.650 [2024-11-26 15:39:28.999550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.650 [2024-11-26 15:39:28.999585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.650 [2024-11-26 15:39:29.010608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.650 [2024-11-26 15:39:29.010638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.650 [2024-11-26 15:39:29.021317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.650 [2024-11-26 15:39:29.021348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.650 [2024-11-26 15:39:29.032621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.650 [2024-11-26 15:39:29.032651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.650 [2024-11-26 15:39:29.043780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.650 [2024-11-26 15:39:29.043810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.650 [2024-11-26 15:39:29.054773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.650 [2024-11-26 15:39:29.054803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.650 [2024-11-26 15:39:29.065776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.650 [2024-11-26 15:39:29.065807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.650 [2024-11-26 15:39:29.078784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.650 [2024-11-26 15:39:29.078823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.650 [2024-11-26 15:39:29.089248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.650 [2024-11-26 15:39:29.089279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.100366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.100396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.111887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.111917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.122523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.122553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.133214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.133243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.146158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.146187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.155910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.155940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.166949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.166980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.177943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.177972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.189013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.189042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.200310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.200339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.211199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.211229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.222259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.222289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.233146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.233175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.245897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.245926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.255775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.255805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.266932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.266963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.279601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.279630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.289972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.290010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.300399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.300429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.311661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.311698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.322432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.322461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.333906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.333937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.345129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.345158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:37.919 [2024-11-26 15:39:29.356415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:37.919 [2024-11-26 15:39:29.356445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.367786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.367815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.378907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.378938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.389716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.389746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.400452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.400481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.411411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.411441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.422552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.422582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.433447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.433476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.444277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.444307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.456859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.456889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.466353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.466383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.477726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.477755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.489001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.489031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.499537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.499582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.510274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.510306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.521243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.521273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.532409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.532439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.543357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.543387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.555995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.556024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.566092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.566121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.576744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.576774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.589747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.589777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.599786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.599816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.610841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.610872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.177 [2024-11-26 15:39:29.621728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.177 [2024-11-26 15:39:29.621758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.436 [2024-11-26 15:39:29.632611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.436 [2024-11-26 15:39:29.632641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.436 [2024-11-26 15:39:29.645012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.436 [2024-11-26 15:39:29.645042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.436 [2024-11-26 15:39:29.654953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.436 [2024-11-26 15:39:29.654983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.436 [2024-11-26 15:39:29.666417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.436 [2024-11-26 15:39:29.666447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.436 [2024-11-26 15:39:29.676693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.436 [2024-11-26 15:39:29.676724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.436 [2024-11-26 15:39:29.687708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.436 [2024-11-26 15:39:29.687738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.436 [2024-11-26 15:39:29.698563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.436 [2024-11-26 15:39:29.698593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.436 [2024-11-26 15:39:29.709670] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.436 [2024-11-26 15:39:29.709710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.436 [2024-11-26 15:39:29.722205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.436 [2024-11-26 15:39:29.722234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.437 [2024-11-26 15:39:29.732378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.437 [2024-11-26 15:39:29.732407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.437 [2024-11-26 15:39:29.743305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.437 [2024-11-26 15:39:29.743335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.437 [2024-11-26 15:39:29.755937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.437 [2024-11-26 15:39:29.755968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.437 [2024-11-26 15:39:29.766079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.437 [2024-11-26 15:39:29.766108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.437 [2024-11-26 15:39:29.777084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.437 [2024-11-26 15:39:29.777115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.437 [2024-11-26 15:39:29.789766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.437 [2024-11-26 15:39:29.789796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.437 [2024-11-26 15:39:29.800084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.437 [2024-11-26 15:39:29.800115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.437 [2024-11-26 15:39:29.810636] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.437 [2024-11-26 15:39:29.810666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.437 [2024-11-26 15:39:29.823151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.437 [2024-11-26 15:39:29.823181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.437 [2024-11-26 15:39:29.833306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.437 [2024-11-26 15:39:29.833336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.437 [2024-11-26 15:39:29.844281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.437 [2024-11-26 15:39:29.844312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.437 [2024-11-26 15:39:29.855153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.437 [2024-11-26 15:39:29.855184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.437 [2024-11-26 15:39:29.866360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.437 [2024-11-26 15:39:29.866390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.437 [2024-11-26 15:39:29.879280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.437 [2024-11-26 15:39:29.879310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:29.889829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:29.889859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:29.900840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:29.900870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:29.913329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:29.913360] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:29.925217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:29.925247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:29.934241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:29.934271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:29.946052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:29.946081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:29.959005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:29.959036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:29.969624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:29.969655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:29.980519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:29.980549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:29.991334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:29.991367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:30.002194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:30.002223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:30.014721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:30.014771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:30.024702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:30.024759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:30.036274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:30.036331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:30.050167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.695 [2024-11-26 15:39:30.050206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.695 [2024-11-26 15:39:30.064288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.696 [2024-11-26 15:39:30.064327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.696 [2024-11-26 15:39:30.079519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.696 [2024-11-26 15:39:30.079551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.696 [2024-11-26 15:39:30.090566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.696 [2024-11-26 15:39:30.090597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.696 [2024-11-26 15:39:30.103675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.696 [2024-11-26 15:39:30.103731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.696 [2024-11-26 15:39:30.114062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.696 [2024-11-26 15:39:30.114094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.696 [2024-11-26 15:39:30.125502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.696 [2024-11-26 15:39:30.125533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.696 [2024-11-26 15:39:30.138490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.696 [2024-11-26 15:39:30.138531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.149710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.149754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.160682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.160723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.171894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.171922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.184949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.184996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.195739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.195770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.207295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.207325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.218449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.218479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.229358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.229389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.240597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.240628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.253446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.253476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.264018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.264049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.274717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.274747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.287699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.287730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.297897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.297928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.309027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.309058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.319991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.320021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.331236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.331267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.344655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.344695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.355319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.355357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.366773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.366804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.378271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.378302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.389251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.389281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.954 [2024-11-26 15:39:30.400238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.954 [2024-11-26 15:39:30.400268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.411479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.411510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.423138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.423169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.434413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.434447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.448163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.448193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.458716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.458746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.470248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.470280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.481653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.481698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.494449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.494481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.504397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.504428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.516339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.516371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.527394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.527425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.538844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.538875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.549778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.549809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.562582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.562612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.572531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.572572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.583663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.583704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.596311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.596341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.605935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.605964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.617291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.617321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.628105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.628134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.639328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.639358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.214 [2024-11-26 15:39:30.652297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.214 [2024-11-26 15:39:30.652327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.480 [2024-11-26 15:39:30.663080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.480 [2024-11-26 15:39:30.663110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.480 [2024-11-26 15:39:30.673937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.480 [2024-11-26 15:39:30.673967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.480 [2024-11-26 15:39:30.686754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.480 [2024-11-26 15:39:30.686784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.480 [2024-11-26 15:39:30.697016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.480 [2024-11-26 15:39:30.697046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.480 [2024-11-26 15:39:30.707887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.480 [2024-11-26 15:39:30.707918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.480 [2024-11-26 15:39:30.720325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.480 [2024-11-26 15:39:30.720355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.480 [2024-11-26 15:39:30.730240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.480 [2024-11-26 15:39:30.730269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.480 [2024-11-26 15:39:30.741282] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.480 [2024-11-26 15:39:30.741312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.480 [2024-11-26 15:39:30.752187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.480 [2024-11-26 15:39:30.752218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.480 [2024-11-26 15:39:30.764805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.480 [2024-11-26 15:39:30.764834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.480 [2024-11-26 15:39:30.774791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.480 [2024-11-26 15:39:30.774821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.480 [2024-11-26 15:39:30.785044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.480 [2024-11-26 15:39:30.785085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.480 [2024-11-26 15:39:30.796045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.481 [2024-11-26 15:39:30.796075] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.481 [2024-11-26 15:39:30.808728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.481 [2024-11-26 15:39:30.808758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.481 [2024-11-26 15:39:30.819071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.481 [2024-11-26 15:39:30.819102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.481 [2024-11-26 15:39:30.830069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.481 [2024-11-26 15:39:30.830099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.481 [2024-11-26 15:39:30.841093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.481 [2024-11-26 15:39:30.841122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.481 [2024-11-26 15:39:30.851868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.481 [2024-11-26 15:39:30.851898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.481 [2024-11-26 15:39:30.862911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.481 [2024-11-26 15:39:30.862941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.481 [2024-11-26 15:39:30.874009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.481 [2024-11-26 15:39:30.874038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.481 [2024-11-26 15:39:30.886704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.481 [2024-11-26 15:39:30.886734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.481 [2024-11-26 15:39:30.896790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.481 [2024-11-26 15:39:30.896820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.481 [2024-11-26 15:39:30.907353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.481 [2024-11-26 15:39:30.907382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.481 [2024-11-26 15:39:30.920117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.481 [2024-11-26 15:39:30.920147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:30.930376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:30.930406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:30.940905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:30.940935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:30.953605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:30.953635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:30.963412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:30.963441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:30.974462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:30.974492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:30.987123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:30.987153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:30.997234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:30.997274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.008347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.008378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.019004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.019033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.030127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.030156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.040935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.040965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.051640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.051670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.062504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.062534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.073630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.073661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.084460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.084490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.095163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.095193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.106008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.106038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.116848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.116878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.128095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.128125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.139046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.139076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.149695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.149725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.160552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.160582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.173471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.173501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.740 [2024-11-26 15:39:31.183433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.740 [2024-11-26 15:39:31.183463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.195497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.195527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.206729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.206772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.218005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.218036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.228665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.228705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.240025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.240056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.251120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.251150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.263840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.263871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.273966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.273996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.284964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.284996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.295620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.295650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.306628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.306658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.319403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.319434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.329545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.329575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.340320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.340352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.350842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.350872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.361658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.361698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.374046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.374076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.386639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.386670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.396849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.396879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.407604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.407634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.418446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.418475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.429215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.429245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.999 [2024-11-26 15:39:31.441904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.999 [2024-11-26 15:39:31.441934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.451342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.451372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.462563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.462592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.473449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.473491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.484161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.484192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.496864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.496901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.507252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.507283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.518463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.518492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.531318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.531347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.543132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.543162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.551984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.552025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.563093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.563119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.575375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.575401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.586605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.586631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.594633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.594658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.606976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.607018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.618484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.618511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.627283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.627310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.637947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.637974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.648115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.648141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.658454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.658481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.668471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.668497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.678513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.678540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.688366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.688392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.259 [2024-11-26 15:39:31.698368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.259 [2024-11-26 15:39:31.698394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.708322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.708351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.718297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.718323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.728637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.728663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.740620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.740647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.749146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.749172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.760075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.760103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.772295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.772322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.781587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.781613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.791385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.791412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.801150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.801176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.811091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.811117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.821267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.821293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.831335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.831361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.841639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.841679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.851765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.851792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.861376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.861417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.518 [2024-11-26 15:39:31.873544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.518 [2024-11-26 15:39:31.873571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.519 [2024-11-26 15:39:31.884813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.519 [2024-11-26 15:39:31.884840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.519 [2024-11-26 15:39:31.893194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.519 [2024-11-26 15:39:31.893220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.519 [2024-11-26 15:39:31.905307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.519 [2024-11-26 15:39:31.905333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.519 [2024-11-26 15:39:31.917056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.519 [2024-11-26 15:39:31.917082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.519 [2024-11-26 15:39:31.925624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.519 [2024-11-26 15:39:31.925650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.519 [2024-11-26 15:39:31.936534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.519 [2024-11-26 15:39:31.936559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.519 [2024-11-26 15:39:31.948953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.519 [2024-11-26 15:39:31.948980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.519 [2024-11-26 15:39:31.957937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.519 [2024-11-26 15:39:31.957964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.777 [2024-11-26 15:39:31.970630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.777 [2024-11-26 15:39:31.970657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.777 [2024-11-26 15:39:31.981088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.777 [2024-11-26 15:39:31.981114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.777 [2024-11-26 15:39:31.991253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:31.991278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.004119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.004146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.015510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.015545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.023946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.023973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.036028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.036053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.047528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.047558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.056784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.056820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.069048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.069078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.080027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.080057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.091088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.091118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.102267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.102297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.112863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.112890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.123611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.123641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.134460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.134490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.145208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.145239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.156096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.156126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.166916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.166943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.177667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.177706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.188615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.188644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.201450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.201480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.211862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.211891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.778 [2024-11-26 15:39:32.222994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.778 [2024-11-26 15:39:32.223035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.036 [2024-11-26 15:39:32.233798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.036 [2024-11-26 15:39:32.233825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.036 [2024-11-26 15:39:32.244793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.036 [2024-11-26 15:39:32.244820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.036 [2024-11-26 15:39:32.257513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.036 [2024-11-26 15:39:32.257542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.036 [2024-11-26 15:39:32.267565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.036 [2024-11-26 15:39:32.267595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.036 [2024-11-26 15:39:32.278511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.036 [2024-11-26 15:39:32.278541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.291635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.291664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.302175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.302206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.313242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.313271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.323928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.323955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.335182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.335212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.348274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.348304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.358633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.358664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.368935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.368989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.379739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.379767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.392488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.392518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.402303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.402333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.413896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.413924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.424684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.424750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.435525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.435565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.448333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.448363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.458260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.458290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.469775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.469803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.037 [2024-11-26 15:39:32.480400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.037 [2024-11-26 15:39:32.480431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.295 [2024-11-26 15:39:32.491515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.295 [2024-11-26 15:39:32.491545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.504149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.504179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.513909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.513937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.525325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.525354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.536589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.536618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.547548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.547579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.558557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.558587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.569216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.569247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.579823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.579850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.590236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.590265] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.603089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.603119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.613356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.613387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.624528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.624558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.636899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.636926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.646267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.646312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.657611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.657641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.668623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.668653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.679901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.679928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.690892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.690919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.701285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.701315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.711822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.711851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.722421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.722450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.296 [2024-11-26 15:39:32.735218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.296 [2024-11-26 15:39:32.735248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.554 [2024-11-26 15:39:32.745505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.745535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.756286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.756316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.767380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.767409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.778463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.778492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.790802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.790829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.800597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.800628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.811586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.811616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.824632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.824661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.835126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.835156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.845887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.845916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.858461] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.858502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.870373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.870403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.879460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.879490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.891280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.891310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.904149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.904179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.914186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.914216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.924656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.924694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.935711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.935753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.946453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.946483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.957523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.957553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.968707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.968751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.979047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.979077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:32.989961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:32.990006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.555 [2024-11-26 15:39:33.000606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.555 [2024-11-26 15:39:33.000638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.011566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.011596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.024176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.024208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.034124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.034154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.045287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.045316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.057845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.057874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.076553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.076586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.088129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.088155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.099251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.099277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.107471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.107497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.119599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.119625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.131153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.131187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.139325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.139352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.152073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.152099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.161863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.161890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.171659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.171709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.181320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.181345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.191168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.191195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.201085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.201111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.211140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.211166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.221331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.221357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.231708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.231735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.241801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.241829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.814 [2024-11-26 15:39:33.251746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.814 [2024-11-26 15:39:33.251774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.073 [2024-11-26 15:39:33.261679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.073 [2024-11-26 15:39:33.261714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.073 [2024-11-26 15:39:33.271669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.073 [2024-11-26 15:39:33.271704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.073 [2024-11-26 15:39:33.281408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.073 [2024-11-26 15:39:33.281434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.073 [2024-11-26 15:39:33.291510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.073 [2024-11-26 15:39:33.291536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.073 [2024-11-26 15:39:33.301448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.073 [2024-11-26 15:39:33.301474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.073 [2024-11-26 15:39:33.311513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.073 [2024-11-26 15:39:33.311539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.073 [2024-11-26 15:39:33.321629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.073 [2024-11-26 15:39:33.321656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.073 [2024-11-26 15:39:33.331573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.073 [2024-11-26 15:39:33.331599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.073 [2024-11-26 15:39:33.340337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.073 [2024-11-26 15:39:33.340362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.073 00:15:42.073 Latency(us) 00:15:42.073 [2024-11-26T14:39:33.526Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:42.073 [2024-11-26T14:39:33.527Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:15:42.074 Nvme1n1 : 5.01 11796.36 92.16 0.00 0.00 10837.39 4417.61 21165.70 00:15:42.074 [2024-11-26T14:39:33.527Z] =================================================================================================================== 00:15:42.074 [2024-11-26T14:39:33.527Z] Total : 11796.36 92.16 0.00 0.00 10837.39 4417.61 21165.70 00:15:42.074 [2024-11-26 15:39:33.346383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.346406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.354435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.354458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.362462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.362485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.370544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.370599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.378562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.378612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.386583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.386631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.394609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.394654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.402635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.402681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.410664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.410727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.418676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.418729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.426710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.426770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.434748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.434806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.442769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.442826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.450778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.450824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.458800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.458845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.466820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.466869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.474824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.474870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.482797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.482820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.490814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.490836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.498836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.498858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.506859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.506881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.074 [2024-11-26 15:39:33.514942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.074 [2024-11-26 15:39:33.514987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.332 [2024-11-26 15:39:33.522988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.332 [2024-11-26 15:39:33.523056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.332 [2024-11-26 15:39:33.530968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.332 [2024-11-26 15:39:33.531007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.332 [2024-11-26 15:39:33.538958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.332 [2024-11-26 15:39:33.538993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.333 [2024-11-26 15:39:33.546974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.333 [2024-11-26 15:39:33.547009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.333 [2024-11-26 15:39:33.555016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.333 [2024-11-26 15:39:33.555064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.333 [2024-11-26 15:39:33.563026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.333 [2024-11-26 15:39:33.563051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.333 [2024-11-26 15:39:33.571102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.333 [2024-11-26 15:39:33.571150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.333 [2024-11-26 15:39:33.579115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.333 [2024-11-26 15:39:33.579161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.333 [2024-11-26 15:39:33.587105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.333 [2024-11-26 15:39:33.587126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.333 [2024-11-26 15:39:33.595107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.333 [2024-11-26 15:39:33.595128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.333 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (866397) - No such process 00:15:42.333 15:39:33 -- target/zcopy.sh@49 -- # wait 866397 00:15:42.333 15:39:33 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:42.333 15:39:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.333 15:39:33 -- common/autotest_common.sh@10 -- # set +x 00:15:42.333 15:39:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.333 15:39:33 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:42.333 15:39:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.333 15:39:33 -- common/autotest_common.sh@10 -- # set +x 00:15:42.333 delay0 00:15:42.333 15:39:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.333 15:39:33 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:15:42.333 15:39:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.333 15:39:33 -- common/autotest_common.sh@10 -- # set +x 00:15:42.333 15:39:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.333 15:39:33 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:15:42.333 EAL: No free 2048 kB hugepages reported on node 1 00:15:42.333 [2024-11-26 15:39:33.762795] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:15:48.894 Initializing NVMe Controllers 00:15:48.894 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:48.894 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:15:48.894 Initialization complete. Launching workers. 00:15:48.894 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 865 00:15:48.894 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 1137, failed to submit 48 00:15:48.894 success 967, unsuccess 170, failed 0 00:15:48.894 15:39:39 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:15:48.894 15:39:39 -- target/zcopy.sh@60 -- # nvmftestfini 00:15:48.894 15:39:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:48.894 15:39:39 -- nvmf/common.sh@116 -- # sync 00:15:48.894 15:39:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:48.894 15:39:40 -- nvmf/common.sh@119 -- # set +e 00:15:48.894 15:39:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:48.894 15:39:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:48.894 rmmod nvme_tcp 00:15:48.894 rmmod nvme_fabrics 00:15:48.894 rmmod nvme_keyring 00:15:48.894 15:39:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:48.894 15:39:40 -- nvmf/common.sh@123 -- # set -e 00:15:48.894 15:39:40 -- nvmf/common.sh@124 -- # return 0 00:15:48.894 15:39:40 -- nvmf/common.sh@477 -- # '[' -n 865076 ']' 00:15:48.894 15:39:40 -- nvmf/common.sh@478 -- # killprocess 865076 00:15:48.894 15:39:40 -- common/autotest_common.sh@936 -- # '[' -z 865076 ']' 00:15:48.894 15:39:40 -- common/autotest_common.sh@940 -- # kill -0 865076 00:15:48.894 15:39:40 -- common/autotest_common.sh@941 -- # uname 00:15:48.894 15:39:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:48.894 15:39:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 865076 00:15:48.894 15:39:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:48.894 15:39:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:48.894 15:39:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 865076' 00:15:48.894 killing process with pid 865076 00:15:48.894 15:39:40 -- common/autotest_common.sh@955 -- # kill 865076 00:15:48.894 15:39:40 -- common/autotest_common.sh@960 -- # wait 865076 00:15:49.154 15:39:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:49.154 15:39:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:49.154 15:39:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:49.154 15:39:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:49.154 15:39:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:49.154 15:39:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:49.154 15:39:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:49.154 15:39:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:51.058 15:39:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:51.058 00:15:51.058 real 0m29.023s 00:15:51.058 user 0m42.845s 00:15:51.058 sys 0m8.233s 00:15:51.058 15:39:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:51.058 15:39:42 -- common/autotest_common.sh@10 -- # set +x 00:15:51.058 ************************************ 00:15:51.058 END TEST nvmf_zcopy 00:15:51.058 ************************************ 00:15:51.058 15:39:42 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:15:51.058 15:39:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:51.058 15:39:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:51.058 15:39:42 -- common/autotest_common.sh@10 -- # set +x 00:15:51.058 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:15:51.058 ************************************ 00:15:51.058 START TEST nvmf_nmic 00:15:51.058 ************************************ 00:15:51.058 15:39:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:15:51.318 * Looking for test storage... 00:15:51.318 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:51.318 15:39:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:51.318 15:39:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:51.318 15:39:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:51.318 15:39:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:51.318 15:39:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:51.318 15:39:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:51.318 15:39:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:51.318 15:39:42 -- scripts/common.sh@335 -- # IFS=.-: 00:15:51.318 15:39:42 -- scripts/common.sh@335 -- # read -ra ver1 00:15:51.318 15:39:42 -- scripts/common.sh@336 -- # IFS=.-: 00:15:51.318 15:39:42 -- scripts/common.sh@336 -- # read -ra ver2 00:15:51.318 15:39:42 -- scripts/common.sh@337 -- # local 'op=<' 00:15:51.318 15:39:42 -- scripts/common.sh@339 -- # ver1_l=2 00:15:51.318 15:39:42 -- scripts/common.sh@340 -- # ver2_l=1 00:15:51.318 15:39:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:51.318 15:39:42 -- scripts/common.sh@343 -- # case "$op" in 00:15:51.318 15:39:42 -- scripts/common.sh@344 -- # : 1 00:15:51.318 15:39:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:51.318 15:39:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:51.318 15:39:42 -- scripts/common.sh@364 -- # decimal 1 00:15:51.318 15:39:42 -- scripts/common.sh@352 -- # local d=1 00:15:51.318 15:39:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:51.318 15:39:42 -- scripts/common.sh@354 -- # echo 1 00:15:51.318 15:39:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:51.318 15:39:42 -- scripts/common.sh@365 -- # decimal 2 00:15:51.318 15:39:42 -- scripts/common.sh@352 -- # local d=2 00:15:51.318 15:39:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:51.318 15:39:42 -- scripts/common.sh@354 -- # echo 2 00:15:51.318 15:39:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:51.318 15:39:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:51.318 15:39:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:51.318 15:39:42 -- scripts/common.sh@367 -- # return 0 00:15:51.318 15:39:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:51.318 15:39:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:51.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:51.318 --rc genhtml_branch_coverage=1 00:15:51.318 --rc genhtml_function_coverage=1 00:15:51.318 --rc genhtml_legend=1 00:15:51.318 --rc geninfo_all_blocks=1 00:15:51.318 --rc geninfo_unexecuted_blocks=1 00:15:51.318 00:15:51.318 ' 00:15:51.318 15:39:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:51.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:51.318 --rc genhtml_branch_coverage=1 00:15:51.318 --rc genhtml_function_coverage=1 00:15:51.318 --rc genhtml_legend=1 00:15:51.318 --rc geninfo_all_blocks=1 00:15:51.318 --rc geninfo_unexecuted_blocks=1 00:15:51.318 00:15:51.318 ' 00:15:51.318 15:39:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:51.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:51.318 --rc genhtml_branch_coverage=1 00:15:51.318 --rc genhtml_function_coverage=1 00:15:51.318 --rc genhtml_legend=1 00:15:51.318 --rc geninfo_all_blocks=1 00:15:51.318 --rc geninfo_unexecuted_blocks=1 00:15:51.318 00:15:51.318 ' 00:15:51.318 15:39:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:51.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:51.318 --rc genhtml_branch_coverage=1 00:15:51.318 --rc genhtml_function_coverage=1 00:15:51.318 --rc genhtml_legend=1 00:15:51.318 --rc geninfo_all_blocks=1 00:15:51.318 --rc geninfo_unexecuted_blocks=1 00:15:51.318 00:15:51.318 ' 00:15:51.318 15:39:42 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:51.318 15:39:42 -- nvmf/common.sh@7 -- # uname -s 00:15:51.318 15:39:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:51.318 15:39:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:51.318 15:39:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:51.318 15:39:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:51.318 15:39:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:51.318 15:39:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:51.318 15:39:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:51.318 15:39:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:51.318 15:39:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:51.318 15:39:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:51.318 15:39:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:51.318 15:39:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:51.318 15:39:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:51.318 15:39:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:51.319 15:39:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:51.319 15:39:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:51.319 15:39:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:51.319 15:39:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:51.319 15:39:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:51.319 15:39:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.319 15:39:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.319 15:39:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.319 15:39:42 -- paths/export.sh@5 -- # export PATH 00:15:51.319 15:39:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.319 15:39:42 -- nvmf/common.sh@46 -- # : 0 00:15:51.319 15:39:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:51.319 15:39:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:51.319 15:39:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:51.319 15:39:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:51.319 15:39:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:51.319 15:39:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:51.319 15:39:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:51.319 15:39:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:51.319 15:39:42 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:51.319 15:39:42 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:51.319 15:39:42 -- target/nmic.sh@14 -- # nvmftestinit 00:15:51.319 15:39:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:51.319 15:39:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:51.319 15:39:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:51.319 15:39:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:51.319 15:39:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:51.319 15:39:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:51.319 15:39:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:51.319 15:39:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:51.319 15:39:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:51.319 15:39:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:51.319 15:39:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:51.319 15:39:42 -- common/autotest_common.sh@10 -- # set +x 00:15:53.225 15:39:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:53.225 15:39:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:53.225 15:39:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:53.225 15:39:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:53.225 15:39:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:53.225 15:39:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:53.225 15:39:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:53.225 15:39:44 -- nvmf/common.sh@294 -- # net_devs=() 00:15:53.225 15:39:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:53.225 15:39:44 -- nvmf/common.sh@295 -- # e810=() 00:15:53.225 15:39:44 -- nvmf/common.sh@295 -- # local -ga e810 00:15:53.225 15:39:44 -- nvmf/common.sh@296 -- # x722=() 00:15:53.225 15:39:44 -- nvmf/common.sh@296 -- # local -ga x722 00:15:53.225 15:39:44 -- nvmf/common.sh@297 -- # mlx=() 00:15:53.225 15:39:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:53.225 15:39:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:53.225 15:39:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:53.225 15:39:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:53.225 15:39:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:53.225 15:39:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:53.225 15:39:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:53.225 15:39:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:53.225 15:39:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:53.225 15:39:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:53.225 15:39:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:53.225 15:39:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:53.225 15:39:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:53.225 15:39:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:53.225 15:39:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:53.225 15:39:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:53.225 15:39:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:53.225 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:53.225 15:39:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:53.225 15:39:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:53.225 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:53.225 15:39:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:53.225 15:39:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:53.225 15:39:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:53.225 15:39:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:53.225 15:39:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:53.225 15:39:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:53.225 15:39:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:53.225 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:53.225 15:39:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:53.225 15:39:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:53.225 15:39:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:53.485 15:39:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:53.485 15:39:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:53.485 15:39:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:53.485 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:53.485 15:39:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:53.485 15:39:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:53.485 15:39:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:53.485 15:39:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:53.485 15:39:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:53.485 15:39:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:53.485 15:39:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:53.485 15:39:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:53.485 15:39:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:53.485 15:39:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:53.485 15:39:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:53.485 15:39:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:53.485 15:39:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:53.485 15:39:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:53.485 15:39:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:53.485 15:39:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:53.485 15:39:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:53.485 15:39:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:53.485 15:39:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:53.485 15:39:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:53.485 15:39:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:53.485 15:39:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:53.485 15:39:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:53.485 15:39:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:53.485 15:39:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:53.485 15:39:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:53.485 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:53.485 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.321 ms 00:15:53.485 00:15:53.485 --- 10.0.0.2 ping statistics --- 00:15:53.485 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:53.485 rtt min/avg/max/mdev = 0.321/0.321/0.321/0.000 ms 00:15:53.485 15:39:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:53.485 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:53.485 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.179 ms 00:15:53.485 00:15:53.485 --- 10.0.0.1 ping statistics --- 00:15:53.485 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:53.485 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:15:53.485 15:39:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:53.485 15:39:44 -- nvmf/common.sh@410 -- # return 0 00:15:53.485 15:39:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:53.485 15:39:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:53.485 15:39:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:53.485 15:39:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:53.485 15:39:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:53.485 15:39:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:53.485 15:39:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:53.485 15:39:44 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:15:53.485 15:39:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:53.485 15:39:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:53.485 15:39:44 -- common/autotest_common.sh@10 -- # set +x 00:15:53.485 15:39:44 -- nvmf/common.sh@469 -- # nvmfpid=869750 00:15:53.485 15:39:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:53.485 15:39:44 -- nvmf/common.sh@470 -- # waitforlisten 869750 00:15:53.485 15:39:44 -- common/autotest_common.sh@829 -- # '[' -z 869750 ']' 00:15:53.485 15:39:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:53.485 15:39:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:53.485 15:39:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:53.485 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:53.485 15:39:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:53.485 15:39:44 -- common/autotest_common.sh@10 -- # set +x 00:15:53.485 [2024-11-26 15:39:44.886841] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:53.485 [2024-11-26 15:39:44.886936] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:53.485 EAL: No free 2048 kB hugepages reported on node 1 00:15:53.744 [2024-11-26 15:39:44.953511] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:53.744 [2024-11-26 15:39:45.063156] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:53.744 [2024-11-26 15:39:45.063328] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:53.744 [2024-11-26 15:39:45.063349] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:53.744 [2024-11-26 15:39:45.063372] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:53.744 [2024-11-26 15:39:45.063440] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:53.744 [2024-11-26 15:39:45.063567] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:53.744 [2024-11-26 15:39:45.063808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:53.744 [2024-11-26 15:39:45.063813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:54.678 15:39:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:54.678 15:39:45 -- common/autotest_common.sh@862 -- # return 0 00:15:54.678 15:39:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:54.678 15:39:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:54.678 15:39:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.678 15:39:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:54.678 15:39:45 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:54.678 15:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:54.678 15:39:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.678 [2024-11-26 15:39:45.888247] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:54.678 15:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:54.678 15:39:45 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:54.678 15:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:54.678 15:39:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.678 Malloc0 00:15:54.678 15:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:54.679 15:39:45 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:15:54.679 15:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:54.679 15:39:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.679 15:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:54.679 15:39:45 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:54.679 15:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:54.679 15:39:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.679 15:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:54.679 15:39:45 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:54.679 15:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:54.679 15:39:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.679 [2024-11-26 15:39:45.939303] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:54.679 15:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:54.679 15:39:45 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:15:54.679 test case1: single bdev can't be used in multiple subsystems 00:15:54.679 15:39:45 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:15:54.679 15:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:54.679 15:39:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.679 15:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:54.679 15:39:45 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:15:54.679 15:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:54.679 15:39:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.679 15:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:54.679 15:39:45 -- target/nmic.sh@28 -- # nmic_status=0 00:15:54.679 15:39:45 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:15:54.679 15:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:54.679 15:39:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.679 [2024-11-26 15:39:45.963159] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:15:54.679 [2024-11-26 15:39:45.963187] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:15:54.679 [2024-11-26 15:39:45.963216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:54.679 request: 00:15:54.679 { 00:15:54.679 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:15:54.679 "namespace": { 00:15:54.679 "bdev_name": "Malloc0" 00:15:54.679 }, 00:15:54.679 "method": "nvmf_subsystem_add_ns", 00:15:54.679 "req_id": 1 00:15:54.679 } 00:15:54.679 Got JSON-RPC error response 00:15:54.679 response: 00:15:54.679 { 00:15:54.679 "code": -32602, 00:15:54.679 "message": "Invalid parameters" 00:15:54.679 } 00:15:54.679 15:39:45 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:15:54.679 15:39:45 -- target/nmic.sh@29 -- # nmic_status=1 00:15:54.679 15:39:45 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:15:54.679 15:39:45 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:15:54.679 Adding namespace failed - expected result. 00:15:54.679 15:39:45 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:15:54.679 test case2: host connect to nvmf target in multiple paths 00:15:54.679 15:39:45 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:15:54.679 15:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:54.679 15:39:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.679 [2024-11-26 15:39:45.971287] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:15:54.679 15:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:54.679 15:39:45 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:55.245 15:39:46 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:15:56.178 15:39:47 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:15:56.178 15:39:47 -- common/autotest_common.sh@1187 -- # local i=0 00:15:56.178 15:39:47 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:56.178 15:39:47 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:15:56.178 15:39:47 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:58.139 15:39:49 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:58.140 15:39:49 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:58.140 15:39:49 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:58.140 15:39:49 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:15:58.140 15:39:49 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:58.140 15:39:49 -- common/autotest_common.sh@1197 -- # return 0 00:15:58.140 15:39:49 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:15:58.140 [global] 00:15:58.140 thread=1 00:15:58.140 invalidate=1 00:15:58.140 rw=write 00:15:58.140 time_based=1 00:15:58.140 runtime=1 00:15:58.140 ioengine=libaio 00:15:58.140 direct=1 00:15:58.140 bs=4096 00:15:58.140 iodepth=1 00:15:58.140 norandommap=0 00:15:58.140 numjobs=1 00:15:58.140 00:15:58.140 verify_dump=1 00:15:58.140 verify_backlog=512 00:15:58.140 verify_state_save=0 00:15:58.140 do_verify=1 00:15:58.140 verify=crc32c-intel 00:15:58.140 [job0] 00:15:58.140 filename=/dev/nvme0n1 00:15:58.140 Could not set queue depth (nvme0n1) 00:15:58.140 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:58.140 fio-3.35 00:15:58.140 Starting 1 thread 00:15:59.513 00:15:59.513 job0: (groupid=0, jobs=1): err= 0: pid=870497: Tue Nov 26 15:39:50 2024 00:15:59.513 read: IOPS=517, BW=2071KiB/s (2121kB/s)(2148KiB/1037msec) 00:15:59.513 slat (nsec): min=5761, max=45421, avg=15001.01, stdev=7059.90 00:15:59.513 clat (usec): min=208, max=42026, avg=1475.91, stdev=6994.39 00:15:59.513 lat (usec): min=214, max=42043, avg=1490.91, stdev=6994.83 00:15:59.513 clat percentiles (usec): 00:15:59.513 | 1.00th=[ 217], 5.00th=[ 223], 10.00th=[ 227], 20.00th=[ 231], 00:15:59.513 | 30.00th=[ 235], 40.00th=[ 239], 50.00th=[ 243], 60.00th=[ 247], 00:15:59.513 | 70.00th=[ 255], 80.00th=[ 273], 90.00th=[ 302], 95.00th=[ 343], 00:15:59.513 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:15:59.513 | 99.99th=[42206] 00:15:59.513 write: IOPS=987, BW=3950KiB/s (4045kB/s)(4096KiB/1037msec); 0 zone resets 00:15:59.513 slat (usec): min=7, max=31820, avg=48.19, stdev=993.87 00:15:59.513 clat (usec): min=142, max=357, avg=175.17, stdev=25.39 00:15:59.513 lat (usec): min=150, max=32177, avg=223.36, stdev=999.95 00:15:59.513 clat percentiles (usec): 00:15:59.513 | 1.00th=[ 149], 5.00th=[ 155], 10.00th=[ 159], 20.00th=[ 161], 00:15:59.513 | 30.00th=[ 163], 40.00th=[ 167], 50.00th=[ 169], 60.00th=[ 172], 00:15:59.513 | 70.00th=[ 176], 80.00th=[ 182], 90.00th=[ 198], 95.00th=[ 217], 00:15:59.513 | 99.00th=[ 302], 99.50th=[ 330], 99.90th=[ 347], 99.95th=[ 359], 00:15:59.513 | 99.99th=[ 359] 00:15:59.513 bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 00:15:59.513 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:15:59.513 lat (usec) : 250=85.84%, 500=13.07%, 750=0.06% 00:15:59.513 lat (msec) : 50=1.02% 00:15:59.514 cpu : usr=1.93%, sys=1.83%, ctx=1566, majf=0, minf=1 00:15:59.514 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:59.514 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.514 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.514 issued rwts: total=537,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:59.514 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:59.514 00:15:59.514 Run status group 0 (all jobs): 00:15:59.514 READ: bw=2071KiB/s (2121kB/s), 2071KiB/s-2071KiB/s (2121kB/s-2121kB/s), io=2148KiB (2200kB), run=1037-1037msec 00:15:59.514 WRITE: bw=3950KiB/s (4045kB/s), 3950KiB/s-3950KiB/s (4045kB/s-4045kB/s), io=4096KiB (4194kB), run=1037-1037msec 00:15:59.514 00:15:59.514 Disk stats (read/write): 00:15:59.514 nvme0n1: ios=585/1024, merge=0/0, ticks=1144/172, in_queue=1316, util=98.70% 00:15:59.514 15:39:50 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:59.514 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:15:59.514 15:39:50 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:59.514 15:39:50 -- common/autotest_common.sh@1208 -- # local i=0 00:15:59.514 15:39:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:59.514 15:39:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:59.514 15:39:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:59.514 15:39:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:59.514 15:39:50 -- common/autotest_common.sh@1220 -- # return 0 00:15:59.514 15:39:50 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:15:59.514 15:39:50 -- target/nmic.sh@53 -- # nvmftestfini 00:15:59.514 15:39:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:59.514 15:39:50 -- nvmf/common.sh@116 -- # sync 00:15:59.514 15:39:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:59.514 15:39:50 -- nvmf/common.sh@119 -- # set +e 00:15:59.514 15:39:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:59.514 15:39:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:59.514 rmmod nvme_tcp 00:15:59.514 rmmod nvme_fabrics 00:15:59.514 rmmod nvme_keyring 00:15:59.514 15:39:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:59.772 15:39:50 -- nvmf/common.sh@123 -- # set -e 00:15:59.772 15:39:50 -- nvmf/common.sh@124 -- # return 0 00:15:59.772 15:39:50 -- nvmf/common.sh@477 -- # '[' -n 869750 ']' 00:15:59.772 15:39:50 -- nvmf/common.sh@478 -- # killprocess 869750 00:15:59.772 15:39:50 -- common/autotest_common.sh@936 -- # '[' -z 869750 ']' 00:15:59.772 15:39:50 -- common/autotest_common.sh@940 -- # kill -0 869750 00:15:59.772 15:39:50 -- common/autotest_common.sh@941 -- # uname 00:15:59.772 15:39:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:59.772 15:39:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 869750 00:15:59.772 15:39:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:59.772 15:39:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:59.772 15:39:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 869750' 00:15:59.772 killing process with pid 869750 00:15:59.772 15:39:51 -- common/autotest_common.sh@955 -- # kill 869750 00:15:59.772 15:39:51 -- common/autotest_common.sh@960 -- # wait 869750 00:16:00.032 15:39:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:00.032 15:39:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:00.032 15:39:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:00.032 15:39:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:00.032 15:39:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:00.032 15:39:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:00.032 15:39:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:00.032 15:39:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:01.939 15:39:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:01.939 00:16:01.939 real 0m10.877s 00:16:01.939 user 0m25.780s 00:16:01.939 sys 0m2.491s 00:16:01.939 15:39:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:01.939 15:39:53 -- common/autotest_common.sh@10 -- # set +x 00:16:01.939 ************************************ 00:16:01.939 END TEST nvmf_nmic 00:16:01.939 ************************************ 00:16:02.198 15:39:53 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:02.198 15:39:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:02.198 15:39:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:02.198 15:39:53 -- common/autotest_common.sh@10 -- # set +x 00:16:02.198 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:16:02.198 ************************************ 00:16:02.198 START TEST nvmf_fio_target 00:16:02.198 ************************************ 00:16:02.198 15:39:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:02.198 * Looking for test storage... 00:16:02.198 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:02.198 15:39:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:02.198 15:39:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:02.198 15:39:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:02.198 15:39:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:02.198 15:39:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:02.198 15:39:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:02.198 15:39:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:02.198 15:39:53 -- scripts/common.sh@335 -- # IFS=.-: 00:16:02.198 15:39:53 -- scripts/common.sh@335 -- # read -ra ver1 00:16:02.198 15:39:53 -- scripts/common.sh@336 -- # IFS=.-: 00:16:02.198 15:39:53 -- scripts/common.sh@336 -- # read -ra ver2 00:16:02.198 15:39:53 -- scripts/common.sh@337 -- # local 'op=<' 00:16:02.198 15:39:53 -- scripts/common.sh@339 -- # ver1_l=2 00:16:02.198 15:39:53 -- scripts/common.sh@340 -- # ver2_l=1 00:16:02.198 15:39:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:02.198 15:39:53 -- scripts/common.sh@343 -- # case "$op" in 00:16:02.198 15:39:53 -- scripts/common.sh@344 -- # : 1 00:16:02.198 15:39:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:02.198 15:39:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:02.198 15:39:53 -- scripts/common.sh@364 -- # decimal 1 00:16:02.198 15:39:53 -- scripts/common.sh@352 -- # local d=1 00:16:02.198 15:39:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:02.198 15:39:53 -- scripts/common.sh@354 -- # echo 1 00:16:02.198 15:39:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:02.198 15:39:53 -- scripts/common.sh@365 -- # decimal 2 00:16:02.198 15:39:53 -- scripts/common.sh@352 -- # local d=2 00:16:02.198 15:39:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:02.198 15:39:53 -- scripts/common.sh@354 -- # echo 2 00:16:02.198 15:39:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:02.198 15:39:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:02.198 15:39:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:02.198 15:39:53 -- scripts/common.sh@367 -- # return 0 00:16:02.198 15:39:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:02.198 15:39:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:02.198 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:02.198 --rc genhtml_branch_coverage=1 00:16:02.198 --rc genhtml_function_coverage=1 00:16:02.198 --rc genhtml_legend=1 00:16:02.198 --rc geninfo_all_blocks=1 00:16:02.198 --rc geninfo_unexecuted_blocks=1 00:16:02.198 00:16:02.198 ' 00:16:02.198 15:39:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:02.198 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:02.198 --rc genhtml_branch_coverage=1 00:16:02.198 --rc genhtml_function_coverage=1 00:16:02.198 --rc genhtml_legend=1 00:16:02.198 --rc geninfo_all_blocks=1 00:16:02.198 --rc geninfo_unexecuted_blocks=1 00:16:02.198 00:16:02.198 ' 00:16:02.198 15:39:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:02.198 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:02.198 --rc genhtml_branch_coverage=1 00:16:02.198 --rc genhtml_function_coverage=1 00:16:02.198 --rc genhtml_legend=1 00:16:02.198 --rc geninfo_all_blocks=1 00:16:02.198 --rc geninfo_unexecuted_blocks=1 00:16:02.198 00:16:02.198 ' 00:16:02.198 15:39:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:02.198 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:02.198 --rc genhtml_branch_coverage=1 00:16:02.198 --rc genhtml_function_coverage=1 00:16:02.198 --rc genhtml_legend=1 00:16:02.198 --rc geninfo_all_blocks=1 00:16:02.198 --rc geninfo_unexecuted_blocks=1 00:16:02.198 00:16:02.198 ' 00:16:02.198 15:39:53 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:02.198 15:39:53 -- nvmf/common.sh@7 -- # uname -s 00:16:02.198 15:39:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:02.198 15:39:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:02.198 15:39:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:02.198 15:39:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:02.198 15:39:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:02.199 15:39:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:02.199 15:39:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:02.199 15:39:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:02.199 15:39:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:02.199 15:39:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:02.199 15:39:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:02.199 15:39:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:02.199 15:39:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:02.199 15:39:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:02.199 15:39:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:02.199 15:39:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:02.199 15:39:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:02.199 15:39:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:02.199 15:39:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:02.199 15:39:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.199 15:39:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.199 15:39:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.199 15:39:53 -- paths/export.sh@5 -- # export PATH 00:16:02.199 15:39:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.199 15:39:53 -- nvmf/common.sh@46 -- # : 0 00:16:02.199 15:39:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:02.199 15:39:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:02.199 15:39:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:02.199 15:39:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:02.199 15:39:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:02.199 15:39:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:02.199 15:39:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:02.199 15:39:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:02.199 15:39:53 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:02.199 15:39:53 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:02.199 15:39:53 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:02.199 15:39:53 -- target/fio.sh@16 -- # nvmftestinit 00:16:02.199 15:39:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:02.199 15:39:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:02.199 15:39:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:02.199 15:39:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:02.199 15:39:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:02.199 15:39:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:02.199 15:39:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:02.199 15:39:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:02.199 15:39:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:02.199 15:39:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:02.199 15:39:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:02.199 15:39:53 -- common/autotest_common.sh@10 -- # set +x 00:16:04.100 15:39:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:04.100 15:39:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:04.100 15:39:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:04.100 15:39:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:04.100 15:39:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:04.100 15:39:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:04.100 15:39:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:04.100 15:39:55 -- nvmf/common.sh@294 -- # net_devs=() 00:16:04.100 15:39:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:04.100 15:39:55 -- nvmf/common.sh@295 -- # e810=() 00:16:04.100 15:39:55 -- nvmf/common.sh@295 -- # local -ga e810 00:16:04.100 15:39:55 -- nvmf/common.sh@296 -- # x722=() 00:16:04.100 15:39:55 -- nvmf/common.sh@296 -- # local -ga x722 00:16:04.100 15:39:55 -- nvmf/common.sh@297 -- # mlx=() 00:16:04.100 15:39:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:04.100 15:39:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:04.100 15:39:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:04.100 15:39:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:04.100 15:39:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:04.100 15:39:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:04.100 15:39:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:04.100 15:39:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:04.100 15:39:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:04.100 15:39:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:04.100 15:39:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:04.100 15:39:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:04.100 15:39:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:04.100 15:39:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:04.100 15:39:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:04.100 15:39:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:04.100 15:39:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:04.100 15:39:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:04.100 15:39:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:04.101 15:39:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:04.101 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:04.101 15:39:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:04.101 15:39:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:04.101 15:39:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:04.101 15:39:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:04.101 15:39:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:04.101 15:39:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:04.101 15:39:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:04.101 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:04.101 15:39:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:04.101 15:39:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:04.101 15:39:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:04.101 15:39:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:04.101 15:39:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:04.101 15:39:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:04.101 15:39:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:04.101 15:39:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:04.101 15:39:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:04.101 15:39:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:04.101 15:39:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:04.101 15:39:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:04.101 15:39:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:04.101 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:04.101 15:39:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:04.101 15:39:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:04.101 15:39:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:04.101 15:39:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:04.101 15:39:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:04.101 15:39:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:04.101 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:04.101 15:39:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:04.101 15:39:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:04.101 15:39:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:04.101 15:39:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:04.101 15:39:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:04.101 15:39:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:04.101 15:39:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:04.101 15:39:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:04.101 15:39:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:04.101 15:39:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:04.101 15:39:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:04.101 15:39:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:04.101 15:39:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:04.101 15:39:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:04.101 15:39:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:04.101 15:39:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:04.101 15:39:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:04.101 15:39:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:04.101 15:39:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:04.101 15:39:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:04.101 15:39:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:04.101 15:39:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:04.101 15:39:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:04.359 15:39:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:04.359 15:39:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:04.359 15:39:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:04.359 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:04.359 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.224 ms 00:16:04.359 00:16:04.359 --- 10.0.0.2 ping statistics --- 00:16:04.359 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:04.359 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:16:04.359 15:39:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:04.359 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:04.359 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:16:04.359 00:16:04.359 --- 10.0.0.1 ping statistics --- 00:16:04.359 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:04.359 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:16:04.359 15:39:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:04.359 15:39:55 -- nvmf/common.sh@410 -- # return 0 00:16:04.359 15:39:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:04.359 15:39:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:04.359 15:39:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:04.359 15:39:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:04.359 15:39:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:04.359 15:39:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:04.359 15:39:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:04.359 15:39:55 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:04.359 15:39:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:04.359 15:39:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:04.359 15:39:55 -- common/autotest_common.sh@10 -- # set +x 00:16:04.359 15:39:55 -- nvmf/common.sh@469 -- # nvmfpid=872555 00:16:04.359 15:39:55 -- nvmf/common.sh@470 -- # waitforlisten 872555 00:16:04.359 15:39:55 -- common/autotest_common.sh@829 -- # '[' -z 872555 ']' 00:16:04.359 15:39:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:04.359 15:39:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:04.359 15:39:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:04.359 15:39:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:04.359 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:04.359 15:39:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:04.359 15:39:55 -- common/autotest_common.sh@10 -- # set +x 00:16:04.359 [2024-11-26 15:39:55.663028] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:04.359 [2024-11-26 15:39:55.663104] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:04.359 EAL: No free 2048 kB hugepages reported on node 1 00:16:04.359 [2024-11-26 15:39:55.731400] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:04.617 [2024-11-26 15:39:55.850155] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:04.617 [2024-11-26 15:39:55.850318] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:04.618 [2024-11-26 15:39:55.850345] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:04.618 [2024-11-26 15:39:55.850369] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:04.618 [2024-11-26 15:39:55.850467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:04.618 [2024-11-26 15:39:55.850530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:04.618 [2024-11-26 15:39:55.850732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:04.618 [2024-11-26 15:39:55.850738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:05.183 15:39:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:05.183 15:39:56 -- common/autotest_common.sh@862 -- # return 0 00:16:05.183 15:39:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:05.183 15:39:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:05.183 15:39:56 -- common/autotest_common.sh@10 -- # set +x 00:16:05.441 15:39:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:05.441 15:39:56 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:05.441 [2024-11-26 15:39:56.859948] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:05.441 15:39:56 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:06.007 15:39:57 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:06.007 15:39:57 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:06.007 15:39:57 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:06.007 15:39:57 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:06.265 15:39:57 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:06.265 15:39:57 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:06.524 15:39:57 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:06.524 15:39:57 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:06.782 15:39:58 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:07.040 15:39:58 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:07.040 15:39:58 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:07.607 15:39:58 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:07.607 15:39:58 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:07.607 15:39:59 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:07.607 15:39:59 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:07.871 15:39:59 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:08.132 15:39:59 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:08.132 15:39:59 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:08.390 15:39:59 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:08.390 15:39:59 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:08.648 15:40:00 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:08.906 [2024-11-26 15:40:00.253519] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:08.906 15:40:00 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:09.164 15:40:00 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:09.422 15:40:00 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:10.357 15:40:01 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:10.357 15:40:01 -- common/autotest_common.sh@1187 -- # local i=0 00:16:10.357 15:40:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:10.357 15:40:01 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:10.357 15:40:01 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:10.357 15:40:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:12.255 15:40:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:12.255 15:40:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:12.255 15:40:03 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:12.255 15:40:03 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:12.255 15:40:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:12.255 15:40:03 -- common/autotest_common.sh@1197 -- # return 0 00:16:12.255 15:40:03 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:12.255 [global] 00:16:12.255 thread=1 00:16:12.255 invalidate=1 00:16:12.255 rw=write 00:16:12.255 time_based=1 00:16:12.255 runtime=1 00:16:12.255 ioengine=libaio 00:16:12.255 direct=1 00:16:12.255 bs=4096 00:16:12.255 iodepth=1 00:16:12.255 norandommap=0 00:16:12.255 numjobs=1 00:16:12.255 00:16:12.255 verify_dump=1 00:16:12.255 verify_backlog=512 00:16:12.255 verify_state_save=0 00:16:12.255 do_verify=1 00:16:12.255 verify=crc32c-intel 00:16:12.255 [job0] 00:16:12.255 filename=/dev/nvme0n1 00:16:12.255 [job1] 00:16:12.255 filename=/dev/nvme0n2 00:16:12.255 [job2] 00:16:12.255 filename=/dev/nvme0n3 00:16:12.255 [job3] 00:16:12.255 filename=/dev/nvme0n4 00:16:12.255 Could not set queue depth (nvme0n1) 00:16:12.255 Could not set queue depth (nvme0n2) 00:16:12.255 Could not set queue depth (nvme0n3) 00:16:12.255 Could not set queue depth (nvme0n4) 00:16:12.513 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:12.513 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:12.513 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:12.513 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:12.513 fio-3.35 00:16:12.513 Starting 4 threads 00:16:13.887 00:16:13.887 job0: (groupid=0, jobs=1): err= 0: pid=873616: Tue Nov 26 15:40:04 2024 00:16:13.887 read: IOPS=510, BW=2041KiB/s (2089kB/s)(2116KiB/1037msec) 00:16:13.887 slat (nsec): min=5517, max=36467, avg=8151.78, stdev=4634.85 00:16:13.887 clat (usec): min=228, max=41999, avg=1517.54, stdev=7142.99 00:16:13.887 lat (usec): min=234, max=42025, avg=1525.69, stdev=7146.41 00:16:13.887 clat percentiles (usec): 00:16:13.887 | 1.00th=[ 233], 5.00th=[ 237], 10.00th=[ 241], 20.00th=[ 245], 00:16:13.887 | 30.00th=[ 249], 40.00th=[ 253], 50.00th=[ 255], 60.00th=[ 260], 00:16:13.887 | 70.00th=[ 262], 80.00th=[ 269], 90.00th=[ 281], 95.00th=[ 314], 00:16:13.887 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:13.887 | 99.99th=[42206] 00:16:13.887 write: IOPS=987, BW=3950KiB/s (4045kB/s)(4096KiB/1037msec); 0 zone resets 00:16:13.887 slat (nsec): min=7529, max=52876, avg=14090.11, stdev=6443.92 00:16:13.887 clat (usec): min=165, max=347, avg=205.13, stdev=14.60 00:16:13.887 lat (usec): min=175, max=399, avg=219.22, stdev=16.86 00:16:13.887 clat percentiles (usec): 00:16:13.887 | 1.00th=[ 172], 5.00th=[ 180], 10.00th=[ 186], 20.00th=[ 194], 00:16:13.887 | 30.00th=[ 200], 40.00th=[ 202], 50.00th=[ 206], 60.00th=[ 210], 00:16:13.887 | 70.00th=[ 212], 80.00th=[ 217], 90.00th=[ 223], 95.00th=[ 227], 00:16:13.887 | 99.00th=[ 241], 99.50th=[ 245], 99.90th=[ 253], 99.95th=[ 347], 00:16:13.887 | 99.99th=[ 347] 00:16:13.887 bw ( KiB/s): min= 8192, max= 8192, per=51.85%, avg=8192.00, stdev= 0.00, samples=1 00:16:13.887 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:13.887 lat (usec) : 250=77.01%, 500=21.96% 00:16:13.887 lat (msec) : 50=1.03% 00:16:13.888 cpu : usr=0.87%, sys=2.80%, ctx=1553, majf=0, minf=1 00:16:13.888 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:13.888 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:13.888 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:13.888 issued rwts: total=529,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:13.888 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:13.888 job1: (groupid=0, jobs=1): err= 0: pid=873617: Tue Nov 26 15:40:04 2024 00:16:13.888 read: IOPS=22, BW=91.5KiB/s (93.7kB/s)(92.0KiB/1005msec) 00:16:13.888 slat (nsec): min=6505, max=35603, avg=24067.04, stdev=9525.50 00:16:13.888 clat (usec): min=368, max=41000, avg=38311.15, stdev=9242.53 00:16:13.888 lat (usec): min=387, max=41017, avg=38335.22, stdev=9242.46 00:16:13.888 clat percentiles (usec): 00:16:13.888 | 1.00th=[ 367], 5.00th=[21103], 10.00th=[40633], 20.00th=[41157], 00:16:13.888 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:13.888 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:13.888 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:13.888 | 99.99th=[41157] 00:16:13.888 write: IOPS=509, BW=2038KiB/s (2087kB/s)(2048KiB/1005msec); 0 zone resets 00:16:13.888 slat (nsec): min=6523, max=31990, avg=9157.48, stdev=3808.05 00:16:13.888 clat (usec): min=155, max=409, avg=226.45, stdev=63.10 00:16:13.888 lat (usec): min=162, max=426, avg=235.61, stdev=64.85 00:16:13.888 clat percentiles (usec): 00:16:13.888 | 1.00th=[ 163], 5.00th=[ 172], 10.00th=[ 178], 20.00th=[ 184], 00:16:13.888 | 30.00th=[ 190], 40.00th=[ 196], 50.00th=[ 202], 60.00th=[ 210], 00:16:13.888 | 70.00th=[ 227], 80.00th=[ 265], 90.00th=[ 343], 95.00th=[ 383], 00:16:13.888 | 99.00th=[ 396], 99.50th=[ 400], 99.90th=[ 408], 99.95th=[ 408], 00:16:13.888 | 99.99th=[ 408] 00:16:13.888 bw ( KiB/s): min= 4096, max= 4096, per=25.93%, avg=4096.00, stdev= 0.00, samples=1 00:16:13.888 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:13.888 lat (usec) : 250=73.83%, 500=22.06% 00:16:13.888 lat (msec) : 50=4.11% 00:16:13.888 cpu : usr=0.00%, sys=0.70%, ctx=537, majf=0, minf=1 00:16:13.888 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:13.888 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:13.888 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:13.888 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:13.888 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:13.888 job2: (groupid=0, jobs=1): err= 0: pid=873618: Tue Nov 26 15:40:04 2024 00:16:13.888 read: IOPS=1742, BW=6969KiB/s (7136kB/s)(6976KiB/1001msec) 00:16:13.888 slat (nsec): min=4968, max=64621, avg=18876.56, stdev=10814.56 00:16:13.888 clat (usec): min=235, max=1032, avg=303.04, stdev=57.68 00:16:13.888 lat (usec): min=241, max=1053, avg=321.92, stdev=63.52 00:16:13.888 clat percentiles (usec): 00:16:13.888 | 1.00th=[ 247], 5.00th=[ 253], 10.00th=[ 258], 20.00th=[ 265], 00:16:13.888 | 30.00th=[ 269], 40.00th=[ 277], 50.00th=[ 285], 60.00th=[ 293], 00:16:13.888 | 70.00th=[ 318], 80.00th=[ 334], 90.00th=[ 375], 95.00th=[ 408], 00:16:13.888 | 99.00th=[ 486], 99.50th=[ 502], 99.90th=[ 832], 99.95th=[ 1037], 00:16:13.888 | 99.99th=[ 1037] 00:16:13.888 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:16:13.888 slat (nsec): min=6654, max=44506, avg=14866.27, stdev=4873.37 00:16:13.888 clat (usec): min=146, max=462, avg=190.45, stdev=47.44 00:16:13.888 lat (usec): min=155, max=479, avg=205.31, stdev=46.37 00:16:13.888 clat percentiles (usec): 00:16:13.888 | 1.00th=[ 153], 5.00th=[ 159], 10.00th=[ 161], 20.00th=[ 165], 00:16:13.888 | 30.00th=[ 167], 40.00th=[ 172], 50.00th=[ 176], 60.00th=[ 178], 00:16:13.888 | 70.00th=[ 184], 80.00th=[ 208], 90.00th=[ 233], 95.00th=[ 285], 00:16:13.888 | 99.00th=[ 388], 99.50th=[ 396], 99.90th=[ 441], 99.95th=[ 445], 00:16:13.888 | 99.99th=[ 465] 00:16:13.888 bw ( KiB/s): min= 8192, max= 8192, per=51.85%, avg=8192.00, stdev= 0.00, samples=1 00:16:13.888 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:13.888 lat (usec) : 250=51.61%, 500=48.13%, 750=0.21%, 1000=0.03% 00:16:13.888 lat (msec) : 2=0.03% 00:16:13.888 cpu : usr=3.80%, sys=6.10%, ctx=3794, majf=0, minf=1 00:16:13.888 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:13.888 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:13.888 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:13.888 issued rwts: total=1744,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:13.888 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:13.888 job3: (groupid=0, jobs=1): err= 0: pid=873619: Tue Nov 26 15:40:04 2024 00:16:13.888 read: IOPS=22, BW=89.8KiB/s (91.9kB/s)(92.0KiB/1025msec) 00:16:13.888 slat (nsec): min=12501, max=40806, avg=25402.83, stdev=9529.53 00:16:13.888 clat (usec): min=436, max=42402, avg=39453.75, stdev=8517.56 00:16:13.888 lat (usec): min=477, max=42435, avg=39479.16, stdev=8514.47 00:16:13.888 clat percentiles (usec): 00:16:13.888 | 1.00th=[ 437], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:16:13.888 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:13.888 | 70.00th=[41157], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:13.888 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:13.888 | 99.99th=[42206] 00:16:13.888 write: IOPS=499, BW=1998KiB/s (2046kB/s)(2048KiB/1025msec); 0 zone resets 00:16:13.888 slat (nsec): min=6381, max=52771, avg=8338.24, stdev=3425.04 00:16:13.888 clat (usec): min=173, max=398, avg=217.22, stdev=27.76 00:16:13.888 lat (usec): min=180, max=423, avg=225.55, stdev=28.69 00:16:13.888 clat percentiles (usec): 00:16:13.888 | 1.00th=[ 182], 5.00th=[ 186], 10.00th=[ 190], 20.00th=[ 198], 00:16:13.888 | 30.00th=[ 204], 40.00th=[ 208], 50.00th=[ 215], 60.00th=[ 219], 00:16:13.888 | 70.00th=[ 225], 80.00th=[ 231], 90.00th=[ 243], 95.00th=[ 251], 00:16:13.888 | 99.00th=[ 383], 99.50th=[ 392], 99.90th=[ 400], 99.95th=[ 400], 00:16:13.888 | 99.99th=[ 400] 00:16:13.888 bw ( KiB/s): min= 4096, max= 4096, per=25.93%, avg=4096.00, stdev= 0.00, samples=1 00:16:13.888 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:13.888 lat (usec) : 250=91.03%, 500=4.86% 00:16:13.888 lat (msec) : 50=4.11% 00:16:13.888 cpu : usr=0.10%, sys=0.49%, ctx=535, majf=0, minf=1 00:16:13.888 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:13.888 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:13.888 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:13.888 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:13.888 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:13.888 00:16:13.888 Run status group 0 (all jobs): 00:16:13.888 READ: bw=8945KiB/s (9160kB/s), 89.8KiB/s-6969KiB/s (91.9kB/s-7136kB/s), io=9276KiB (9499kB), run=1001-1037msec 00:16:13.888 WRITE: bw=15.4MiB/s (16.2MB/s), 1998KiB/s-8184KiB/s (2046kB/s-8380kB/s), io=16.0MiB (16.8MB), run=1001-1037msec 00:16:13.888 00:16:13.888 Disk stats (read/write): 00:16:13.888 nvme0n1: ios=574/1024, merge=0/0, ticks=617/209, in_queue=826, util=86.57% 00:16:13.888 nvme0n2: ios=43/512, merge=0/0, ticks=1672/117, in_queue=1789, util=97.35% 00:16:13.888 nvme0n3: ios=1593/1607, merge=0/0, ticks=1383/297, in_queue=1680, util=97.27% 00:16:13.888 nvme0n4: ios=18/512, merge=0/0, ticks=698/108, in_queue=806, util=89.62% 00:16:13.888 15:40:04 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:13.888 [global] 00:16:13.888 thread=1 00:16:13.888 invalidate=1 00:16:13.888 rw=randwrite 00:16:13.888 time_based=1 00:16:13.888 runtime=1 00:16:13.888 ioengine=libaio 00:16:13.888 direct=1 00:16:13.888 bs=4096 00:16:13.888 iodepth=1 00:16:13.888 norandommap=0 00:16:13.888 numjobs=1 00:16:13.888 00:16:13.888 verify_dump=1 00:16:13.888 verify_backlog=512 00:16:13.888 verify_state_save=0 00:16:13.888 do_verify=1 00:16:13.888 verify=crc32c-intel 00:16:13.888 [job0] 00:16:13.888 filename=/dev/nvme0n1 00:16:13.888 [job1] 00:16:13.888 filename=/dev/nvme0n2 00:16:13.888 [job2] 00:16:13.888 filename=/dev/nvme0n3 00:16:13.888 [job3] 00:16:13.888 filename=/dev/nvme0n4 00:16:13.888 Could not set queue depth (nvme0n1) 00:16:13.888 Could not set queue depth (nvme0n2) 00:16:13.888 Could not set queue depth (nvme0n3) 00:16:13.888 Could not set queue depth (nvme0n4) 00:16:13.888 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:13.888 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:13.888 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:13.888 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:13.888 fio-3.35 00:16:13.888 Starting 4 threads 00:16:15.269 00:16:15.269 job0: (groupid=0, jobs=1): err= 0: pid=873939: Tue Nov 26 15:40:06 2024 00:16:15.269 read: IOPS=512, BW=2048KiB/s (2097kB/s)(2120KiB/1035msec) 00:16:15.269 slat (nsec): min=6398, max=51520, avg=12895.40, stdev=7432.70 00:16:15.269 clat (usec): min=260, max=41862, avg=1435.41, stdev=6356.34 00:16:15.269 lat (usec): min=267, max=41876, avg=1448.31, stdev=6356.16 00:16:15.269 clat percentiles (usec): 00:16:15.269 | 1.00th=[ 285], 5.00th=[ 297], 10.00th=[ 306], 20.00th=[ 322], 00:16:15.269 | 30.00th=[ 338], 40.00th=[ 367], 50.00th=[ 396], 60.00th=[ 416], 00:16:15.269 | 70.00th=[ 433], 80.00th=[ 453], 90.00th=[ 519], 95.00th=[ 603], 00:16:15.269 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41681], 99.95th=[41681], 00:16:15.269 | 99.99th=[41681] 00:16:15.270 write: IOPS=989, BW=3957KiB/s (4052kB/s)(4096KiB/1035msec); 0 zone resets 00:16:15.270 slat (nsec): min=7849, max=73812, avg=14436.97, stdev=8401.38 00:16:15.270 clat (usec): min=156, max=3599, avg=236.99, stdev=112.31 00:16:15.270 lat (usec): min=164, max=3622, avg=251.43, stdev=113.77 00:16:15.270 clat percentiles (usec): 00:16:15.270 | 1.00th=[ 176], 5.00th=[ 200], 10.00th=[ 206], 20.00th=[ 212], 00:16:15.270 | 30.00th=[ 217], 40.00th=[ 221], 50.00th=[ 225], 60.00th=[ 231], 00:16:15.270 | 70.00th=[ 239], 80.00th=[ 251], 90.00th=[ 265], 95.00th=[ 289], 00:16:15.270 | 99.00th=[ 437], 99.50th=[ 474], 99.90th=[ 619], 99.95th=[ 3589], 00:16:15.270 | 99.99th=[ 3589] 00:16:15.270 bw ( KiB/s): min= 8192, max= 8192, per=34.04%, avg=8192.00, stdev= 0.00, samples=1 00:16:15.270 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:15.270 lat (usec) : 250=52.83%, 500=42.66%, 750=3.54% 00:16:15.270 lat (msec) : 4=0.06%, 50=0.90% 00:16:15.270 cpu : usr=1.84%, sys=2.51%, ctx=1555, majf=0, minf=1 00:16:15.270 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:15.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.270 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.270 issued rwts: total=530,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:15.270 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:15.270 job1: (groupid=0, jobs=1): err= 0: pid=873960: Tue Nov 26 15:40:06 2024 00:16:15.270 read: IOPS=1564, BW=6258KiB/s (6408kB/s)(6264KiB/1001msec) 00:16:15.270 slat (nsec): min=4732, max=68427, avg=13088.86, stdev=7912.70 00:16:15.270 clat (usec): min=226, max=662, avg=302.44, stdev=71.91 00:16:15.270 lat (usec): min=237, max=673, avg=315.53, stdev=75.27 00:16:15.270 clat percentiles (usec): 00:16:15.270 | 1.00th=[ 235], 5.00th=[ 243], 10.00th=[ 247], 20.00th=[ 253], 00:16:15.270 | 30.00th=[ 258], 40.00th=[ 262], 50.00th=[ 269], 60.00th=[ 277], 00:16:15.270 | 70.00th=[ 310], 80.00th=[ 375], 90.00th=[ 412], 95.00th=[ 449], 00:16:15.270 | 99.00th=[ 537], 99.50th=[ 562], 99.90th=[ 652], 99.95th=[ 660], 00:16:15.270 | 99.99th=[ 660] 00:16:15.270 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:16:15.270 slat (nsec): min=5973, max=60693, avg=11926.58, stdev=6029.76 00:16:15.270 clat (usec): min=153, max=2851, avg=228.40, stdev=80.73 00:16:15.270 lat (usec): min=159, max=2858, avg=240.32, stdev=80.86 00:16:15.270 clat percentiles (usec): 00:16:15.270 | 1.00th=[ 163], 5.00th=[ 178], 10.00th=[ 184], 20.00th=[ 196], 00:16:15.270 | 30.00th=[ 208], 40.00th=[ 217], 50.00th=[ 223], 60.00th=[ 229], 00:16:15.270 | 70.00th=[ 237], 80.00th=[ 247], 90.00th=[ 265], 95.00th=[ 285], 00:16:15.270 | 99.00th=[ 388], 99.50th=[ 420], 99.90th=[ 1045], 99.95th=[ 1729], 00:16:15.270 | 99.99th=[ 2868] 00:16:15.270 bw ( KiB/s): min= 8192, max= 8192, per=34.04%, avg=8192.00, stdev= 0.00, samples=1 00:16:15.270 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:15.270 lat (usec) : 250=53.49%, 500=45.55%, 750=0.89% 00:16:15.270 lat (msec) : 2=0.06%, 4=0.03% 00:16:15.270 cpu : usr=2.10%, sys=5.50%, ctx=3614, majf=0, minf=1 00:16:15.270 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:15.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.270 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.270 issued rwts: total=1566,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:15.270 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:15.270 job2: (groupid=0, jobs=1): err= 0: pid=873965: Tue Nov 26 15:40:06 2024 00:16:15.270 read: IOPS=1278, BW=5115KiB/s (5238kB/s)(5120KiB/1001msec) 00:16:15.270 slat (nsec): min=4928, max=56188, avg=15274.40, stdev=7607.40 00:16:15.270 clat (usec): min=255, max=41037, avg=441.84, stdev=1138.32 00:16:15.270 lat (usec): min=263, max=41044, avg=457.12, stdev=1138.18 00:16:15.270 clat percentiles (usec): 00:16:15.270 | 1.00th=[ 277], 5.00th=[ 306], 10.00th=[ 322], 20.00th=[ 338], 00:16:15.270 | 30.00th=[ 355], 40.00th=[ 375], 50.00th=[ 396], 60.00th=[ 429], 00:16:15.270 | 70.00th=[ 449], 80.00th=[ 474], 90.00th=[ 519], 95.00th=[ 545], 00:16:15.270 | 99.00th=[ 644], 99.50th=[ 660], 99.90th=[ 758], 99.95th=[41157], 00:16:15.270 | 99.99th=[41157] 00:16:15.270 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:16:15.270 slat (nsec): min=6292, max=84932, avg=15930.37, stdev=9890.92 00:16:15.270 clat (usec): min=170, max=834, avg=244.15, stdev=53.71 00:16:15.270 lat (usec): min=182, max=843, avg=260.08, stdev=57.58 00:16:15.270 clat percentiles (usec): 00:16:15.270 | 1.00th=[ 184], 5.00th=[ 198], 10.00th=[ 204], 20.00th=[ 210], 00:16:15.270 | 30.00th=[ 217], 40.00th=[ 221], 50.00th=[ 225], 60.00th=[ 231], 00:16:15.270 | 70.00th=[ 245], 80.00th=[ 273], 90.00th=[ 318], 95.00th=[ 347], 00:16:15.270 | 99.00th=[ 449], 99.50th=[ 469], 99.90th=[ 529], 99.95th=[ 832], 00:16:15.270 | 99.99th=[ 832] 00:16:15.270 bw ( KiB/s): min= 7664, max= 7664, per=31.85%, avg=7664.00, stdev= 0.00, samples=1 00:16:15.270 iops : min= 1916, max= 1916, avg=1916.00, stdev= 0.00, samples=1 00:16:15.270 lat (usec) : 250=39.13%, 500=55.01%, 750=5.75%, 1000=0.07% 00:16:15.270 lat (msec) : 50=0.04% 00:16:15.270 cpu : usr=3.00%, sys=5.70%, ctx=2819, majf=0, minf=1 00:16:15.270 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:15.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.270 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.270 issued rwts: total=1280,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:15.270 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:15.270 job3: (groupid=0, jobs=1): err= 0: pid=873966: Tue Nov 26 15:40:06 2024 00:16:15.270 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:16:15.270 slat (nsec): min=6116, max=61074, avg=14032.78, stdev=7582.82 00:16:15.270 clat (usec): min=218, max=1389, avg=378.82, stdev=87.87 00:16:15.270 lat (usec): min=226, max=1396, avg=392.86, stdev=89.09 00:16:15.270 clat percentiles (usec): 00:16:15.270 | 1.00th=[ 243], 5.00th=[ 269], 10.00th=[ 289], 20.00th=[ 318], 00:16:15.270 | 30.00th=[ 330], 40.00th=[ 343], 50.00th=[ 359], 60.00th=[ 379], 00:16:15.270 | 70.00th=[ 412], 80.00th=[ 437], 90.00th=[ 478], 95.00th=[ 537], 00:16:15.270 | 99.00th=[ 652], 99.50th=[ 693], 99.90th=[ 1123], 99.95th=[ 1385], 00:16:15.270 | 99.99th=[ 1385] 00:16:15.270 write: IOPS=1617, BW=6470KiB/s (6625kB/s)(6476KiB/1001msec); 0 zone resets 00:16:15.270 slat (nsec): min=7781, max=58193, avg=15441.04, stdev=7792.30 00:16:15.270 clat (usec): min=153, max=413, avg=219.12, stdev=28.69 00:16:15.270 lat (usec): min=164, max=422, avg=234.56, stdev=30.03 00:16:15.270 clat percentiles (usec): 00:16:15.270 | 1.00th=[ 165], 5.00th=[ 184], 10.00th=[ 192], 20.00th=[ 200], 00:16:15.270 | 30.00th=[ 206], 40.00th=[ 210], 50.00th=[ 215], 60.00th=[ 221], 00:16:15.270 | 70.00th=[ 227], 80.00th=[ 235], 90.00th=[ 253], 95.00th=[ 273], 00:16:15.270 | 99.00th=[ 322], 99.50th=[ 343], 99.90th=[ 408], 99.95th=[ 412], 00:16:15.270 | 99.99th=[ 412] 00:16:15.270 bw ( KiB/s): min= 8192, max= 8192, per=34.04%, avg=8192.00, stdev= 0.00, samples=1 00:16:15.270 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:15.270 lat (usec) : 250=46.81%, 500=49.45%, 750=3.55%, 1000=0.13% 00:16:15.270 lat (msec) : 2=0.06% 00:16:15.270 cpu : usr=2.70%, sys=7.20%, ctx=3156, majf=0, minf=1 00:16:15.270 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:15.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.270 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.270 issued rwts: total=1536,1619,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:15.270 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:15.270 00:16:15.270 Run status group 0 (all jobs): 00:16:15.270 READ: bw=18.5MiB/s (19.4MB/s), 2048KiB/s-6258KiB/s (2097kB/s-6408kB/s), io=19.2MiB (20.1MB), run=1001-1035msec 00:16:15.270 WRITE: bw=23.5MiB/s (24.6MB/s), 3957KiB/s-8184KiB/s (4052kB/s-8380kB/s), io=24.3MiB (25.5MB), run=1001-1035msec 00:16:15.270 00:16:15.270 Disk stats (read/write): 00:16:15.270 nvme0n1: ios=549/1024, merge=0/0, ticks=1568/219, in_queue=1787, util=99.30% 00:16:15.270 nvme0n2: ios=1541/1536, merge=0/0, ticks=447/338, in_queue=785, util=87.79% 00:16:15.270 nvme0n3: ios=1070/1389, merge=0/0, ticks=885/314, in_queue=1199, util=100.00% 00:16:15.270 nvme0n4: ios=1261/1536, merge=0/0, ticks=1387/327, in_queue=1714, util=97.26% 00:16:15.270 15:40:06 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:15.270 [global] 00:16:15.270 thread=1 00:16:15.270 invalidate=1 00:16:15.270 rw=write 00:16:15.270 time_based=1 00:16:15.270 runtime=1 00:16:15.270 ioengine=libaio 00:16:15.270 direct=1 00:16:15.270 bs=4096 00:16:15.270 iodepth=128 00:16:15.270 norandommap=0 00:16:15.270 numjobs=1 00:16:15.270 00:16:15.270 verify_dump=1 00:16:15.270 verify_backlog=512 00:16:15.270 verify_state_save=0 00:16:15.270 do_verify=1 00:16:15.270 verify=crc32c-intel 00:16:15.270 [job0] 00:16:15.270 filename=/dev/nvme0n1 00:16:15.270 [job1] 00:16:15.270 filename=/dev/nvme0n2 00:16:15.270 [job2] 00:16:15.270 filename=/dev/nvme0n3 00:16:15.270 [job3] 00:16:15.270 filename=/dev/nvme0n4 00:16:15.270 Could not set queue depth (nvme0n1) 00:16:15.270 Could not set queue depth (nvme0n2) 00:16:15.270 Could not set queue depth (nvme0n3) 00:16:15.270 Could not set queue depth (nvme0n4) 00:16:15.528 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:15.528 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:15.528 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:15.528 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:15.528 fio-3.35 00:16:15.528 Starting 4 threads 00:16:16.904 00:16:16.904 job0: (groupid=0, jobs=1): err= 0: pid=874194: Tue Nov 26 15:40:07 2024 00:16:16.904 read: IOPS=4104, BW=16.0MiB/s (16.8MB/s)(16.1MiB/1002msec) 00:16:16.904 slat (usec): min=3, max=21986, avg=125.87, stdev=932.15 00:16:16.904 clat (usec): min=1741, max=146939, avg=13794.26, stdev=15508.89 00:16:16.904 lat (usec): min=1751, max=146957, avg=13920.13, stdev=15666.41 00:16:16.904 clat percentiles (msec): 00:16:16.904 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 9], 00:16:16.904 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11], 00:16:16.904 | 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 25], 95.00th=[ 36], 00:16:16.904 | 99.00th=[ 110], 99.50th=[ 132], 99.90th=[ 148], 99.95th=[ 148], 00:16:16.904 | 99.99th=[ 148] 00:16:16.904 write: IOPS=4598, BW=18.0MiB/s (18.8MB/s)(18.0MiB/1002msec); 0 zone resets 00:16:16.904 slat (usec): min=4, max=13478, avg=90.25, stdev=466.60 00:16:16.904 clat (usec): min=473, max=146957, avg=15200.20, stdev=17571.52 00:16:16.904 lat (usec): min=482, max=146977, avg=15290.46, stdev=17637.81 00:16:16.904 clat percentiles (msec): 00:16:16.904 | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], 00:16:16.904 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11], 00:16:16.904 | 70.00th=[ 11], 80.00th=[ 20], 90.00th=[ 23], 95.00th=[ 44], 00:16:16.904 | 99.00th=[ 123], 99.50th=[ 138], 99.90th=[ 142], 99.95th=[ 142], 00:16:16.904 | 99.99th=[ 148] 00:16:16.904 bw ( KiB/s): min=12288, max=23696, per=30.56%, avg=17992.00, stdev=8066.67, samples=2 00:16:16.904 iops : min= 3072, max= 5924, avg=4498.00, stdev=2016.67, samples=2 00:16:16.904 lat (usec) : 500=0.03%, 1000=0.05% 00:16:16.904 lat (msec) : 2=0.56%, 4=1.31%, 10=51.47%, 20=31.27%, 50=11.78% 00:16:16.904 lat (msec) : 100=2.26%, 250=1.27% 00:16:16.904 cpu : usr=6.19%, sys=12.09%, ctx=412, majf=0, minf=1 00:16:16.904 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:16.904 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.904 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:16.904 issued rwts: total=4113,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:16.904 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:16.904 job1: (groupid=0, jobs=1): err= 0: pid=874195: Tue Nov 26 15:40:07 2024 00:16:16.904 read: IOPS=4047, BW=15.8MiB/s (16.6MB/s)(16.0MiB/1012msec) 00:16:16.904 slat (usec): min=3, max=18270, avg=97.33, stdev=723.56 00:16:16.904 clat (usec): min=5127, max=55427, avg=12188.86, stdev=6659.77 00:16:16.904 lat (usec): min=5135, max=55466, avg=12286.19, stdev=6728.71 00:16:16.904 clat percentiles (usec): 00:16:16.904 | 1.00th=[ 5538], 5.00th=[ 7046], 10.00th=[ 8455], 20.00th=[ 8848], 00:16:16.904 | 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10159], 00:16:16.904 | 70.00th=[11076], 80.00th=[14877], 90.00th=[17171], 95.00th=[26608], 00:16:16.904 | 99.00th=[39060], 99.50th=[43254], 99.90th=[45351], 99.95th=[46924], 00:16:16.904 | 99.99th=[55313] 00:16:16.904 write: IOPS=4354, BW=17.0MiB/s (17.8MB/s)(17.2MiB/1012msec); 0 zone resets 00:16:16.904 slat (usec): min=4, max=47245, avg=123.84, stdev=1030.15 00:16:16.904 clat (usec): min=1530, max=96406, avg=15639.30, stdev=15418.54 00:16:16.904 lat (usec): min=1546, max=96427, avg=15763.14, stdev=15535.00 00:16:16.904 clat percentiles (usec): 00:16:16.904 | 1.00th=[ 5211], 5.00th=[ 6718], 10.00th=[ 8029], 20.00th=[ 8979], 00:16:16.904 | 30.00th=[ 9241], 40.00th=[ 9765], 50.00th=[10683], 60.00th=[11076], 00:16:16.904 | 70.00th=[12387], 80.00th=[13698], 90.00th=[33424], 95.00th=[46400], 00:16:16.904 | 99.00th=[89654], 99.50th=[93848], 99.90th=[95945], 99.95th=[95945], 00:16:16.904 | 99.99th=[95945] 00:16:16.904 bw ( KiB/s): min=11400, max=22840, per=29.08%, avg=17120.00, stdev=8089.30, samples=2 00:16:16.904 iops : min= 2850, max= 5710, avg=4280.00, stdev=2022.33, samples=2 00:16:16.904 lat (msec) : 2=0.02%, 4=0.07%, 10=47.96%, 20=41.20%, 50=8.42% 00:16:16.904 lat (msec) : 100=2.33% 00:16:16.904 cpu : usr=6.63%, sys=10.88%, ctx=365, majf=0, minf=1 00:16:16.904 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:16.904 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.904 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:16.904 issued rwts: total=4096,4407,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:16.905 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:16.905 job2: (groupid=0, jobs=1): err= 0: pid=874196: Tue Nov 26 15:40:07 2024 00:16:16.905 read: IOPS=2509, BW=9.80MiB/s (10.3MB/s)(10.0MiB/1020msec) 00:16:16.905 slat (usec): min=3, max=21927, avg=169.13, stdev=1103.17 00:16:16.905 clat (usec): min=5998, max=75874, avg=19713.73, stdev=13488.14 00:16:16.905 lat (usec): min=6016, max=75891, avg=19882.86, stdev=13570.85 00:16:16.905 clat percentiles (usec): 00:16:16.905 | 1.00th=[ 9503], 5.00th=[10290], 10.00th=[11207], 20.00th=[11469], 00:16:16.905 | 30.00th=[12518], 40.00th=[14353], 50.00th=[14877], 60.00th=[16319], 00:16:16.905 | 70.00th=[18744], 80.00th=[21365], 90.00th=[37487], 95.00th=[55837], 00:16:16.905 | 99.00th=[70779], 99.50th=[73925], 99.90th=[76022], 99.95th=[76022], 00:16:16.905 | 99.99th=[76022] 00:16:16.905 write: IOPS=2664, BW=10.4MiB/s (10.9MB/s)(10.6MiB/1020msec); 0 zone resets 00:16:16.905 slat (usec): min=4, max=14928, avg=195.85, stdev=853.36 00:16:16.905 clat (usec): min=1412, max=81226, avg=29049.78, stdev=14980.59 00:16:16.905 lat (usec): min=1428, max=81247, avg=29245.63, stdev=15058.24 00:16:16.905 clat percentiles (usec): 00:16:16.905 | 1.00th=[ 5014], 5.00th=[ 7439], 10.00th=[11076], 20.00th=[15270], 00:16:16.905 | 30.00th=[21890], 40.00th=[22676], 50.00th=[25822], 60.00th=[29492], 00:16:16.905 | 70.00th=[35390], 80.00th=[43254], 90.00th=[50594], 95.00th=[54264], 00:16:16.905 | 99.00th=[72877], 99.50th=[79168], 99.90th=[81265], 99.95th=[81265], 00:16:16.905 | 99.99th=[81265] 00:16:16.905 bw ( KiB/s): min= 8440, max=12288, per=17.61%, avg=10364.00, stdev=2720.95, samples=2 00:16:16.905 iops : min= 2110, max= 3072, avg=2591.00, stdev=680.24, samples=2 00:16:16.905 lat (msec) : 2=0.06%, 10=5.93%, 20=43.84%, 50=42.02%, 100=8.15% 00:16:16.905 cpu : usr=3.93%, sys=7.46%, ctx=304, majf=0, minf=2 00:16:16.905 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:16:16.905 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.905 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:16.905 issued rwts: total=2560,2718,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:16.905 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:16.905 job3: (groupid=0, jobs=1): err= 0: pid=874197: Tue Nov 26 15:40:07 2024 00:16:16.905 read: IOPS=3011, BW=11.8MiB/s (12.3MB/s)(12.0MiB/1020msec) 00:16:16.905 slat (usec): min=3, max=27894, avg=132.06, stdev=1019.00 00:16:16.905 clat (usec): min=7424, max=43990, avg=16591.66, stdev=7390.89 00:16:16.905 lat (usec): min=7782, max=53683, avg=16723.72, stdev=7481.25 00:16:16.905 clat percentiles (usec): 00:16:16.905 | 1.00th=[ 8586], 5.00th=[ 9896], 10.00th=[10290], 20.00th=[11207], 00:16:16.905 | 30.00th=[11731], 40.00th=[12125], 50.00th=[12911], 60.00th=[16319], 00:16:16.905 | 70.00th=[19530], 80.00th=[22414], 90.00th=[27657], 95.00th=[34866], 00:16:16.905 | 99.00th=[37487], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:16:16.905 | 99.99th=[43779] 00:16:16.905 write: IOPS=3213, BW=12.6MiB/s (13.2MB/s)(12.8MiB/1020msec); 0 zone resets 00:16:16.905 slat (usec): min=4, max=13117, avg=168.25, stdev=882.16 00:16:16.905 clat (usec): min=5678, max=95864, avg=23851.73, stdev=18052.87 00:16:16.905 lat (usec): min=6083, max=95871, avg=24019.97, stdev=18165.33 00:16:16.905 clat percentiles (usec): 00:16:16.905 | 1.00th=[ 7963], 5.00th=[10028], 10.00th=[10290], 20.00th=[10814], 00:16:16.905 | 30.00th=[12125], 40.00th=[12387], 50.00th=[12911], 60.00th=[16057], 00:16:16.905 | 70.00th=[29492], 80.00th=[40109], 90.00th=[50594], 95.00th=[58459], 00:16:16.905 | 99.00th=[84411], 99.50th=[85459], 99.90th=[95945], 99.95th=[95945], 00:16:16.905 | 99.99th=[95945] 00:16:16.905 bw ( KiB/s): min= 8456, max=16752, per=21.41%, avg=12604.00, stdev=5866.16, samples=2 00:16:16.905 iops : min= 2114, max= 4188, avg=3151.00, stdev=1466.54, samples=2 00:16:16.905 lat (msec) : 10=5.86%, 20=62.63%, 50=26.08%, 100=5.43% 00:16:16.905 cpu : usr=3.14%, sys=5.00%, ctx=298, majf=0, minf=1 00:16:16.905 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:16:16.905 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.905 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:16.905 issued rwts: total=3072,3278,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:16.905 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:16.905 00:16:16.905 Run status group 0 (all jobs): 00:16:16.905 READ: bw=53.0MiB/s (55.6MB/s), 9.80MiB/s-16.0MiB/s (10.3MB/s-16.8MB/s), io=54.1MiB (56.7MB), run=1002-1020msec 00:16:16.905 WRITE: bw=57.5MiB/s (60.3MB/s), 10.4MiB/s-18.0MiB/s (10.9MB/s-18.8MB/s), io=58.6MiB (61.5MB), run=1002-1020msec 00:16:16.905 00:16:16.905 Disk stats (read/write): 00:16:16.905 nvme0n1: ios=3199/3584, merge=0/0, ticks=35766/47358, in_queue=83124, util=97.39% 00:16:16.905 nvme0n2: ios=3928/4096, merge=0/0, ticks=26381/25455, in_queue=51836, util=92.69% 00:16:16.905 nvme0n3: ios=2105/2343, merge=0/0, ticks=37354/65788, in_queue=103142, util=91.36% 00:16:16.905 nvme0n4: ios=2617/2903, merge=0/0, ticks=31003/49780, in_queue=80783, util=95.18% 00:16:16.905 15:40:07 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:16.905 [global] 00:16:16.905 thread=1 00:16:16.905 invalidate=1 00:16:16.905 rw=randwrite 00:16:16.905 time_based=1 00:16:16.905 runtime=1 00:16:16.905 ioengine=libaio 00:16:16.905 direct=1 00:16:16.905 bs=4096 00:16:16.905 iodepth=128 00:16:16.905 norandommap=0 00:16:16.905 numjobs=1 00:16:16.905 00:16:16.905 verify_dump=1 00:16:16.905 verify_backlog=512 00:16:16.905 verify_state_save=0 00:16:16.905 do_verify=1 00:16:16.905 verify=crc32c-intel 00:16:16.905 [job0] 00:16:16.905 filename=/dev/nvme0n1 00:16:16.905 [job1] 00:16:16.905 filename=/dev/nvme0n2 00:16:16.905 [job2] 00:16:16.905 filename=/dev/nvme0n3 00:16:16.905 [job3] 00:16:16.905 filename=/dev/nvme0n4 00:16:16.905 Could not set queue depth (nvme0n1) 00:16:16.905 Could not set queue depth (nvme0n2) 00:16:16.905 Could not set queue depth (nvme0n3) 00:16:16.905 Could not set queue depth (nvme0n4) 00:16:16.905 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:16.905 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:16.905 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:16.905 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:16.905 fio-3.35 00:16:16.905 Starting 4 threads 00:16:18.281 00:16:18.281 job0: (groupid=0, jobs=1): err= 0: pid=874416: Tue Nov 26 15:40:09 2024 00:16:18.281 read: IOPS=3559, BW=13.9MiB/s (14.6MB/s)(14.5MiB/1043msec) 00:16:18.281 slat (usec): min=2, max=25965, avg=132.26, stdev=899.22 00:16:18.281 clat (usec): min=4002, max=60000, avg=17550.48, stdev=11594.84 00:16:18.282 lat (usec): min=4010, max=60013, avg=17682.73, stdev=11650.09 00:16:18.282 clat percentiles (usec): 00:16:18.282 | 1.00th=[ 6521], 5.00th=[ 7504], 10.00th=[ 7701], 20.00th=[ 9503], 00:16:18.282 | 30.00th=[10421], 40.00th=[10552], 50.00th=[11994], 60.00th=[15533], 00:16:18.282 | 70.00th=[20317], 80.00th=[26870], 90.00th=[32113], 95.00th=[47449], 00:16:18.282 | 99.00th=[56886], 99.50th=[56886], 99.90th=[56886], 99.95th=[60031], 00:16:18.282 | 99.99th=[60031] 00:16:18.282 write: IOPS=3927, BW=15.3MiB/s (16.1MB/s)(16.0MiB/1043msec); 0 zone resets 00:16:18.282 slat (usec): min=3, max=17033, avg=108.90, stdev=598.82 00:16:18.282 clat (usec): min=637, max=73229, avg=16409.14, stdev=11513.41 00:16:18.282 lat (usec): min=709, max=73239, avg=16518.05, stdev=11576.04 00:16:18.282 clat percentiles (usec): 00:16:18.282 | 1.00th=[ 2540], 5.00th=[ 5735], 10.00th=[ 6980], 20.00th=[ 9896], 00:16:18.282 | 30.00th=[10421], 40.00th=[10945], 50.00th=[12649], 60.00th=[13698], 00:16:18.282 | 70.00th=[18220], 80.00th=[22676], 90.00th=[28181], 95.00th=[40633], 00:16:18.282 | 99.00th=[67634], 99.50th=[69731], 99.90th=[72877], 99.95th=[72877], 00:16:18.282 | 99.99th=[72877] 00:16:18.282 bw ( KiB/s): min=16384, max=16384, per=25.98%, avg=16384.00, stdev= 0.00, samples=2 00:16:18.282 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=2 00:16:18.282 lat (usec) : 750=0.01% 00:16:18.282 lat (msec) : 2=0.13%, 4=0.90%, 10=23.22%, 20=47.48%, 50=25.89% 00:16:18.282 lat (msec) : 100=2.37% 00:16:18.282 cpu : usr=3.65%, sys=8.45%, ctx=435, majf=0, minf=1 00:16:18.282 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:18.282 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:18.282 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:18.282 issued rwts: total=3713,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:18.282 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:18.282 job1: (groupid=0, jobs=1): err= 0: pid=874417: Tue Nov 26 15:40:09 2024 00:16:18.282 read: IOPS=4594, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1003msec) 00:16:18.282 slat (usec): min=2, max=14458, avg=95.55, stdev=648.80 00:16:18.282 clat (usec): min=1972, max=55152, avg=12875.37, stdev=7013.56 00:16:18.282 lat (usec): min=1980, max=56029, avg=12970.93, stdev=7048.99 00:16:18.282 clat percentiles (usec): 00:16:18.282 | 1.00th=[ 4047], 5.00th=[ 5866], 10.00th=[ 8356], 20.00th=[10028], 00:16:18.282 | 30.00th=[10421], 40.00th=[10683], 50.00th=[11207], 60.00th=[12387], 00:16:18.282 | 70.00th=[12911], 80.00th=[13566], 90.00th=[17171], 95.00th=[19530], 00:16:18.282 | 99.00th=[52691], 99.50th=[54789], 99.90th=[55313], 99.95th=[55313], 00:16:18.282 | 99.99th=[55313] 00:16:18.282 write: IOPS=4653, BW=18.2MiB/s (19.1MB/s)(18.2MiB/1003msec); 0 zone resets 00:16:18.282 slat (usec): min=2, max=26227, avg=108.03, stdev=883.18 00:16:18.282 clat (usec): min=966, max=52590, avg=14307.06, stdev=9265.10 00:16:18.282 lat (usec): min=974, max=52596, avg=14415.08, stdev=9326.89 00:16:18.282 clat percentiles (usec): 00:16:18.282 | 1.00th=[ 4293], 5.00th=[ 5080], 10.00th=[ 7046], 20.00th=[ 8979], 00:16:18.282 | 30.00th=[10290], 40.00th=[10683], 50.00th=[11207], 60.00th=[11731], 00:16:18.282 | 70.00th=[13304], 80.00th=[14746], 90.00th=[31589], 95.00th=[35914], 00:16:18.282 | 99.00th=[44303], 99.50th=[51643], 99.90th=[52691], 99.95th=[52691], 00:16:18.282 | 99.99th=[52691] 00:16:18.282 bw ( KiB/s): min=16384, max=20480, per=29.23%, avg=18432.00, stdev=2896.31, samples=2 00:16:18.282 iops : min= 4096, max= 5120, avg=4608.00, stdev=724.08, samples=2 00:16:18.282 lat (usec) : 1000=0.05% 00:16:18.282 lat (msec) : 2=0.10%, 4=0.40%, 10=23.25%, 20=65.52%, 50=9.56% 00:16:18.282 lat (msec) : 100=1.12% 00:16:18.282 cpu : usr=6.59%, sys=8.68%, ctx=324, majf=0, minf=1 00:16:18.282 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:18.282 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:18.282 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:18.282 issued rwts: total=4608,4667,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:18.282 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:18.282 job2: (groupid=0, jobs=1): err= 0: pid=874422: Tue Nov 26 15:40:09 2024 00:16:18.282 read: IOPS=4031, BW=15.7MiB/s (16.5MB/s)(15.8MiB/1002msec) 00:16:18.282 slat (usec): min=2, max=23004, avg=121.49, stdev=909.42 00:16:18.282 clat (usec): min=1017, max=75322, avg=15762.07, stdev=6399.18 00:16:18.282 lat (usec): min=1026, max=75330, avg=15883.56, stdev=6442.65 00:16:18.282 clat percentiles (usec): 00:16:18.282 | 1.00th=[ 6194], 5.00th=[ 7963], 10.00th=[10028], 20.00th=[11469], 00:16:18.282 | 30.00th=[12125], 40.00th=[13173], 50.00th=[13960], 60.00th=[15008], 00:16:18.282 | 70.00th=[16319], 80.00th=[19792], 90.00th=[24773], 95.00th=[30278], 00:16:18.282 | 99.00th=[35914], 99.50th=[36439], 99.90th=[36439], 99.95th=[48497], 00:16:18.282 | 99.99th=[74974] 00:16:18.282 write: IOPS=4087, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1002msec); 0 zone resets 00:16:18.282 slat (usec): min=3, max=17657, avg=100.77, stdev=772.87 00:16:18.282 clat (usec): min=671, max=52803, avg=15472.55, stdev=6730.50 00:16:18.282 lat (usec): min=676, max=52808, avg=15573.31, stdev=6775.00 00:16:18.282 clat percentiles (usec): 00:16:18.282 | 1.00th=[ 1352], 5.00th=[ 7439], 10.00th=[ 8455], 20.00th=[11076], 00:16:18.282 | 30.00th=[11731], 40.00th=[12518], 50.00th=[13435], 60.00th=[15270], 00:16:18.282 | 70.00th=[17433], 80.00th=[19792], 90.00th=[24511], 95.00th=[28443], 00:16:18.282 | 99.00th=[35914], 99.50th=[45876], 99.90th=[52691], 99.95th=[52691], 00:16:18.282 | 99.99th=[52691] 00:16:18.282 bw ( KiB/s): min=15680, max=15680, per=24.87%, avg=15680.00, stdev= 0.00, samples=1 00:16:18.282 iops : min= 3920, max= 3920, avg=3920.00, stdev= 0.00, samples=1 00:16:18.282 lat (usec) : 750=0.04%, 1000=0.01% 00:16:18.282 lat (msec) : 2=0.57%, 4=0.10%, 10=10.94%, 20=69.41%, 50=18.82% 00:16:18.282 lat (msec) : 100=0.12% 00:16:18.282 cpu : usr=3.20%, sys=5.19%, ctx=340, majf=0, minf=2 00:16:18.282 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:18.282 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:18.282 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:18.282 issued rwts: total=4040,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:18.282 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:18.282 job3: (groupid=0, jobs=1): err= 0: pid=874423: Tue Nov 26 15:40:09 2024 00:16:18.282 read: IOPS=3374, BW=13.2MiB/s (13.8MB/s)(13.2MiB/1003msec) 00:16:18.282 slat (usec): min=2, max=14240, avg=130.26, stdev=909.47 00:16:18.282 clat (usec): min=656, max=63104, avg=17584.24, stdev=7553.06 00:16:18.282 lat (usec): min=7020, max=63125, avg=17714.49, stdev=7597.96 00:16:18.282 clat percentiles (usec): 00:16:18.282 | 1.00th=[ 8291], 5.00th=[10028], 10.00th=[11338], 20.00th=[11994], 00:16:18.282 | 30.00th=[12649], 40.00th=[14615], 50.00th=[16057], 60.00th=[17957], 00:16:18.282 | 70.00th=[19530], 80.00th=[21365], 90.00th=[25297], 95.00th=[27919], 00:16:18.282 | 99.00th=[52167], 99.50th=[55837], 99.90th=[59507], 99.95th=[59507], 00:16:18.282 | 99.99th=[63177] 00:16:18.282 write: IOPS=3573, BW=14.0MiB/s (14.6MB/s)(14.0MiB/1003msec); 0 zone resets 00:16:18.282 slat (usec): min=3, max=19368, avg=144.46, stdev=955.08 00:16:18.282 clat (usec): min=7634, max=63010, avg=18853.75, stdev=8714.70 00:16:18.282 lat (usec): min=7644, max=63580, avg=18998.22, stdev=8766.58 00:16:18.282 clat percentiles (usec): 00:16:18.282 | 1.00th=[ 7963], 5.00th=[11207], 10.00th=[11863], 20.00th=[12649], 00:16:18.282 | 30.00th=[15139], 40.00th=[16057], 50.00th=[16909], 60.00th=[18220], 00:16:18.282 | 70.00th=[20055], 80.00th=[21103], 90.00th=[26346], 95.00th=[34866], 00:16:18.282 | 99.00th=[60031], 99.50th=[61604], 99.90th=[63177], 99.95th=[63177], 00:16:18.282 | 99.99th=[63177] 00:16:18.282 bw ( KiB/s): min=14008, max=14664, per=22.73%, avg=14336.00, stdev=463.86, samples=2 00:16:18.282 iops : min= 3502, max= 3666, avg=3584.00, stdev=115.97, samples=2 00:16:18.282 lat (usec) : 750=0.01% 00:16:18.282 lat (msec) : 10=3.87%, 20=69.18%, 50=25.14%, 100=1.79% 00:16:18.282 cpu : usr=4.19%, sys=5.39%, ctx=295, majf=0, minf=1 00:16:18.282 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:18.282 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:18.282 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:18.282 issued rwts: total=3385,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:18.282 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:18.282 00:16:18.282 Run status group 0 (all jobs): 00:16:18.282 READ: bw=59.0MiB/s (61.8MB/s), 13.2MiB/s-17.9MiB/s (13.8MB/s-18.8MB/s), io=61.5MiB (64.5MB), run=1002-1043msec 00:16:18.282 WRITE: bw=61.6MiB/s (64.6MB/s), 14.0MiB/s-18.2MiB/s (14.6MB/s-19.1MB/s), io=64.2MiB (67.3MB), run=1002-1043msec 00:16:18.282 00:16:18.282 Disk stats (read/write): 00:16:18.282 nvme0n1: ios=3112/3263, merge=0/0, ticks=30739/36853, in_queue=67592, util=97.29% 00:16:18.282 nvme0n2: ios=3764/4096, merge=0/0, ticks=22698/29952, in_queue=52650, util=84.97% 00:16:18.282 nvme0n3: ios=3467/3584, merge=0/0, ticks=32784/41402, in_queue=74186, util=96.77% 00:16:18.282 nvme0n4: ios=2760/3072, merge=0/0, ticks=25720/33775, in_queue=59495, util=97.58% 00:16:18.282 15:40:09 -- target/fio.sh@55 -- # sync 00:16:18.282 15:40:09 -- target/fio.sh@59 -- # fio_pid=874555 00:16:18.282 15:40:09 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:18.282 15:40:09 -- target/fio.sh@61 -- # sleep 3 00:16:18.282 [global] 00:16:18.282 thread=1 00:16:18.282 invalidate=1 00:16:18.282 rw=read 00:16:18.282 time_based=1 00:16:18.282 runtime=10 00:16:18.282 ioengine=libaio 00:16:18.282 direct=1 00:16:18.282 bs=4096 00:16:18.282 iodepth=1 00:16:18.282 norandommap=1 00:16:18.282 numjobs=1 00:16:18.282 00:16:18.282 [job0] 00:16:18.282 filename=/dev/nvme0n1 00:16:18.282 [job1] 00:16:18.282 filename=/dev/nvme0n2 00:16:18.282 [job2] 00:16:18.282 filename=/dev/nvme0n3 00:16:18.282 [job3] 00:16:18.282 filename=/dev/nvme0n4 00:16:18.282 Could not set queue depth (nvme0n1) 00:16:18.282 Could not set queue depth (nvme0n2) 00:16:18.282 Could not set queue depth (nvme0n3) 00:16:18.282 Could not set queue depth (nvme0n4) 00:16:18.282 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:18.282 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:18.282 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:18.282 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:18.282 fio-3.35 00:16:18.282 Starting 4 threads 00:16:21.568 15:40:12 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:21.568 15:40:12 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:21.568 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=8888320, buflen=4096 00:16:21.568 fio: pid=874750, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:21.568 15:40:12 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:21.568 15:40:12 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:21.568 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=589824, buflen=4096 00:16:21.568 fio: pid=874737, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:22.135 15:40:13 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:22.135 15:40:13 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:22.135 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=54296576, buflen=4096 00:16:22.135 fio: pid=874684, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:22.135 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=15949824, buflen=4096 00:16:22.135 15:40:13 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:22.135 fio: pid=874704, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:22.135 15:40:13 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:22.393 00:16:22.393 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=874684: Tue Nov 26 15:40:13 2024 00:16:22.393 read: IOPS=3860, BW=15.1MiB/s (15.8MB/s)(51.8MiB/3434msec) 00:16:22.393 slat (usec): min=4, max=7696, avg= 9.04, stdev=94.33 00:16:22.393 clat (usec): min=193, max=1697, avg=245.71, stdev=35.82 00:16:22.393 lat (usec): min=199, max=8057, avg=254.74, stdev=101.91 00:16:22.393 clat percentiles (usec): 00:16:22.393 | 1.00th=[ 208], 5.00th=[ 217], 10.00th=[ 221], 20.00th=[ 229], 00:16:22.393 | 30.00th=[ 235], 40.00th=[ 239], 50.00th=[ 243], 60.00th=[ 247], 00:16:22.393 | 70.00th=[ 251], 80.00th=[ 255], 90.00th=[ 265], 95.00th=[ 281], 00:16:22.393 | 99.00th=[ 347], 99.50th=[ 461], 99.90th=[ 603], 99.95th=[ 701], 00:16:22.393 | 99.99th=[ 1614] 00:16:22.393 bw ( KiB/s): min=15056, max=16384, per=74.94%, avg=15769.33, stdev=502.96, samples=6 00:16:22.393 iops : min= 3764, max= 4096, avg=3942.33, stdev=125.74, samples=6 00:16:22.393 lat (usec) : 250=67.67%, 500=31.99%, 750=0.29%, 1000=0.02% 00:16:22.393 lat (msec) : 2=0.02% 00:16:22.393 cpu : usr=1.86%, sys=4.14%, ctx=13260, majf=0, minf=1 00:16:22.393 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:22.393 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.393 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.393 issued rwts: total=13257,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:22.393 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:22.393 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=874704: Tue Nov 26 15:40:13 2024 00:16:22.393 read: IOPS=1052, BW=4210KiB/s (4311kB/s)(15.2MiB/3700msec) 00:16:22.393 slat (usec): min=4, max=10675, avg=19.21, stdev=264.04 00:16:22.393 clat (usec): min=201, max=42148, avg=920.52, stdev=4949.81 00:16:22.393 lat (usec): min=214, max=50003, avg=939.72, stdev=4974.40 00:16:22.393 clat percentiles (usec): 00:16:22.393 | 1.00th=[ 227], 5.00th=[ 237], 10.00th=[ 243], 20.00th=[ 251], 00:16:22.393 | 30.00th=[ 260], 40.00th=[ 269], 50.00th=[ 277], 60.00th=[ 293], 00:16:22.393 | 70.00th=[ 326], 80.00th=[ 379], 90.00th=[ 461], 95.00th=[ 486], 00:16:22.393 | 99.00th=[41157], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:16:22.393 | 99.99th=[42206] 00:16:22.393 bw ( KiB/s): min= 96, max= 9496, per=20.29%, avg=4270.14, stdev=3349.06, samples=7 00:16:22.393 iops : min= 24, max= 2374, avg=1067.43, stdev=837.18, samples=7 00:16:22.393 lat (usec) : 250=18.66%, 500=78.02%, 750=1.67%, 1000=0.05% 00:16:22.393 lat (msec) : 4=0.05%, 20=0.03%, 50=1.49% 00:16:22.393 cpu : usr=0.65%, sys=1.51%, ctx=3899, majf=0, minf=1 00:16:22.393 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:22.393 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.393 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.393 issued rwts: total=3895,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:22.393 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:22.393 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=874737: Tue Nov 26 15:40:13 2024 00:16:22.393 read: IOPS=45, BW=182KiB/s (186kB/s)(576KiB/3164msec) 00:16:22.393 slat (nsec): min=6215, max=35938, avg=17166.57, stdev=9390.07 00:16:22.393 clat (usec): min=287, max=41447, avg=21789.72, stdev=20363.35 00:16:22.393 lat (usec): min=296, max=41465, avg=21806.91, stdev=20368.52 00:16:22.393 clat percentiles (usec): 00:16:22.393 | 1.00th=[ 289], 5.00th=[ 297], 10.00th=[ 302], 20.00th=[ 314], 00:16:22.393 | 30.00th=[ 355], 40.00th=[ 371], 50.00th=[40633], 60.00th=[41157], 00:16:22.393 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:22.393 | 99.00th=[41157], 99.50th=[41681], 99.90th=[41681], 99.95th=[41681], 00:16:22.393 | 99.99th=[41681] 00:16:22.394 bw ( KiB/s): min= 96, max= 464, per=0.88%, avg=186.67, stdev=149.64, samples=6 00:16:22.394 iops : min= 24, max= 116, avg=46.67, stdev=37.41, samples=6 00:16:22.394 lat (usec) : 500=46.90% 00:16:22.394 lat (msec) : 50=52.41% 00:16:22.394 cpu : usr=0.13%, sys=0.00%, ctx=147, majf=0, minf=1 00:16:22.394 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:22.394 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.394 complete : 0=0.7%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.394 issued rwts: total=145,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:22.394 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:22.394 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=874750: Tue Nov 26 15:40:13 2024 00:16:22.394 read: IOPS=749, BW=2997KiB/s (3069kB/s)(8680KiB/2896msec) 00:16:22.394 slat (nsec): min=4152, max=63842, avg=14878.59, stdev=8693.23 00:16:22.394 clat (usec): min=220, max=42384, avg=1305.11, stdev=6283.25 00:16:22.394 lat (usec): min=235, max=42401, avg=1319.99, stdev=6284.50 00:16:22.394 clat percentiles (usec): 00:16:22.394 | 1.00th=[ 239], 5.00th=[ 251], 10.00th=[ 258], 20.00th=[ 265], 00:16:22.394 | 30.00th=[ 273], 40.00th=[ 281], 50.00th=[ 293], 60.00th=[ 314], 00:16:22.394 | 70.00th=[ 343], 80.00th=[ 375], 90.00th=[ 388], 95.00th=[ 433], 00:16:22.394 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41681], 00:16:22.394 | 99.99th=[42206] 00:16:22.394 bw ( KiB/s): min= 96, max=10320, per=16.43%, avg=3457.60, stdev=4776.83, samples=5 00:16:22.394 iops : min= 24, max= 2580, avg=864.40, stdev=1194.21, samples=5 00:16:22.394 lat (usec) : 250=4.38%, 500=92.86%, 750=0.18% 00:16:22.394 lat (msec) : 2=0.09%, 50=2.44% 00:16:22.394 cpu : usr=0.76%, sys=1.00%, ctx=2172, majf=0, minf=1 00:16:22.394 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:22.394 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.394 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.394 issued rwts: total=2171,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:22.394 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:22.394 00:16:22.394 Run status group 0 (all jobs): 00:16:22.394 READ: bw=20.5MiB/s (21.5MB/s), 182KiB/s-15.1MiB/s (186kB/s-15.8MB/s), io=76.0MiB (79.7MB), run=2896-3700msec 00:16:22.394 00:16:22.394 Disk stats (read/write): 00:16:22.394 nvme0n1: ios=13087/0, merge=0/0, ticks=3570/0, in_queue=3570, util=99.17% 00:16:22.394 nvme0n2: ios=3892/0, merge=0/0, ticks=3434/0, in_queue=3434, util=95.77% 00:16:22.394 nvme0n3: ios=196/0, merge=0/0, ticks=3585/0, in_queue=3585, util=99.72% 00:16:22.394 nvme0n4: ios=2220/0, merge=0/0, ticks=3832/0, in_queue=3832, util=99.46% 00:16:22.394 15:40:13 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:22.394 15:40:13 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:22.652 15:40:14 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:22.652 15:40:14 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:22.910 15:40:14 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:22.910 15:40:14 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:23.168 15:40:14 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:23.168 15:40:14 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:23.426 15:40:14 -- target/fio.sh@69 -- # fio_status=0 00:16:23.426 15:40:14 -- target/fio.sh@70 -- # wait 874555 00:16:23.426 15:40:14 -- target/fio.sh@70 -- # fio_status=4 00:16:23.426 15:40:14 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:23.684 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:23.684 15:40:14 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:23.684 15:40:14 -- common/autotest_common.sh@1208 -- # local i=0 00:16:23.684 15:40:15 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:23.684 15:40:15 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:23.684 15:40:15 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:23.684 15:40:15 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:23.684 15:40:15 -- common/autotest_common.sh@1220 -- # return 0 00:16:23.684 15:40:15 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:23.684 15:40:15 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:23.684 nvmf hotplug test: fio failed as expected 00:16:23.684 15:40:15 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:23.942 15:40:15 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:23.942 15:40:15 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:23.942 15:40:15 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:23.942 15:40:15 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:23.942 15:40:15 -- target/fio.sh@91 -- # nvmftestfini 00:16:23.942 15:40:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:23.942 15:40:15 -- nvmf/common.sh@116 -- # sync 00:16:23.942 15:40:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:23.942 15:40:15 -- nvmf/common.sh@119 -- # set +e 00:16:23.942 15:40:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:23.942 15:40:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:23.942 rmmod nvme_tcp 00:16:23.942 rmmod nvme_fabrics 00:16:23.942 rmmod nvme_keyring 00:16:23.942 15:40:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:23.942 15:40:15 -- nvmf/common.sh@123 -- # set -e 00:16:23.942 15:40:15 -- nvmf/common.sh@124 -- # return 0 00:16:23.942 15:40:15 -- nvmf/common.sh@477 -- # '[' -n 872555 ']' 00:16:23.942 15:40:15 -- nvmf/common.sh@478 -- # killprocess 872555 00:16:23.942 15:40:15 -- common/autotest_common.sh@936 -- # '[' -z 872555 ']' 00:16:23.942 15:40:15 -- common/autotest_common.sh@940 -- # kill -0 872555 00:16:23.942 15:40:15 -- common/autotest_common.sh@941 -- # uname 00:16:23.942 15:40:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:23.942 15:40:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 872555 00:16:23.942 15:40:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:23.942 15:40:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:23.942 15:40:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 872555' 00:16:23.942 killing process with pid 872555 00:16:23.942 15:40:15 -- common/autotest_common.sh@955 -- # kill 872555 00:16:23.942 15:40:15 -- common/autotest_common.sh@960 -- # wait 872555 00:16:24.200 15:40:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:24.200 15:40:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:24.200 15:40:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:24.200 15:40:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:24.200 15:40:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:24.200 15:40:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:24.200 15:40:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:24.200 15:40:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:26.730 15:40:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:26.730 00:16:26.730 real 0m24.299s 00:16:26.730 user 1m24.705s 00:16:26.730 sys 0m7.125s 00:16:26.730 15:40:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:26.730 15:40:17 -- common/autotest_common.sh@10 -- # set +x 00:16:26.730 ************************************ 00:16:26.730 END TEST nvmf_fio_target 00:16:26.730 ************************************ 00:16:26.730 15:40:17 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:26.730 15:40:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:26.730 15:40:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:26.730 15:40:17 -- common/autotest_common.sh@10 -- # set +x 00:16:26.730 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:16:26.730 ************************************ 00:16:26.730 START TEST nvmf_bdevio 00:16:26.730 ************************************ 00:16:26.730 15:40:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:26.730 * Looking for test storage... 00:16:26.730 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:26.730 15:40:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:26.730 15:40:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:26.730 15:40:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:26.730 15:40:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:26.730 15:40:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:26.730 15:40:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:26.730 15:40:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:26.730 15:40:17 -- scripts/common.sh@335 -- # IFS=.-: 00:16:26.730 15:40:17 -- scripts/common.sh@335 -- # read -ra ver1 00:16:26.730 15:40:17 -- scripts/common.sh@336 -- # IFS=.-: 00:16:26.730 15:40:17 -- scripts/common.sh@336 -- # read -ra ver2 00:16:26.730 15:40:17 -- scripts/common.sh@337 -- # local 'op=<' 00:16:26.730 15:40:17 -- scripts/common.sh@339 -- # ver1_l=2 00:16:26.730 15:40:17 -- scripts/common.sh@340 -- # ver2_l=1 00:16:26.730 15:40:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:26.730 15:40:17 -- scripts/common.sh@343 -- # case "$op" in 00:16:26.730 15:40:17 -- scripts/common.sh@344 -- # : 1 00:16:26.730 15:40:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:26.730 15:40:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:26.730 15:40:17 -- scripts/common.sh@364 -- # decimal 1 00:16:26.730 15:40:17 -- scripts/common.sh@352 -- # local d=1 00:16:26.730 15:40:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:26.730 15:40:17 -- scripts/common.sh@354 -- # echo 1 00:16:26.730 15:40:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:26.730 15:40:17 -- scripts/common.sh@365 -- # decimal 2 00:16:26.730 15:40:17 -- scripts/common.sh@352 -- # local d=2 00:16:26.730 15:40:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:26.730 15:40:17 -- scripts/common.sh@354 -- # echo 2 00:16:26.730 15:40:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:26.730 15:40:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:26.730 15:40:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:26.730 15:40:17 -- scripts/common.sh@367 -- # return 0 00:16:26.730 15:40:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:26.730 15:40:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:26.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:26.730 --rc genhtml_branch_coverage=1 00:16:26.730 --rc genhtml_function_coverage=1 00:16:26.730 --rc genhtml_legend=1 00:16:26.730 --rc geninfo_all_blocks=1 00:16:26.730 --rc geninfo_unexecuted_blocks=1 00:16:26.730 00:16:26.730 ' 00:16:26.730 15:40:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:26.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:26.730 --rc genhtml_branch_coverage=1 00:16:26.730 --rc genhtml_function_coverage=1 00:16:26.730 --rc genhtml_legend=1 00:16:26.730 --rc geninfo_all_blocks=1 00:16:26.730 --rc geninfo_unexecuted_blocks=1 00:16:26.730 00:16:26.730 ' 00:16:26.730 15:40:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:26.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:26.730 --rc genhtml_branch_coverage=1 00:16:26.730 --rc genhtml_function_coverage=1 00:16:26.730 --rc genhtml_legend=1 00:16:26.731 --rc geninfo_all_blocks=1 00:16:26.731 --rc geninfo_unexecuted_blocks=1 00:16:26.731 00:16:26.731 ' 00:16:26.731 15:40:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:26.731 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:26.731 --rc genhtml_branch_coverage=1 00:16:26.731 --rc genhtml_function_coverage=1 00:16:26.731 --rc genhtml_legend=1 00:16:26.731 --rc geninfo_all_blocks=1 00:16:26.731 --rc geninfo_unexecuted_blocks=1 00:16:26.731 00:16:26.731 ' 00:16:26.731 15:40:17 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:26.731 15:40:17 -- nvmf/common.sh@7 -- # uname -s 00:16:26.731 15:40:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:26.731 15:40:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:26.731 15:40:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:26.731 15:40:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:26.731 15:40:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:26.731 15:40:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:26.731 15:40:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:26.731 15:40:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:26.731 15:40:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:26.731 15:40:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:26.731 15:40:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:26.731 15:40:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:26.731 15:40:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:26.731 15:40:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:26.731 15:40:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:26.731 15:40:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:26.731 15:40:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:26.731 15:40:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:26.731 15:40:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:26.731 15:40:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.731 15:40:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.731 15:40:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.731 15:40:17 -- paths/export.sh@5 -- # export PATH 00:16:26.731 15:40:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.731 15:40:17 -- nvmf/common.sh@46 -- # : 0 00:16:26.731 15:40:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:26.731 15:40:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:26.731 15:40:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:26.731 15:40:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:26.731 15:40:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:26.731 15:40:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:26.731 15:40:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:26.731 15:40:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:26.731 15:40:17 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:26.731 15:40:17 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:26.731 15:40:17 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:26.731 15:40:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:26.731 15:40:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:26.731 15:40:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:26.731 15:40:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:26.731 15:40:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:26.731 15:40:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:26.731 15:40:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:26.731 15:40:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:26.731 15:40:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:26.731 15:40:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:26.731 15:40:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:26.731 15:40:17 -- common/autotest_common.sh@10 -- # set +x 00:16:28.633 15:40:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:28.633 15:40:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:28.633 15:40:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:28.633 15:40:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:28.633 15:40:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:28.633 15:40:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:28.633 15:40:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:28.633 15:40:19 -- nvmf/common.sh@294 -- # net_devs=() 00:16:28.633 15:40:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:28.633 15:40:19 -- nvmf/common.sh@295 -- # e810=() 00:16:28.633 15:40:19 -- nvmf/common.sh@295 -- # local -ga e810 00:16:28.633 15:40:19 -- nvmf/common.sh@296 -- # x722=() 00:16:28.633 15:40:19 -- nvmf/common.sh@296 -- # local -ga x722 00:16:28.633 15:40:19 -- nvmf/common.sh@297 -- # mlx=() 00:16:28.633 15:40:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:28.633 15:40:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:28.633 15:40:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:28.634 15:40:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:28.634 15:40:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:28.634 15:40:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:28.634 15:40:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:28.634 15:40:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:28.634 15:40:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:28.634 15:40:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:28.634 15:40:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:28.634 15:40:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:28.634 15:40:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:28.634 15:40:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:28.634 15:40:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:28.634 15:40:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:28.634 15:40:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:28.634 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:28.634 15:40:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:28.634 15:40:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:28.634 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:28.634 15:40:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:28.634 15:40:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:28.634 15:40:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:28.634 15:40:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:28.634 15:40:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:28.634 15:40:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:28.634 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:28.634 15:40:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:28.634 15:40:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:28.634 15:40:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:28.634 15:40:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:28.634 15:40:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:28.634 15:40:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:28.634 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:28.634 15:40:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:28.634 15:40:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:28.634 15:40:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:28.634 15:40:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:28.634 15:40:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:28.634 15:40:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:28.634 15:40:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:28.634 15:40:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:28.634 15:40:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:28.634 15:40:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:28.634 15:40:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:28.634 15:40:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:28.634 15:40:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:28.634 15:40:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:28.634 15:40:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:28.634 15:40:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:28.634 15:40:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:28.634 15:40:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:28.634 15:40:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:28.634 15:40:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:28.634 15:40:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:28.634 15:40:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:28.634 15:40:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:28.634 15:40:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:28.634 15:40:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:28.634 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:28.634 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.356 ms 00:16:28.634 00:16:28.634 --- 10.0.0.2 ping statistics --- 00:16:28.634 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:28.634 rtt min/avg/max/mdev = 0.356/0.356/0.356/0.000 ms 00:16:28.634 15:40:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:28.634 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:28.634 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.183 ms 00:16:28.634 00:16:28.634 --- 10.0.0.1 ping statistics --- 00:16:28.634 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:28.634 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:16:28.634 15:40:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:28.634 15:40:20 -- nvmf/common.sh@410 -- # return 0 00:16:28.634 15:40:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:28.634 15:40:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:28.634 15:40:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:28.634 15:40:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:28.634 15:40:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:28.634 15:40:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:28.634 15:40:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:28.893 15:40:20 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:28.893 15:40:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:28.893 15:40:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:28.893 15:40:20 -- common/autotest_common.sh@10 -- # set +x 00:16:28.893 15:40:20 -- nvmf/common.sh@469 -- # nvmfpid=877363 00:16:28.893 15:40:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:28.893 15:40:20 -- nvmf/common.sh@470 -- # waitforlisten 877363 00:16:28.893 15:40:20 -- common/autotest_common.sh@829 -- # '[' -z 877363 ']' 00:16:28.893 15:40:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:28.893 15:40:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:28.893 15:40:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:28.893 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:28.893 15:40:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:28.893 15:40:20 -- common/autotest_common.sh@10 -- # set +x 00:16:28.893 [2024-11-26 15:40:20.147796] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:28.893 [2024-11-26 15:40:20.147867] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:28.893 EAL: No free 2048 kB hugepages reported on node 1 00:16:28.893 [2024-11-26 15:40:20.223386] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:29.151 [2024-11-26 15:40:20.347818] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:29.151 [2024-11-26 15:40:20.347988] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:29.151 [2024-11-26 15:40:20.348008] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:29.151 [2024-11-26 15:40:20.348022] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:29.151 [2024-11-26 15:40:20.348110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:29.151 [2024-11-26 15:40:20.348167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:29.151 [2024-11-26 15:40:20.348220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:29.151 [2024-11-26 15:40:20.348224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:30.086 15:40:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:30.086 15:40:21 -- common/autotest_common.sh@862 -- # return 0 00:16:30.086 15:40:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:30.086 15:40:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:30.086 15:40:21 -- common/autotest_common.sh@10 -- # set +x 00:16:30.086 15:40:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:30.086 15:40:21 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:30.086 15:40:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.086 15:40:21 -- common/autotest_common.sh@10 -- # set +x 00:16:30.086 [2024-11-26 15:40:21.209400] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:30.086 15:40:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.086 15:40:21 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:30.086 15:40:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.086 15:40:21 -- common/autotest_common.sh@10 -- # set +x 00:16:30.086 Malloc0 00:16:30.086 15:40:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.086 15:40:21 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:30.086 15:40:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.086 15:40:21 -- common/autotest_common.sh@10 -- # set +x 00:16:30.086 15:40:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.086 15:40:21 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:30.086 15:40:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.086 15:40:21 -- common/autotest_common.sh@10 -- # set +x 00:16:30.086 15:40:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.086 15:40:21 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:30.086 15:40:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.086 15:40:21 -- common/autotest_common.sh@10 -- # set +x 00:16:30.086 [2024-11-26 15:40:21.263432] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:30.086 15:40:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.086 15:40:21 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:16:30.086 15:40:21 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:30.086 15:40:21 -- nvmf/common.sh@520 -- # config=() 00:16:30.086 15:40:21 -- nvmf/common.sh@520 -- # local subsystem config 00:16:30.086 15:40:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:30.086 15:40:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:30.086 { 00:16:30.086 "params": { 00:16:30.086 "name": "Nvme$subsystem", 00:16:30.086 "trtype": "$TEST_TRANSPORT", 00:16:30.086 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:30.086 "adrfam": "ipv4", 00:16:30.086 "trsvcid": "$NVMF_PORT", 00:16:30.086 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:30.086 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:30.086 "hdgst": ${hdgst:-false}, 00:16:30.086 "ddgst": ${ddgst:-false} 00:16:30.086 }, 00:16:30.086 "method": "bdev_nvme_attach_controller" 00:16:30.086 } 00:16:30.086 EOF 00:16:30.086 )") 00:16:30.086 15:40:21 -- nvmf/common.sh@542 -- # cat 00:16:30.086 15:40:21 -- nvmf/common.sh@544 -- # jq . 00:16:30.086 15:40:21 -- nvmf/common.sh@545 -- # IFS=, 00:16:30.086 15:40:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:30.086 "params": { 00:16:30.086 "name": "Nvme1", 00:16:30.086 "trtype": "tcp", 00:16:30.086 "traddr": "10.0.0.2", 00:16:30.086 "adrfam": "ipv4", 00:16:30.086 "trsvcid": "4420", 00:16:30.086 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:30.086 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:30.086 "hdgst": false, 00:16:30.086 "ddgst": false 00:16:30.086 }, 00:16:30.086 "method": "bdev_nvme_attach_controller" 00:16:30.086 }' 00:16:30.086 [2024-11-26 15:40:21.306302] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:30.086 [2024-11-26 15:40:21.306367] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid877521 ] 00:16:30.086 EAL: No free 2048 kB hugepages reported on node 1 00:16:30.086 [2024-11-26 15:40:21.366178] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:30.086 [2024-11-26 15:40:21.479042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:30.086 [2024-11-26 15:40:21.479094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:30.086 [2024-11-26 15:40:21.479097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:30.345 [2024-11-26 15:40:21.774975] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:30.345 [2024-11-26 15:40:21.775042] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:30.345 I/O targets: 00:16:30.345 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:30.345 00:16:30.345 00:16:30.345 CUnit - A unit testing framework for C - Version 2.1-3 00:16:30.345 http://cunit.sourceforge.net/ 00:16:30.345 00:16:30.345 00:16:30.345 Suite: bdevio tests on: Nvme1n1 00:16:30.603 Test: blockdev write read block ...passed 00:16:30.604 Test: blockdev write zeroes read block ...passed 00:16:30.604 Test: blockdev write zeroes read no split ...passed 00:16:30.604 Test: blockdev write zeroes read split ...passed 00:16:30.604 Test: blockdev write zeroes read split partial ...passed 00:16:30.604 Test: blockdev reset ...[2024-11-26 15:40:21.933551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:30.604 [2024-11-26 15:40:21.933667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfdaf20 (9): Bad file descriptor 00:16:30.861 [2024-11-26 15:40:22.075835] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:30.862 passed 00:16:30.862 Test: blockdev write read 8 blocks ...passed 00:16:30.862 Test: blockdev write read size > 128k ...passed 00:16:30.862 Test: blockdev write read invalid size ...passed 00:16:30.862 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:30.862 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:30.862 Test: blockdev write read max offset ...passed 00:16:30.862 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:30.862 Test: blockdev writev readv 8 blocks ...passed 00:16:31.120 Test: blockdev writev readv 30 x 1block ...passed 00:16:31.120 Test: blockdev writev readv block ...passed 00:16:31.120 Test: blockdev writev readv size > 128k ...passed 00:16:31.120 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:31.120 Test: blockdev comparev and writev ...[2024-11-26 15:40:22.372483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:31.120 [2024-11-26 15:40:22.372521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:31.120 [2024-11-26 15:40:22.372546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:31.120 [2024-11-26 15:40:22.372564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:31.120 [2024-11-26 15:40:22.372903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:31.120 [2024-11-26 15:40:22.372928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:31.120 [2024-11-26 15:40:22.372949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:31.120 [2024-11-26 15:40:22.372965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:31.120 [2024-11-26 15:40:22.373301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:31.120 [2024-11-26 15:40:22.373326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:31.120 [2024-11-26 15:40:22.373348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:31.120 [2024-11-26 15:40:22.373363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:31.120 [2024-11-26 15:40:22.373678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:31.120 [2024-11-26 15:40:22.373710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:31.120 [2024-11-26 15:40:22.373732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:31.120 [2024-11-26 15:40:22.373749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:31.120 passed 00:16:31.120 Test: blockdev nvme passthru rw ...passed 00:16:31.120 Test: blockdev nvme passthru vendor specific ...[2024-11-26 15:40:22.457974] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:31.120 [2024-11-26 15:40:22.458001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:31.120 [2024-11-26 15:40:22.458171] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:31.120 [2024-11-26 15:40:22.458195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:31.120 [2024-11-26 15:40:22.458355] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:31.120 [2024-11-26 15:40:22.458379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:31.120 [2024-11-26 15:40:22.458547] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:31.120 [2024-11-26 15:40:22.458571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:31.120 passed 00:16:31.120 Test: blockdev nvme admin passthru ...passed 00:16:31.120 Test: blockdev copy ...passed 00:16:31.120 00:16:31.120 Run Summary: Type Total Ran Passed Failed Inactive 00:16:31.120 suites 1 1 n/a 0 0 00:16:31.120 tests 23 23 23 0 0 00:16:31.120 asserts 152 152 152 0 n/a 00:16:31.120 00:16:31.120 Elapsed time = 1.482 seconds 00:16:31.379 15:40:22 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:31.379 15:40:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.380 15:40:22 -- common/autotest_common.sh@10 -- # set +x 00:16:31.380 15:40:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.380 15:40:22 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:31.380 15:40:22 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:31.380 15:40:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:31.380 15:40:22 -- nvmf/common.sh@116 -- # sync 00:16:31.380 15:40:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:31.380 15:40:22 -- nvmf/common.sh@119 -- # set +e 00:16:31.380 15:40:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:31.380 15:40:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:31.380 rmmod nvme_tcp 00:16:31.380 rmmod nvme_fabrics 00:16:31.380 rmmod nvme_keyring 00:16:31.380 15:40:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:31.380 15:40:22 -- nvmf/common.sh@123 -- # set -e 00:16:31.380 15:40:22 -- nvmf/common.sh@124 -- # return 0 00:16:31.380 15:40:22 -- nvmf/common.sh@477 -- # '[' -n 877363 ']' 00:16:31.380 15:40:22 -- nvmf/common.sh@478 -- # killprocess 877363 00:16:31.380 15:40:22 -- common/autotest_common.sh@936 -- # '[' -z 877363 ']' 00:16:31.380 15:40:22 -- common/autotest_common.sh@940 -- # kill -0 877363 00:16:31.380 15:40:22 -- common/autotest_common.sh@941 -- # uname 00:16:31.380 15:40:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:31.380 15:40:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 877363 00:16:31.638 15:40:22 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:31.638 15:40:22 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:31.638 15:40:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 877363' 00:16:31.638 killing process with pid 877363 00:16:31.638 15:40:22 -- common/autotest_common.sh@955 -- # kill 877363 00:16:31.638 15:40:22 -- common/autotest_common.sh@960 -- # wait 877363 00:16:31.897 15:40:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:31.897 15:40:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:31.897 15:40:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:31.897 15:40:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:31.897 15:40:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:31.897 15:40:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:31.897 15:40:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:31.897 15:40:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:33.951 15:40:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:33.951 00:16:33.951 real 0m7.488s 00:16:33.951 user 0m14.865s 00:16:33.951 sys 0m2.195s 00:16:33.951 15:40:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:33.951 15:40:25 -- common/autotest_common.sh@10 -- # set +x 00:16:33.951 ************************************ 00:16:33.951 END TEST nvmf_bdevio 00:16:33.951 ************************************ 00:16:33.951 15:40:25 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:16:33.952 15:40:25 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:33.952 15:40:25 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:16:33.952 15:40:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:33.952 15:40:25 -- common/autotest_common.sh@10 -- # set +x 00:16:33.952 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:16:33.952 ************************************ 00:16:33.952 START TEST nvmf_bdevio_no_huge 00:16:33.952 ************************************ 00:16:33.952 15:40:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:33.952 * Looking for test storage... 00:16:33.952 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:33.952 15:40:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:33.952 15:40:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:33.952 15:40:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:33.952 15:40:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:33.952 15:40:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:33.952 15:40:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:33.952 15:40:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:33.952 15:40:25 -- scripts/common.sh@335 -- # IFS=.-: 00:16:33.952 15:40:25 -- scripts/common.sh@335 -- # read -ra ver1 00:16:33.952 15:40:25 -- scripts/common.sh@336 -- # IFS=.-: 00:16:33.952 15:40:25 -- scripts/common.sh@336 -- # read -ra ver2 00:16:33.952 15:40:25 -- scripts/common.sh@337 -- # local 'op=<' 00:16:33.952 15:40:25 -- scripts/common.sh@339 -- # ver1_l=2 00:16:33.952 15:40:25 -- scripts/common.sh@340 -- # ver2_l=1 00:16:33.952 15:40:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:33.952 15:40:25 -- scripts/common.sh@343 -- # case "$op" in 00:16:33.952 15:40:25 -- scripts/common.sh@344 -- # : 1 00:16:33.952 15:40:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:33.952 15:40:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:33.952 15:40:25 -- scripts/common.sh@364 -- # decimal 1 00:16:33.952 15:40:25 -- scripts/common.sh@352 -- # local d=1 00:16:33.952 15:40:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:33.952 15:40:25 -- scripts/common.sh@354 -- # echo 1 00:16:33.952 15:40:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:33.952 15:40:25 -- scripts/common.sh@365 -- # decimal 2 00:16:33.952 15:40:25 -- scripts/common.sh@352 -- # local d=2 00:16:33.952 15:40:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:33.952 15:40:25 -- scripts/common.sh@354 -- # echo 2 00:16:33.952 15:40:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:33.952 15:40:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:33.952 15:40:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:33.952 15:40:25 -- scripts/common.sh@367 -- # return 0 00:16:33.952 15:40:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:33.952 15:40:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:33.952 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:33.952 --rc genhtml_branch_coverage=1 00:16:33.952 --rc genhtml_function_coverage=1 00:16:33.952 --rc genhtml_legend=1 00:16:33.952 --rc geninfo_all_blocks=1 00:16:33.952 --rc geninfo_unexecuted_blocks=1 00:16:33.952 00:16:33.952 ' 00:16:33.952 15:40:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:33.952 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:33.952 --rc genhtml_branch_coverage=1 00:16:33.952 --rc genhtml_function_coverage=1 00:16:33.952 --rc genhtml_legend=1 00:16:33.952 --rc geninfo_all_blocks=1 00:16:33.952 --rc geninfo_unexecuted_blocks=1 00:16:33.952 00:16:33.952 ' 00:16:33.952 15:40:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:33.952 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:33.952 --rc genhtml_branch_coverage=1 00:16:33.952 --rc genhtml_function_coverage=1 00:16:33.952 --rc genhtml_legend=1 00:16:33.952 --rc geninfo_all_blocks=1 00:16:33.952 --rc geninfo_unexecuted_blocks=1 00:16:33.952 00:16:33.952 ' 00:16:33.952 15:40:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:33.952 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:33.952 --rc genhtml_branch_coverage=1 00:16:33.952 --rc genhtml_function_coverage=1 00:16:33.952 --rc genhtml_legend=1 00:16:33.952 --rc geninfo_all_blocks=1 00:16:33.952 --rc geninfo_unexecuted_blocks=1 00:16:33.952 00:16:33.952 ' 00:16:33.952 15:40:25 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:33.952 15:40:25 -- nvmf/common.sh@7 -- # uname -s 00:16:33.952 15:40:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:33.952 15:40:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:33.952 15:40:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:33.952 15:40:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:33.952 15:40:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:33.952 15:40:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:33.952 15:40:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:33.952 15:40:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:33.952 15:40:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:33.952 15:40:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:33.952 15:40:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:33.952 15:40:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:33.952 15:40:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:33.952 15:40:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:33.952 15:40:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:33.952 15:40:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:33.952 15:40:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:33.952 15:40:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:33.952 15:40:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:33.952 15:40:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:33.952 15:40:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:33.952 15:40:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:33.952 15:40:25 -- paths/export.sh@5 -- # export PATH 00:16:33.952 15:40:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:33.952 15:40:25 -- nvmf/common.sh@46 -- # : 0 00:16:33.952 15:40:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:33.952 15:40:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:33.952 15:40:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:33.952 15:40:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:33.952 15:40:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:33.952 15:40:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:33.952 15:40:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:33.952 15:40:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:33.952 15:40:25 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:33.952 15:40:25 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:33.952 15:40:25 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:33.952 15:40:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:33.952 15:40:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:33.952 15:40:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:33.952 15:40:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:33.952 15:40:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:33.952 15:40:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:33.952 15:40:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:33.952 15:40:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:33.952 15:40:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:33.952 15:40:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:33.952 15:40:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:33.952 15:40:25 -- common/autotest_common.sh@10 -- # set +x 00:16:36.486 15:40:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:36.486 15:40:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:36.486 15:40:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:36.486 15:40:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:36.486 15:40:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:36.486 15:40:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:36.486 15:40:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:36.486 15:40:27 -- nvmf/common.sh@294 -- # net_devs=() 00:16:36.486 15:40:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:36.486 15:40:27 -- nvmf/common.sh@295 -- # e810=() 00:16:36.486 15:40:27 -- nvmf/common.sh@295 -- # local -ga e810 00:16:36.486 15:40:27 -- nvmf/common.sh@296 -- # x722=() 00:16:36.486 15:40:27 -- nvmf/common.sh@296 -- # local -ga x722 00:16:36.486 15:40:27 -- nvmf/common.sh@297 -- # mlx=() 00:16:36.486 15:40:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:36.486 15:40:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:36.486 15:40:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:36.486 15:40:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:36.486 15:40:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:36.486 15:40:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:36.486 15:40:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:36.486 15:40:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:36.486 15:40:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:36.486 15:40:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:36.487 15:40:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:36.487 15:40:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:36.487 15:40:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:36.487 15:40:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:36.487 15:40:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:36.487 15:40:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:36.487 15:40:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:36.487 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:36.487 15:40:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:36.487 15:40:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:36.487 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:36.487 15:40:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:36.487 15:40:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:36.487 15:40:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:36.487 15:40:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:36.487 15:40:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:36.487 15:40:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:36.487 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:36.487 15:40:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:36.487 15:40:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:36.487 15:40:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:36.487 15:40:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:36.487 15:40:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:36.487 15:40:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:36.487 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:36.487 15:40:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:36.487 15:40:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:36.487 15:40:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:36.487 15:40:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:36.487 15:40:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:36.487 15:40:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:36.487 15:40:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:36.487 15:40:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:36.487 15:40:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:36.487 15:40:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:36.487 15:40:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:36.487 15:40:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:36.487 15:40:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:36.487 15:40:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:36.487 15:40:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:36.487 15:40:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:36.487 15:40:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:36.487 15:40:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:36.487 15:40:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:36.487 15:40:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:36.487 15:40:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:36.487 15:40:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:36.487 15:40:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:36.487 15:40:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:36.487 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:36.487 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:16:36.487 00:16:36.487 --- 10.0.0.2 ping statistics --- 00:16:36.487 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:36.487 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:16:36.487 15:40:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:36.487 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:36.487 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.086 ms 00:16:36.487 00:16:36.487 --- 10.0.0.1 ping statistics --- 00:16:36.487 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:36.487 rtt min/avg/max/mdev = 0.086/0.086/0.086/0.000 ms 00:16:36.487 15:40:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:36.487 15:40:27 -- nvmf/common.sh@410 -- # return 0 00:16:36.487 15:40:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:36.487 15:40:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:36.487 15:40:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:36.487 15:40:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:36.487 15:40:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:36.487 15:40:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:36.487 15:40:27 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:36.487 15:40:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:36.487 15:40:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:36.487 15:40:27 -- common/autotest_common.sh@10 -- # set +x 00:16:36.487 15:40:27 -- nvmf/common.sh@469 -- # nvmfpid=879584 00:16:36.487 15:40:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:16:36.487 15:40:27 -- nvmf/common.sh@470 -- # waitforlisten 879584 00:16:36.487 15:40:27 -- common/autotest_common.sh@829 -- # '[' -z 879584 ']' 00:16:36.487 15:40:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:36.487 15:40:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:36.487 15:40:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:36.487 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:36.487 15:40:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:36.487 15:40:27 -- common/autotest_common.sh@10 -- # set +x 00:16:36.487 [2024-11-26 15:40:27.667314] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:36.487 [2024-11-26 15:40:27.667397] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:16:36.487 [2024-11-26 15:40:27.740100] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:36.487 [2024-11-26 15:40:27.861109] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:36.487 [2024-11-26 15:40:27.861273] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:36.487 [2024-11-26 15:40:27.861292] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:36.487 [2024-11-26 15:40:27.861304] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:36.487 [2024-11-26 15:40:27.861367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:36.487 [2024-11-26 15:40:27.861434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:36.487 [2024-11-26 15:40:27.861403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:36.487 [2024-11-26 15:40:27.861438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:37.420 15:40:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:37.420 15:40:28 -- common/autotest_common.sh@862 -- # return 0 00:16:37.420 15:40:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:37.420 15:40:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:37.420 15:40:28 -- common/autotest_common.sh@10 -- # set +x 00:16:37.420 15:40:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:37.420 15:40:28 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:37.420 15:40:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:37.420 15:40:28 -- common/autotest_common.sh@10 -- # set +x 00:16:37.420 [2024-11-26 15:40:28.650322] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:37.420 15:40:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:37.420 15:40:28 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:37.420 15:40:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:37.420 15:40:28 -- common/autotest_common.sh@10 -- # set +x 00:16:37.420 Malloc0 00:16:37.420 15:40:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:37.420 15:40:28 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:37.420 15:40:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:37.420 15:40:28 -- common/autotest_common.sh@10 -- # set +x 00:16:37.420 15:40:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:37.420 15:40:28 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:37.420 15:40:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:37.420 15:40:28 -- common/autotest_common.sh@10 -- # set +x 00:16:37.420 15:40:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:37.420 15:40:28 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:37.420 15:40:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:37.420 15:40:28 -- common/autotest_common.sh@10 -- # set +x 00:16:37.420 [2024-11-26 15:40:28.688241] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:37.420 15:40:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:37.420 15:40:28 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:16:37.420 15:40:28 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:37.420 15:40:28 -- nvmf/common.sh@520 -- # config=() 00:16:37.420 15:40:28 -- nvmf/common.sh@520 -- # local subsystem config 00:16:37.420 15:40:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:37.420 15:40:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:37.420 { 00:16:37.420 "params": { 00:16:37.420 "name": "Nvme$subsystem", 00:16:37.420 "trtype": "$TEST_TRANSPORT", 00:16:37.420 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:37.420 "adrfam": "ipv4", 00:16:37.420 "trsvcid": "$NVMF_PORT", 00:16:37.420 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:37.420 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:37.420 "hdgst": ${hdgst:-false}, 00:16:37.420 "ddgst": ${ddgst:-false} 00:16:37.420 }, 00:16:37.420 "method": "bdev_nvme_attach_controller" 00:16:37.420 } 00:16:37.420 EOF 00:16:37.420 )") 00:16:37.420 15:40:28 -- nvmf/common.sh@542 -- # cat 00:16:37.420 15:40:28 -- nvmf/common.sh@544 -- # jq . 00:16:37.420 15:40:28 -- nvmf/common.sh@545 -- # IFS=, 00:16:37.420 15:40:28 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:37.420 "params": { 00:16:37.420 "name": "Nvme1", 00:16:37.420 "trtype": "tcp", 00:16:37.420 "traddr": "10.0.0.2", 00:16:37.420 "adrfam": "ipv4", 00:16:37.420 "trsvcid": "4420", 00:16:37.420 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:37.420 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:37.420 "hdgst": false, 00:16:37.420 "ddgst": false 00:16:37.420 }, 00:16:37.420 "method": "bdev_nvme_attach_controller" 00:16:37.420 }' 00:16:37.420 [2024-11-26 15:40:28.726695] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:37.420 [2024-11-26 15:40:28.726789] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid879737 ] 00:16:37.420 [2024-11-26 15:40:28.794892] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:37.679 [2024-11-26 15:40:28.908137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:37.679 [2024-11-26 15:40:28.908190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:37.679 [2024-11-26 15:40:28.908194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:37.937 [2024-11-26 15:40:29.184096] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:37.937 [2024-11-26 15:40:29.184157] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:37.937 I/O targets: 00:16:37.937 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:37.937 00:16:37.937 00:16:37.937 CUnit - A unit testing framework for C - Version 2.1-3 00:16:37.937 http://cunit.sourceforge.net/ 00:16:37.937 00:16:37.937 00:16:37.937 Suite: bdevio tests on: Nvme1n1 00:16:37.937 Test: blockdev write read block ...passed 00:16:37.937 Test: blockdev write zeroes read block ...passed 00:16:37.937 Test: blockdev write zeroes read no split ...passed 00:16:37.937 Test: blockdev write zeroes read split ...passed 00:16:37.937 Test: blockdev write zeroes read split partial ...passed 00:16:37.937 Test: blockdev reset ...[2024-11-26 15:40:29.348088] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:37.937 [2024-11-26 15:40:29.348206] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20b07d0 (9): Bad file descriptor 00:16:38.194 [2024-11-26 15:40:29.402982] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:38.194 passed 00:16:38.194 Test: blockdev write read 8 blocks ...passed 00:16:38.194 Test: blockdev write read size > 128k ...passed 00:16:38.194 Test: blockdev write read invalid size ...passed 00:16:38.194 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:38.194 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:38.194 Test: blockdev write read max offset ...passed 00:16:38.194 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:38.194 Test: blockdev writev readv 8 blocks ...passed 00:16:38.194 Test: blockdev writev readv 30 x 1block ...passed 00:16:38.194 Test: blockdev writev readv block ...passed 00:16:38.194 Test: blockdev writev readv size > 128k ...passed 00:16:38.194 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:38.194 Test: blockdev comparev and writev ...[2024-11-26 15:40:29.616061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.194 [2024-11-26 15:40:29.616098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:38.194 [2024-11-26 15:40:29.616123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.194 [2024-11-26 15:40:29.616141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:38.194 [2024-11-26 15:40:29.616478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.194 [2024-11-26 15:40:29.616502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:38.194 [2024-11-26 15:40:29.616524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.194 [2024-11-26 15:40:29.616550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:38.194 [2024-11-26 15:40:29.616892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.194 [2024-11-26 15:40:29.616916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:38.194 [2024-11-26 15:40:29.616937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.194 [2024-11-26 15:40:29.616953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:38.194 [2024-11-26 15:40:29.617308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.195 [2024-11-26 15:40:29.617333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:38.195 [2024-11-26 15:40:29.617353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.195 [2024-11-26 15:40:29.617369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:38.453 passed 00:16:38.453 Test: blockdev nvme passthru rw ...passed 00:16:38.453 Test: blockdev nvme passthru vendor specific ...[2024-11-26 15:40:29.699978] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:38.453 [2024-11-26 15:40:29.700006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:38.453 [2024-11-26 15:40:29.700163] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:38.453 [2024-11-26 15:40:29.700186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:38.453 [2024-11-26 15:40:29.700337] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:38.453 [2024-11-26 15:40:29.700359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:38.453 [2024-11-26 15:40:29.700511] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:38.453 [2024-11-26 15:40:29.700533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:38.453 passed 00:16:38.453 Test: blockdev nvme admin passthru ...passed 00:16:38.453 Test: blockdev copy ...passed 00:16:38.453 00:16:38.453 Run Summary: Type Total Ran Passed Failed Inactive 00:16:38.453 suites 1 1 n/a 0 0 00:16:38.453 tests 23 23 23 0 0 00:16:38.453 asserts 152 152 152 0 n/a 00:16:38.453 00:16:38.453 Elapsed time = 1.152 seconds 00:16:38.710 15:40:30 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:38.710 15:40:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:38.710 15:40:30 -- common/autotest_common.sh@10 -- # set +x 00:16:38.710 15:40:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:38.710 15:40:30 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:38.710 15:40:30 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:38.710 15:40:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:38.711 15:40:30 -- nvmf/common.sh@116 -- # sync 00:16:38.711 15:40:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:38.711 15:40:30 -- nvmf/common.sh@119 -- # set +e 00:16:38.711 15:40:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:38.711 15:40:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:38.968 rmmod nvme_tcp 00:16:38.968 rmmod nvme_fabrics 00:16:38.968 rmmod nvme_keyring 00:16:38.968 15:40:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:38.968 15:40:30 -- nvmf/common.sh@123 -- # set -e 00:16:38.968 15:40:30 -- nvmf/common.sh@124 -- # return 0 00:16:38.968 15:40:30 -- nvmf/common.sh@477 -- # '[' -n 879584 ']' 00:16:38.968 15:40:30 -- nvmf/common.sh@478 -- # killprocess 879584 00:16:38.968 15:40:30 -- common/autotest_common.sh@936 -- # '[' -z 879584 ']' 00:16:38.968 15:40:30 -- common/autotest_common.sh@940 -- # kill -0 879584 00:16:38.968 15:40:30 -- common/autotest_common.sh@941 -- # uname 00:16:38.968 15:40:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:38.968 15:40:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 879584 00:16:38.968 15:40:30 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:38.968 15:40:30 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:38.968 15:40:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 879584' 00:16:38.969 killing process with pid 879584 00:16:38.969 15:40:30 -- common/autotest_common.sh@955 -- # kill 879584 00:16:38.969 15:40:30 -- common/autotest_common.sh@960 -- # wait 879584 00:16:39.535 15:40:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:39.535 15:40:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:39.535 15:40:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:39.535 15:40:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:39.535 15:40:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:39.535 15:40:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:39.535 15:40:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:39.535 15:40:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:41.440 15:40:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:41.440 00:16:41.440 real 0m7.507s 00:16:41.440 user 0m14.214s 00:16:41.440 sys 0m2.587s 00:16:41.440 15:40:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:41.440 15:40:32 -- common/autotest_common.sh@10 -- # set +x 00:16:41.440 ************************************ 00:16:41.440 END TEST nvmf_bdevio_no_huge 00:16:41.440 ************************************ 00:16:41.440 15:40:32 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:16:41.440 15:40:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:41.440 15:40:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:41.440 15:40:32 -- common/autotest_common.sh@10 -- # set +x 00:16:41.440 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:16:41.440 ************************************ 00:16:41.440 START TEST nvmf_tls 00:16:41.440 ************************************ 00:16:41.440 15:40:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:16:41.440 * Looking for test storage... 00:16:41.440 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:41.440 15:40:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:41.440 15:40:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:41.440 15:40:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:41.699 15:40:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:41.699 15:40:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:41.699 15:40:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:41.699 15:40:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:41.699 15:40:32 -- scripts/common.sh@335 -- # IFS=.-: 00:16:41.699 15:40:32 -- scripts/common.sh@335 -- # read -ra ver1 00:16:41.699 15:40:32 -- scripts/common.sh@336 -- # IFS=.-: 00:16:41.699 15:40:32 -- scripts/common.sh@336 -- # read -ra ver2 00:16:41.699 15:40:32 -- scripts/common.sh@337 -- # local 'op=<' 00:16:41.699 15:40:32 -- scripts/common.sh@339 -- # ver1_l=2 00:16:41.699 15:40:32 -- scripts/common.sh@340 -- # ver2_l=1 00:16:41.699 15:40:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:41.699 15:40:32 -- scripts/common.sh@343 -- # case "$op" in 00:16:41.699 15:40:32 -- scripts/common.sh@344 -- # : 1 00:16:41.699 15:40:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:41.699 15:40:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:41.699 15:40:32 -- scripts/common.sh@364 -- # decimal 1 00:16:41.699 15:40:32 -- scripts/common.sh@352 -- # local d=1 00:16:41.699 15:40:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:41.699 15:40:32 -- scripts/common.sh@354 -- # echo 1 00:16:41.699 15:40:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:41.699 15:40:32 -- scripts/common.sh@365 -- # decimal 2 00:16:41.699 15:40:32 -- scripts/common.sh@352 -- # local d=2 00:16:41.699 15:40:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:41.699 15:40:32 -- scripts/common.sh@354 -- # echo 2 00:16:41.699 15:40:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:41.699 15:40:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:41.699 15:40:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:41.699 15:40:32 -- scripts/common.sh@367 -- # return 0 00:16:41.699 15:40:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:41.699 15:40:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:41.699 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.699 --rc genhtml_branch_coverage=1 00:16:41.699 --rc genhtml_function_coverage=1 00:16:41.699 --rc genhtml_legend=1 00:16:41.699 --rc geninfo_all_blocks=1 00:16:41.699 --rc geninfo_unexecuted_blocks=1 00:16:41.699 00:16:41.699 ' 00:16:41.699 15:40:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:41.699 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.699 --rc genhtml_branch_coverage=1 00:16:41.699 --rc genhtml_function_coverage=1 00:16:41.699 --rc genhtml_legend=1 00:16:41.699 --rc geninfo_all_blocks=1 00:16:41.699 --rc geninfo_unexecuted_blocks=1 00:16:41.699 00:16:41.699 ' 00:16:41.699 15:40:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:41.699 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.699 --rc genhtml_branch_coverage=1 00:16:41.699 --rc genhtml_function_coverage=1 00:16:41.699 --rc genhtml_legend=1 00:16:41.699 --rc geninfo_all_blocks=1 00:16:41.699 --rc geninfo_unexecuted_blocks=1 00:16:41.699 00:16:41.699 ' 00:16:41.699 15:40:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:41.699 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.699 --rc genhtml_branch_coverage=1 00:16:41.699 --rc genhtml_function_coverage=1 00:16:41.699 --rc genhtml_legend=1 00:16:41.699 --rc geninfo_all_blocks=1 00:16:41.699 --rc geninfo_unexecuted_blocks=1 00:16:41.699 00:16:41.699 ' 00:16:41.699 15:40:32 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:41.699 15:40:32 -- nvmf/common.sh@7 -- # uname -s 00:16:41.699 15:40:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:41.699 15:40:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:41.699 15:40:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:41.699 15:40:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:41.699 15:40:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:41.699 15:40:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:41.699 15:40:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:41.699 15:40:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:41.699 15:40:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:41.699 15:40:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:41.699 15:40:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:41.699 15:40:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:41.699 15:40:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:41.699 15:40:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:41.699 15:40:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:41.699 15:40:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:41.699 15:40:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:41.699 15:40:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:41.699 15:40:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:41.699 15:40:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.699 15:40:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.699 15:40:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.699 15:40:32 -- paths/export.sh@5 -- # export PATH 00:16:41.699 15:40:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.699 15:40:32 -- nvmf/common.sh@46 -- # : 0 00:16:41.699 15:40:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:41.699 15:40:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:41.699 15:40:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:41.699 15:40:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:41.699 15:40:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:41.699 15:40:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:41.699 15:40:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:41.699 15:40:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:41.699 15:40:32 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:41.699 15:40:32 -- target/tls.sh@71 -- # nvmftestinit 00:16:41.699 15:40:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:41.699 15:40:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:41.699 15:40:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:41.699 15:40:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:41.699 15:40:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:41.699 15:40:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:41.699 15:40:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:41.699 15:40:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:41.699 15:40:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:41.699 15:40:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:41.699 15:40:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:41.699 15:40:32 -- common/autotest_common.sh@10 -- # set +x 00:16:43.601 15:40:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:43.601 15:40:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:43.601 15:40:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:43.601 15:40:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:43.601 15:40:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:43.601 15:40:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:43.601 15:40:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:43.601 15:40:34 -- nvmf/common.sh@294 -- # net_devs=() 00:16:43.601 15:40:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:43.601 15:40:34 -- nvmf/common.sh@295 -- # e810=() 00:16:43.601 15:40:34 -- nvmf/common.sh@295 -- # local -ga e810 00:16:43.601 15:40:34 -- nvmf/common.sh@296 -- # x722=() 00:16:43.601 15:40:34 -- nvmf/common.sh@296 -- # local -ga x722 00:16:43.601 15:40:34 -- nvmf/common.sh@297 -- # mlx=() 00:16:43.601 15:40:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:43.601 15:40:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:43.601 15:40:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:43.602 15:40:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:43.602 15:40:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:43.602 15:40:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:43.602 15:40:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:43.602 15:40:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:43.602 15:40:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:43.602 15:40:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:43.602 15:40:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:43.602 15:40:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:43.602 15:40:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:43.602 15:40:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:43.602 15:40:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:43.602 15:40:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:43.602 15:40:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:43.602 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:43.602 15:40:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:43.602 15:40:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:43.602 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:43.602 15:40:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:43.602 15:40:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:43.602 15:40:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:43.602 15:40:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:43.602 15:40:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:43.602 15:40:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:43.602 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:43.602 15:40:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:43.602 15:40:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:43.602 15:40:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:43.602 15:40:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:43.602 15:40:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:43.602 15:40:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:43.602 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:43.602 15:40:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:43.602 15:40:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:43.602 15:40:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:43.602 15:40:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:43.602 15:40:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:43.602 15:40:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:43.602 15:40:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:43.602 15:40:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:43.602 15:40:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:43.602 15:40:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:43.602 15:40:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:43.602 15:40:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:43.602 15:40:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:43.602 15:40:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:43.602 15:40:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:43.602 15:40:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:43.602 15:40:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:43.602 15:40:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:43.602 15:40:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:43.602 15:40:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:43.602 15:40:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:43.602 15:40:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:43.860 15:40:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:43.860 15:40:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:43.860 15:40:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:43.860 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:43.860 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:16:43.860 00:16:43.860 --- 10.0.0.2 ping statistics --- 00:16:43.860 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:43.860 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:16:43.860 15:40:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:43.860 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:43.860 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:16:43.860 00:16:43.860 --- 10.0.0.1 ping statistics --- 00:16:43.860 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:43.860 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:16:43.860 15:40:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:43.860 15:40:35 -- nvmf/common.sh@410 -- # return 0 00:16:43.860 15:40:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:43.860 15:40:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:43.860 15:40:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:43.860 15:40:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:43.860 15:40:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:43.860 15:40:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:43.860 15:40:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:43.860 15:40:35 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:16:43.860 15:40:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:43.860 15:40:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:43.860 15:40:35 -- common/autotest_common.sh@10 -- # set +x 00:16:43.860 15:40:35 -- nvmf/common.sh@469 -- # nvmfpid=881910 00:16:43.860 15:40:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:16:43.860 15:40:35 -- nvmf/common.sh@470 -- # waitforlisten 881910 00:16:43.860 15:40:35 -- common/autotest_common.sh@829 -- # '[' -z 881910 ']' 00:16:43.860 15:40:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:43.860 15:40:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:43.860 15:40:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:43.860 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:43.860 15:40:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:43.860 15:40:35 -- common/autotest_common.sh@10 -- # set +x 00:16:43.860 [2024-11-26 15:40:35.139430] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:43.860 [2024-11-26 15:40:35.139518] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:43.860 EAL: No free 2048 kB hugepages reported on node 1 00:16:43.860 [2024-11-26 15:40:35.208511] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:44.118 [2024-11-26 15:40:35.321567] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:44.118 [2024-11-26 15:40:35.321728] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:44.118 [2024-11-26 15:40:35.321748] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:44.118 [2024-11-26 15:40:35.321762] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:44.118 [2024-11-26 15:40:35.321792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:45.052 15:40:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:45.052 15:40:36 -- common/autotest_common.sh@862 -- # return 0 00:16:45.052 15:40:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:45.052 15:40:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:45.052 15:40:36 -- common/autotest_common.sh@10 -- # set +x 00:16:45.052 15:40:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:45.052 15:40:36 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:16:45.052 15:40:36 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:16:45.052 true 00:16:45.052 15:40:36 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:45.052 15:40:36 -- target/tls.sh@82 -- # jq -r .tls_version 00:16:45.311 15:40:36 -- target/tls.sh@82 -- # version=0 00:16:45.311 15:40:36 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:16:45.311 15:40:36 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:45.569 15:40:36 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:45.569 15:40:36 -- target/tls.sh@90 -- # jq -r .tls_version 00:16:45.828 15:40:37 -- target/tls.sh@90 -- # version=13 00:16:45.828 15:40:37 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:16:45.828 15:40:37 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:16:46.086 15:40:37 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:46.086 15:40:37 -- target/tls.sh@98 -- # jq -r .tls_version 00:16:46.345 15:40:37 -- target/tls.sh@98 -- # version=7 00:16:46.345 15:40:37 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:16:46.345 15:40:37 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:46.345 15:40:37 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:16:46.603 15:40:37 -- target/tls.sh@105 -- # ktls=false 00:16:46.603 15:40:37 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:16:46.603 15:40:37 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:16:46.862 15:40:38 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:46.862 15:40:38 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:16:47.120 15:40:38 -- target/tls.sh@113 -- # ktls=true 00:16:47.120 15:40:38 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:16:47.120 15:40:38 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:16:47.409 15:40:38 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:47.409 15:40:38 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:16:47.667 15:40:38 -- target/tls.sh@121 -- # ktls=false 00:16:47.667 15:40:38 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:16:47.667 15:40:38 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:16:47.667 15:40:38 -- target/tls.sh@49 -- # local key hash crc 00:16:47.667 15:40:38 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:16:47.667 15:40:38 -- target/tls.sh@51 -- # hash=01 00:16:47.667 15:40:38 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:16:47.667 15:40:38 -- target/tls.sh@52 -- # gzip -1 -c 00:16:47.667 15:40:38 -- target/tls.sh@52 -- # tail -c8 00:16:47.667 15:40:38 -- target/tls.sh@52 -- # head -c 4 00:16:47.667 15:40:38 -- target/tls.sh@52 -- # crc='p$H�' 00:16:47.667 15:40:38 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:47.667 15:40:38 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:16:47.667 15:40:38 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:47.667 15:40:38 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:47.667 15:40:38 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:16:47.667 15:40:38 -- target/tls.sh@49 -- # local key hash crc 00:16:47.667 15:40:38 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:16:47.667 15:40:38 -- target/tls.sh@51 -- # hash=01 00:16:47.667 15:40:38 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:16:47.667 15:40:38 -- target/tls.sh@52 -- # gzip -1 -c 00:16:47.667 15:40:38 -- target/tls.sh@52 -- # tail -c8 00:16:47.667 15:40:38 -- target/tls.sh@52 -- # head -c 4 00:16:47.667 15:40:39 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:16:47.667 15:40:39 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:47.667 15:40:39 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:16:47.667 15:40:39 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:47.667 15:40:39 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:47.667 15:40:39 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:47.667 15:40:39 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:47.667 15:40:39 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:47.667 15:40:39 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:47.667 15:40:39 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:47.667 15:40:39 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:47.667 15:40:39 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:47.929 15:40:39 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:16:48.494 15:40:39 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:48.494 15:40:39 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:48.494 15:40:39 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:48.753 [2024-11-26 15:40:39.965415] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:48.753 15:40:39 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:49.010 15:40:40 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:16:49.266 [2024-11-26 15:40:40.494835] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:49.267 [2024-11-26 15:40:40.495095] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:49.267 15:40:40 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:49.524 malloc0 00:16:49.524 15:40:40 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:49.781 15:40:41 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:50.038 15:40:41 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:50.038 EAL: No free 2048 kB hugepages reported on node 1 00:17:00.008 Initializing NVMe Controllers 00:17:00.008 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:00.008 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:00.008 Initialization complete. Launching workers. 00:17:00.008 ======================================================== 00:17:00.008 Latency(us) 00:17:00.008 Device Information : IOPS MiB/s Average min max 00:17:00.008 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7746.55 30.26 8264.43 1259.74 12232.88 00:17:00.008 ======================================================== 00:17:00.008 Total : 7746.55 30.26 8264.43 1259.74 12232.88 00:17:00.008 00:17:00.008 15:40:51 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:00.008 15:40:51 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:00.008 15:40:51 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:00.008 15:40:51 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:00.008 15:40:51 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:00.008 15:40:51 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:00.008 15:40:51 -- target/tls.sh@28 -- # bdevperf_pid=883786 00:17:00.008 15:40:51 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:00.008 15:40:51 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:00.008 15:40:51 -- target/tls.sh@31 -- # waitforlisten 883786 /var/tmp/bdevperf.sock 00:17:00.008 15:40:51 -- common/autotest_common.sh@829 -- # '[' -z 883786 ']' 00:17:00.008 15:40:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:00.008 15:40:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:00.008 15:40:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:00.008 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:00.008 15:40:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:00.008 15:40:51 -- common/autotest_common.sh@10 -- # set +x 00:17:00.267 [2024-11-26 15:40:51.466136] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:00.267 [2024-11-26 15:40:51.466209] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid883786 ] 00:17:00.267 EAL: No free 2048 kB hugepages reported on node 1 00:17:00.267 [2024-11-26 15:40:51.524348] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:00.267 [2024-11-26 15:40:51.637652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:01.202 15:40:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:01.202 15:40:52 -- common/autotest_common.sh@862 -- # return 0 00:17:01.202 15:40:52 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:01.460 [2024-11-26 15:40:52.774355] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:01.460 TLSTESTn1 00:17:01.460 15:40:52 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:01.718 Running I/O for 10 seconds... 00:17:11.684 00:17:11.684 Latency(us) 00:17:11.684 [2024-11-26T14:41:03.137Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:11.684 [2024-11-26T14:41:03.137Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:11.684 Verification LBA range: start 0x0 length 0x2000 00:17:11.684 TLSTESTn1 : 10.02 3453.50 13.49 0.00 0.00 37017.51 7378.87 47574.28 00:17:11.684 [2024-11-26T14:41:03.137Z] =================================================================================================================== 00:17:11.684 [2024-11-26T14:41:03.137Z] Total : 3453.50 13.49 0.00 0.00 37017.51 7378.87 47574.28 00:17:11.684 0 00:17:11.684 15:41:03 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:11.685 15:41:03 -- target/tls.sh@45 -- # killprocess 883786 00:17:11.685 15:41:03 -- common/autotest_common.sh@936 -- # '[' -z 883786 ']' 00:17:11.685 15:41:03 -- common/autotest_common.sh@940 -- # kill -0 883786 00:17:11.685 15:41:03 -- common/autotest_common.sh@941 -- # uname 00:17:11.685 15:41:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:11.685 15:41:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 883786 00:17:11.685 15:41:03 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:11.685 15:41:03 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:11.685 15:41:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 883786' 00:17:11.685 killing process with pid 883786 00:17:11.685 15:41:03 -- common/autotest_common.sh@955 -- # kill 883786 00:17:11.685 Received shutdown signal, test time was about 10.000000 seconds 00:17:11.685 00:17:11.685 Latency(us) 00:17:11.685 [2024-11-26T14:41:03.138Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:11.685 [2024-11-26T14:41:03.138Z] =================================================================================================================== 00:17:11.685 [2024-11-26T14:41:03.138Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:11.685 15:41:03 -- common/autotest_common.sh@960 -- # wait 883786 00:17:11.943 15:41:03 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:11.943 15:41:03 -- common/autotest_common.sh@650 -- # local es=0 00:17:11.943 15:41:03 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:11.943 15:41:03 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:11.943 15:41:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:11.943 15:41:03 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:11.943 15:41:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:11.943 15:41:03 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:11.943 15:41:03 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:11.943 15:41:03 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:11.943 15:41:03 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:11.943 15:41:03 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:11.943 15:41:03 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:11.943 15:41:03 -- target/tls.sh@28 -- # bdevperf_pid=885211 00:17:11.943 15:41:03 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:11.943 15:41:03 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:11.943 15:41:03 -- target/tls.sh@31 -- # waitforlisten 885211 /var/tmp/bdevperf.sock 00:17:11.943 15:41:03 -- common/autotest_common.sh@829 -- # '[' -z 885211 ']' 00:17:11.943 15:41:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:11.944 15:41:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:11.944 15:41:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:11.944 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:11.944 15:41:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:11.944 15:41:03 -- common/autotest_common.sh@10 -- # set +x 00:17:11.944 [2024-11-26 15:41:03.367337] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:11.944 [2024-11-26 15:41:03.367432] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid885211 ] 00:17:12.203 EAL: No free 2048 kB hugepages reported on node 1 00:17:12.203 [2024-11-26 15:41:03.425606] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:12.203 [2024-11-26 15:41:03.529406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:12.203 15:41:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:12.203 15:41:03 -- common/autotest_common.sh@862 -- # return 0 00:17:12.203 15:41:03 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:12.770 [2024-11-26 15:41:03.925204] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:12.770 [2024-11-26 15:41:03.932195] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:12.770 [2024-11-26 15:41:03.932940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa461f0 (107): Transport endpoint is not connected 00:17:12.770 [2024-11-26 15:41:03.933931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa461f0 (9): Bad file descriptor 00:17:12.770 [2024-11-26 15:41:03.934931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:12.770 [2024-11-26 15:41:03.934951] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:12.770 [2024-11-26 15:41:03.934965] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:12.770 request: 00:17:12.770 { 00:17:12.770 "name": "TLSTEST", 00:17:12.770 "trtype": "tcp", 00:17:12.770 "traddr": "10.0.0.2", 00:17:12.770 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:12.770 "adrfam": "ipv4", 00:17:12.770 "trsvcid": "4420", 00:17:12.770 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:12.770 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:12.770 "method": "bdev_nvme_attach_controller", 00:17:12.770 "req_id": 1 00:17:12.770 } 00:17:12.770 Got JSON-RPC error response 00:17:12.770 response: 00:17:12.770 { 00:17:12.770 "code": -32602, 00:17:12.770 "message": "Invalid parameters" 00:17:12.770 } 00:17:12.770 15:41:03 -- target/tls.sh@36 -- # killprocess 885211 00:17:12.770 15:41:03 -- common/autotest_common.sh@936 -- # '[' -z 885211 ']' 00:17:12.770 15:41:03 -- common/autotest_common.sh@940 -- # kill -0 885211 00:17:12.770 15:41:03 -- common/autotest_common.sh@941 -- # uname 00:17:12.770 15:41:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:12.770 15:41:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 885211 00:17:12.770 15:41:03 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:12.770 15:41:03 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:12.770 15:41:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 885211' 00:17:12.770 killing process with pid 885211 00:17:12.770 15:41:03 -- common/autotest_common.sh@955 -- # kill 885211 00:17:12.770 Received shutdown signal, test time was about 10.000000 seconds 00:17:12.770 00:17:12.770 Latency(us) 00:17:12.770 [2024-11-26T14:41:04.223Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:12.770 [2024-11-26T14:41:04.223Z] =================================================================================================================== 00:17:12.770 [2024-11-26T14:41:04.223Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:12.770 15:41:03 -- common/autotest_common.sh@960 -- # wait 885211 00:17:13.029 15:41:04 -- target/tls.sh@37 -- # return 1 00:17:13.029 15:41:04 -- common/autotest_common.sh@653 -- # es=1 00:17:13.029 15:41:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:13.029 15:41:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:13.029 15:41:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:13.029 15:41:04 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.029 15:41:04 -- common/autotest_common.sh@650 -- # local es=0 00:17:13.030 15:41:04 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.030 15:41:04 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:13.030 15:41:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:13.030 15:41:04 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:13.030 15:41:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:13.030 15:41:04 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.030 15:41:04 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:13.030 15:41:04 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:13.030 15:41:04 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:13.030 15:41:04 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:13.030 15:41:04 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:13.030 15:41:04 -- target/tls.sh@28 -- # bdevperf_pid=885344 00:17:13.030 15:41:04 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:13.030 15:41:04 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:13.030 15:41:04 -- target/tls.sh@31 -- # waitforlisten 885344 /var/tmp/bdevperf.sock 00:17:13.030 15:41:04 -- common/autotest_common.sh@829 -- # '[' -z 885344 ']' 00:17:13.030 15:41:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:13.030 15:41:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:13.030 15:41:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:13.030 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:13.030 15:41:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:13.030 15:41:04 -- common/autotest_common.sh@10 -- # set +x 00:17:13.030 [2024-11-26 15:41:04.284518] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:13.030 [2024-11-26 15:41:04.284593] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid885344 ] 00:17:13.030 EAL: No free 2048 kB hugepages reported on node 1 00:17:13.030 [2024-11-26 15:41:04.343371] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:13.030 [2024-11-26 15:41:04.445775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:13.966 15:41:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:13.966 15:41:05 -- common/autotest_common.sh@862 -- # return 0 00:17:13.966 15:41:05 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:14.225 [2024-11-26 15:41:05.515161] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:14.225 [2024-11-26 15:41:05.526195] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:14.225 [2024-11-26 15:41:05.526225] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:14.225 [2024-11-26 15:41:05.526281] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:14.225 [2024-11-26 15:41:05.526950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8101f0 (107): Transport endpoint is not connected 00:17:14.225 [2024-11-26 15:41:05.527940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8101f0 (9): Bad file descriptor 00:17:14.225 [2024-11-26 15:41:05.528939] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:14.225 [2024-11-26 15:41:05.528960] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:14.225 [2024-11-26 15:41:05.528988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:14.225 request: 00:17:14.225 { 00:17:14.225 "name": "TLSTEST", 00:17:14.225 "trtype": "tcp", 00:17:14.225 "traddr": "10.0.0.2", 00:17:14.225 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:14.225 "adrfam": "ipv4", 00:17:14.225 "trsvcid": "4420", 00:17:14.225 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:14.225 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:14.225 "method": "bdev_nvme_attach_controller", 00:17:14.225 "req_id": 1 00:17:14.225 } 00:17:14.225 Got JSON-RPC error response 00:17:14.225 response: 00:17:14.225 { 00:17:14.225 "code": -32602, 00:17:14.225 "message": "Invalid parameters" 00:17:14.225 } 00:17:14.225 15:41:05 -- target/tls.sh@36 -- # killprocess 885344 00:17:14.225 15:41:05 -- common/autotest_common.sh@936 -- # '[' -z 885344 ']' 00:17:14.225 15:41:05 -- common/autotest_common.sh@940 -- # kill -0 885344 00:17:14.225 15:41:05 -- common/autotest_common.sh@941 -- # uname 00:17:14.225 15:41:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:14.225 15:41:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 885344 00:17:14.225 15:41:05 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:14.225 15:41:05 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:14.225 15:41:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 885344' 00:17:14.225 killing process with pid 885344 00:17:14.225 15:41:05 -- common/autotest_common.sh@955 -- # kill 885344 00:17:14.225 Received shutdown signal, test time was about 10.000000 seconds 00:17:14.225 00:17:14.225 Latency(us) 00:17:14.225 [2024-11-26T14:41:05.678Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:14.225 [2024-11-26T14:41:05.678Z] =================================================================================================================== 00:17:14.225 [2024-11-26T14:41:05.678Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:14.225 15:41:05 -- common/autotest_common.sh@960 -- # wait 885344 00:17:14.484 15:41:05 -- target/tls.sh@37 -- # return 1 00:17:14.484 15:41:05 -- common/autotest_common.sh@653 -- # es=1 00:17:14.484 15:41:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:14.484 15:41:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:14.484 15:41:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:14.484 15:41:05 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:14.484 15:41:05 -- common/autotest_common.sh@650 -- # local es=0 00:17:14.484 15:41:05 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:14.484 15:41:05 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:14.484 15:41:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:14.484 15:41:05 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:14.484 15:41:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:14.484 15:41:05 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:14.484 15:41:05 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:14.484 15:41:05 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:14.484 15:41:05 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:14.484 15:41:05 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:14.484 15:41:05 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:14.484 15:41:05 -- target/tls.sh@28 -- # bdevperf_pid=885489 00:17:14.484 15:41:05 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:14.484 15:41:05 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:14.484 15:41:05 -- target/tls.sh@31 -- # waitforlisten 885489 /var/tmp/bdevperf.sock 00:17:14.484 15:41:05 -- common/autotest_common.sh@829 -- # '[' -z 885489 ']' 00:17:14.484 15:41:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:14.484 15:41:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:14.484 15:41:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:14.484 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:14.484 15:41:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:14.484 15:41:05 -- common/autotest_common.sh@10 -- # set +x 00:17:14.484 [2024-11-26 15:41:05.883146] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:14.484 [2024-11-26 15:41:05.883225] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid885489 ] 00:17:14.484 EAL: No free 2048 kB hugepages reported on node 1 00:17:14.743 [2024-11-26 15:41:05.941427] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:14.743 [2024-11-26 15:41:06.047045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:15.676 15:41:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:15.676 15:41:06 -- common/autotest_common.sh@862 -- # return 0 00:17:15.676 15:41:06 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:15.933 [2024-11-26 15:41:07.193143] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:15.933 [2024-11-26 15:41:07.200522] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:15.933 [2024-11-26 15:41:07.200552] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:15.933 [2024-11-26 15:41:07.200606] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:15.934 [2024-11-26 15:41:07.200979] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xac21f0 (107): Transport endpoint is not connected 00:17:15.934 [2024-11-26 15:41:07.201968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xac21f0 (9): Bad file descriptor 00:17:15.934 [2024-11-26 15:41:07.202976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:15.934 [2024-11-26 15:41:07.202996] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:15.934 [2024-11-26 15:41:07.203011] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:15.934 request: 00:17:15.934 { 00:17:15.934 "name": "TLSTEST", 00:17:15.934 "trtype": "tcp", 00:17:15.934 "traddr": "10.0.0.2", 00:17:15.934 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:15.934 "adrfam": "ipv4", 00:17:15.934 "trsvcid": "4420", 00:17:15.934 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:15.934 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:15.934 "method": "bdev_nvme_attach_controller", 00:17:15.934 "req_id": 1 00:17:15.934 } 00:17:15.934 Got JSON-RPC error response 00:17:15.934 response: 00:17:15.934 { 00:17:15.934 "code": -32602, 00:17:15.934 "message": "Invalid parameters" 00:17:15.934 } 00:17:15.934 15:41:07 -- target/tls.sh@36 -- # killprocess 885489 00:17:15.934 15:41:07 -- common/autotest_common.sh@936 -- # '[' -z 885489 ']' 00:17:15.934 15:41:07 -- common/autotest_common.sh@940 -- # kill -0 885489 00:17:15.934 15:41:07 -- common/autotest_common.sh@941 -- # uname 00:17:15.934 15:41:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:15.934 15:41:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 885489 00:17:15.934 15:41:07 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:15.934 15:41:07 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:15.934 15:41:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 885489' 00:17:15.934 killing process with pid 885489 00:17:15.934 15:41:07 -- common/autotest_common.sh@955 -- # kill 885489 00:17:15.934 Received shutdown signal, test time was about 10.000000 seconds 00:17:15.934 00:17:15.934 Latency(us) 00:17:15.934 [2024-11-26T14:41:07.387Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:15.934 [2024-11-26T14:41:07.387Z] =================================================================================================================== 00:17:15.934 [2024-11-26T14:41:07.387Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:15.934 15:41:07 -- common/autotest_common.sh@960 -- # wait 885489 00:17:16.192 15:41:07 -- target/tls.sh@37 -- # return 1 00:17:16.192 15:41:07 -- common/autotest_common.sh@653 -- # es=1 00:17:16.192 15:41:07 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:16.192 15:41:07 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:16.192 15:41:07 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:16.192 15:41:07 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:16.192 15:41:07 -- common/autotest_common.sh@650 -- # local es=0 00:17:16.192 15:41:07 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:16.192 15:41:07 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:16.192 15:41:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:16.192 15:41:07 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:16.192 15:41:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:16.192 15:41:07 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:16.192 15:41:07 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:16.192 15:41:07 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:16.192 15:41:07 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:16.192 15:41:07 -- target/tls.sh@23 -- # psk= 00:17:16.192 15:41:07 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:16.192 15:41:07 -- target/tls.sh@28 -- # bdevperf_pid=885750 00:17:16.192 15:41:07 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:16.192 15:41:07 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:16.192 15:41:07 -- target/tls.sh@31 -- # waitforlisten 885750 /var/tmp/bdevperf.sock 00:17:16.192 15:41:07 -- common/autotest_common.sh@829 -- # '[' -z 885750 ']' 00:17:16.192 15:41:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:16.192 15:41:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:16.192 15:41:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:16.192 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:16.192 15:41:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:16.192 15:41:07 -- common/autotest_common.sh@10 -- # set +x 00:17:16.192 [2024-11-26 15:41:07.541177] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:16.192 [2024-11-26 15:41:07.541250] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid885750 ] 00:17:16.192 EAL: No free 2048 kB hugepages reported on node 1 00:17:16.192 [2024-11-26 15:41:07.598492] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:16.451 [2024-11-26 15:41:07.705798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:17.439 15:41:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:17.439 15:41:08 -- common/autotest_common.sh@862 -- # return 0 00:17:17.439 15:41:08 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:17.439 [2024-11-26 15:41:08.834854] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:17.439 [2024-11-26 15:41:08.836866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1e050 (9): Bad file descriptor 00:17:17.439 [2024-11-26 15:41:08.837862] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:17.439 [2024-11-26 15:41:08.837884] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:17.439 [2024-11-26 15:41:08.837899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:17.439 request: 00:17:17.439 { 00:17:17.439 "name": "TLSTEST", 00:17:17.439 "trtype": "tcp", 00:17:17.439 "traddr": "10.0.0.2", 00:17:17.439 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:17.439 "adrfam": "ipv4", 00:17:17.439 "trsvcid": "4420", 00:17:17.439 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:17.439 "method": "bdev_nvme_attach_controller", 00:17:17.439 "req_id": 1 00:17:17.439 } 00:17:17.439 Got JSON-RPC error response 00:17:17.439 response: 00:17:17.439 { 00:17:17.439 "code": -32602, 00:17:17.439 "message": "Invalid parameters" 00:17:17.439 } 00:17:17.439 15:41:08 -- target/tls.sh@36 -- # killprocess 885750 00:17:17.439 15:41:08 -- common/autotest_common.sh@936 -- # '[' -z 885750 ']' 00:17:17.439 15:41:08 -- common/autotest_common.sh@940 -- # kill -0 885750 00:17:17.439 15:41:08 -- common/autotest_common.sh@941 -- # uname 00:17:17.439 15:41:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:17.439 15:41:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 885750 00:17:17.697 15:41:08 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:17.697 15:41:08 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:17.697 15:41:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 885750' 00:17:17.697 killing process with pid 885750 00:17:17.697 15:41:08 -- common/autotest_common.sh@955 -- # kill 885750 00:17:17.697 Received shutdown signal, test time was about 10.000000 seconds 00:17:17.697 00:17:17.697 Latency(us) 00:17:17.697 [2024-11-26T14:41:09.150Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:17.697 [2024-11-26T14:41:09.150Z] =================================================================================================================== 00:17:17.697 [2024-11-26T14:41:09.150Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:17.697 15:41:08 -- common/autotest_common.sh@960 -- # wait 885750 00:17:17.954 15:41:09 -- target/tls.sh@37 -- # return 1 00:17:17.954 15:41:09 -- common/autotest_common.sh@653 -- # es=1 00:17:17.954 15:41:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:17.954 15:41:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:17.954 15:41:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:17.954 15:41:09 -- target/tls.sh@167 -- # killprocess 881910 00:17:17.954 15:41:09 -- common/autotest_common.sh@936 -- # '[' -z 881910 ']' 00:17:17.954 15:41:09 -- common/autotest_common.sh@940 -- # kill -0 881910 00:17:17.954 15:41:09 -- common/autotest_common.sh@941 -- # uname 00:17:17.954 15:41:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:17.954 15:41:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 881910 00:17:17.954 15:41:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:17.954 15:41:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:17.954 15:41:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 881910' 00:17:17.954 killing process with pid 881910 00:17:17.954 15:41:09 -- common/autotest_common.sh@955 -- # kill 881910 00:17:17.954 15:41:09 -- common/autotest_common.sh@960 -- # wait 881910 00:17:18.212 15:41:09 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:18.212 15:41:09 -- target/tls.sh@49 -- # local key hash crc 00:17:18.212 15:41:09 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:18.212 15:41:09 -- target/tls.sh@51 -- # hash=02 00:17:18.212 15:41:09 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:18.212 15:41:09 -- target/tls.sh@52 -- # gzip -1 -c 00:17:18.212 15:41:09 -- target/tls.sh@52 -- # tail -c8 00:17:18.212 15:41:09 -- target/tls.sh@52 -- # head -c 4 00:17:18.212 15:41:09 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:18.212 15:41:09 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:18.212 15:41:09 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:18.212 15:41:09 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:18.212 15:41:09 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:18.212 15:41:09 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:18.212 15:41:09 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:18.212 15:41:09 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:18.212 15:41:09 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:18.212 15:41:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:18.212 15:41:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:18.212 15:41:09 -- common/autotest_common.sh@10 -- # set +x 00:17:18.212 15:41:09 -- nvmf/common.sh@469 -- # nvmfpid=885918 00:17:18.212 15:41:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:18.212 15:41:09 -- nvmf/common.sh@470 -- # waitforlisten 885918 00:17:18.212 15:41:09 -- common/autotest_common.sh@829 -- # '[' -z 885918 ']' 00:17:18.212 15:41:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:18.212 15:41:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:18.212 15:41:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:18.212 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:18.212 15:41:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:18.212 15:41:09 -- common/autotest_common.sh@10 -- # set +x 00:17:18.212 [2024-11-26 15:41:09.561833] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:18.213 [2024-11-26 15:41:09.561932] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:18.213 EAL: No free 2048 kB hugepages reported on node 1 00:17:18.213 [2024-11-26 15:41:09.624892] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:18.471 [2024-11-26 15:41:09.732241] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:18.471 [2024-11-26 15:41:09.732422] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:18.471 [2024-11-26 15:41:09.732439] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:18.471 [2024-11-26 15:41:09.732452] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:18.471 [2024-11-26 15:41:09.732480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:19.406 15:41:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:19.406 15:41:10 -- common/autotest_common.sh@862 -- # return 0 00:17:19.406 15:41:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:19.406 15:41:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:19.406 15:41:10 -- common/autotest_common.sh@10 -- # set +x 00:17:19.406 15:41:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:19.406 15:41:10 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:19.406 15:41:10 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:19.406 15:41:10 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:19.406 [2024-11-26 15:41:10.799068] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:19.406 15:41:10 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:19.664 15:41:11 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:19.922 [2024-11-26 15:41:11.348538] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:19.922 [2024-11-26 15:41:11.348821] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:19.922 15:41:11 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:20.181 malloc0 00:17:20.181 15:41:11 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:20.748 15:41:11 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:20.748 15:41:12 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:20.748 15:41:12 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:20.748 15:41:12 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:20.748 15:41:12 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:20.748 15:41:12 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:20.748 15:41:12 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:20.748 15:41:12 -- target/tls.sh@28 -- # bdevperf_pid=886325 00:17:20.748 15:41:12 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:20.748 15:41:12 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:20.749 15:41:12 -- target/tls.sh@31 -- # waitforlisten 886325 /var/tmp/bdevperf.sock 00:17:20.749 15:41:12 -- common/autotest_common.sh@829 -- # '[' -z 886325 ']' 00:17:20.749 15:41:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:20.749 15:41:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:20.749 15:41:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:20.749 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:20.749 15:41:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:20.749 15:41:12 -- common/autotest_common.sh@10 -- # set +x 00:17:21.007 [2024-11-26 15:41:12.225277] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:21.007 [2024-11-26 15:41:12.225349] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid886325 ] 00:17:21.007 EAL: No free 2048 kB hugepages reported on node 1 00:17:21.007 [2024-11-26 15:41:12.282504] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:21.007 [2024-11-26 15:41:12.386030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:21.941 15:41:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:21.941 15:41:13 -- common/autotest_common.sh@862 -- # return 0 00:17:21.941 15:41:13 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:22.199 [2024-11-26 15:41:13.443794] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:22.199 TLSTESTn1 00:17:22.199 15:41:13 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:22.199 Running I/O for 10 seconds... 00:17:34.394 00:17:34.394 Latency(us) 00:17:34.394 [2024-11-26T14:41:25.847Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:34.394 [2024-11-26T14:41:25.847Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:34.394 Verification LBA range: start 0x0 length 0x2000 00:17:34.394 TLSTESTn1 : 10.02 4279.00 16.71 0.00 0.00 29877.93 5461.33 46020.84 00:17:34.394 [2024-11-26T14:41:25.847Z] =================================================================================================================== 00:17:34.394 [2024-11-26T14:41:25.847Z] Total : 4279.00 16.71 0.00 0.00 29877.93 5461.33 46020.84 00:17:34.394 0 00:17:34.394 15:41:23 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:34.394 15:41:23 -- target/tls.sh@45 -- # killprocess 886325 00:17:34.394 15:41:23 -- common/autotest_common.sh@936 -- # '[' -z 886325 ']' 00:17:34.394 15:41:23 -- common/autotest_common.sh@940 -- # kill -0 886325 00:17:34.394 15:41:23 -- common/autotest_common.sh@941 -- # uname 00:17:34.394 15:41:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:34.394 15:41:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 886325 00:17:34.394 15:41:23 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:34.394 15:41:23 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:34.394 15:41:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 886325' 00:17:34.394 killing process with pid 886325 00:17:34.394 15:41:23 -- common/autotest_common.sh@955 -- # kill 886325 00:17:34.394 Received shutdown signal, test time was about 10.000000 seconds 00:17:34.394 00:17:34.394 Latency(us) 00:17:34.394 [2024-11-26T14:41:25.847Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:34.394 [2024-11-26T14:41:25.847Z] =================================================================================================================== 00:17:34.394 [2024-11-26T14:41:25.847Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:34.394 15:41:23 -- common/autotest_common.sh@960 -- # wait 886325 00:17:34.394 15:41:23 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:34.394 15:41:23 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:34.394 15:41:23 -- common/autotest_common.sh@650 -- # local es=0 00:17:34.394 15:41:23 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:34.394 15:41:23 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:34.394 15:41:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:34.394 15:41:23 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:34.394 15:41:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:34.394 15:41:23 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:34.394 15:41:23 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:34.394 15:41:23 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:34.394 15:41:23 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:34.394 15:41:23 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:34.394 15:41:23 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:34.394 15:41:23 -- target/tls.sh@28 -- # bdevperf_pid=887625 00:17:34.394 15:41:23 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:34.394 15:41:23 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:34.394 15:41:23 -- target/tls.sh@31 -- # waitforlisten 887625 /var/tmp/bdevperf.sock 00:17:34.394 15:41:23 -- common/autotest_common.sh@829 -- # '[' -z 887625 ']' 00:17:34.394 15:41:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:34.394 15:41:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:34.394 15:41:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:34.394 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:34.394 15:41:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:34.394 15:41:23 -- common/autotest_common.sh@10 -- # set +x 00:17:34.394 [2024-11-26 15:41:24.033870] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:34.394 [2024-11-26 15:41:24.033941] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid887625 ] 00:17:34.394 EAL: No free 2048 kB hugepages reported on node 1 00:17:34.394 [2024-11-26 15:41:24.089578] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:34.395 [2024-11-26 15:41:24.190000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:34.395 15:41:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:34.395 15:41:24 -- common/autotest_common.sh@862 -- # return 0 00:17:34.395 15:41:24 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:34.395 [2024-11-26 15:41:25.208772] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:34.395 [2024-11-26 15:41:25.208838] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:34.395 request: 00:17:34.395 { 00:17:34.395 "name": "TLSTEST", 00:17:34.395 "trtype": "tcp", 00:17:34.395 "traddr": "10.0.0.2", 00:17:34.395 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:34.395 "adrfam": "ipv4", 00:17:34.395 "trsvcid": "4420", 00:17:34.395 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:34.395 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:34.395 "method": "bdev_nvme_attach_controller", 00:17:34.395 "req_id": 1 00:17:34.395 } 00:17:34.395 Got JSON-RPC error response 00:17:34.395 response: 00:17:34.395 { 00:17:34.395 "code": -22, 00:17:34.395 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:34.395 } 00:17:34.395 15:41:25 -- target/tls.sh@36 -- # killprocess 887625 00:17:34.395 15:41:25 -- common/autotest_common.sh@936 -- # '[' -z 887625 ']' 00:17:34.395 15:41:25 -- common/autotest_common.sh@940 -- # kill -0 887625 00:17:34.395 15:41:25 -- common/autotest_common.sh@941 -- # uname 00:17:34.395 15:41:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:34.395 15:41:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 887625 00:17:34.395 15:41:25 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:34.395 15:41:25 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:34.395 15:41:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 887625' 00:17:34.395 killing process with pid 887625 00:17:34.395 15:41:25 -- common/autotest_common.sh@955 -- # kill 887625 00:17:34.395 Received shutdown signal, test time was about 10.000000 seconds 00:17:34.395 00:17:34.395 Latency(us) 00:17:34.395 [2024-11-26T14:41:25.848Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:34.395 [2024-11-26T14:41:25.848Z] =================================================================================================================== 00:17:34.395 [2024-11-26T14:41:25.848Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:34.395 15:41:25 -- common/autotest_common.sh@960 -- # wait 887625 00:17:34.395 15:41:25 -- target/tls.sh@37 -- # return 1 00:17:34.395 15:41:25 -- common/autotest_common.sh@653 -- # es=1 00:17:34.395 15:41:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:34.395 15:41:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:34.395 15:41:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:34.395 15:41:25 -- target/tls.sh@183 -- # killprocess 885918 00:17:34.395 15:41:25 -- common/autotest_common.sh@936 -- # '[' -z 885918 ']' 00:17:34.395 15:41:25 -- common/autotest_common.sh@940 -- # kill -0 885918 00:17:34.395 15:41:25 -- common/autotest_common.sh@941 -- # uname 00:17:34.395 15:41:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:34.395 15:41:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 885918 00:17:34.395 15:41:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:34.395 15:41:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:34.395 15:41:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 885918' 00:17:34.395 killing process with pid 885918 00:17:34.395 15:41:25 -- common/autotest_common.sh@955 -- # kill 885918 00:17:34.395 15:41:25 -- common/autotest_common.sh@960 -- # wait 885918 00:17:34.653 15:41:25 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:17:34.653 15:41:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:34.653 15:41:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:34.653 15:41:25 -- common/autotest_common.sh@10 -- # set +x 00:17:34.653 15:41:25 -- nvmf/common.sh@469 -- # nvmfpid=887890 00:17:34.653 15:41:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:34.653 15:41:25 -- nvmf/common.sh@470 -- # waitforlisten 887890 00:17:34.653 15:41:25 -- common/autotest_common.sh@829 -- # '[' -z 887890 ']' 00:17:34.653 15:41:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:34.653 15:41:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:34.653 15:41:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:34.653 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:34.653 15:41:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:34.653 15:41:25 -- common/autotest_common.sh@10 -- # set +x 00:17:34.653 [2024-11-26 15:41:25.897333] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:34.653 [2024-11-26 15:41:25.897407] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:34.653 EAL: No free 2048 kB hugepages reported on node 1 00:17:34.653 [2024-11-26 15:41:25.964678] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:34.653 [2024-11-26 15:41:26.077515] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:34.653 [2024-11-26 15:41:26.077667] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:34.653 [2024-11-26 15:41:26.077710] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:34.653 [2024-11-26 15:41:26.077741] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:34.653 [2024-11-26 15:41:26.077770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:35.588 15:41:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:35.588 15:41:26 -- common/autotest_common.sh@862 -- # return 0 00:17:35.588 15:41:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:35.588 15:41:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:35.588 15:41:26 -- common/autotest_common.sh@10 -- # set +x 00:17:35.588 15:41:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:35.588 15:41:26 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:35.588 15:41:26 -- common/autotest_common.sh@650 -- # local es=0 00:17:35.588 15:41:26 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:35.588 15:41:26 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:17:35.588 15:41:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:35.588 15:41:26 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:17:35.588 15:41:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:35.588 15:41:26 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:35.588 15:41:26 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:35.588 15:41:26 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:35.845 [2024-11-26 15:41:27.107709] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:35.845 15:41:27 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:36.103 15:41:27 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:36.361 [2024-11-26 15:41:27.597011] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:36.361 [2024-11-26 15:41:27.597272] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:36.361 15:41:27 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:36.619 malloc0 00:17:36.619 15:41:27 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:36.877 15:41:28 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:37.134 [2024-11-26 15:41:28.376056] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:37.134 [2024-11-26 15:41:28.376104] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:17:37.135 [2024-11-26 15:41:28.376128] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:17:37.135 request: 00:17:37.135 { 00:17:37.135 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:37.135 "host": "nqn.2016-06.io.spdk:host1", 00:17:37.135 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:37.135 "method": "nvmf_subsystem_add_host", 00:17:37.135 "req_id": 1 00:17:37.135 } 00:17:37.135 Got JSON-RPC error response 00:17:37.135 response: 00:17:37.135 { 00:17:37.135 "code": -32603, 00:17:37.135 "message": "Internal error" 00:17:37.135 } 00:17:37.135 15:41:28 -- common/autotest_common.sh@653 -- # es=1 00:17:37.135 15:41:28 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:37.135 15:41:28 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:37.135 15:41:28 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:37.135 15:41:28 -- target/tls.sh@189 -- # killprocess 887890 00:17:37.135 15:41:28 -- common/autotest_common.sh@936 -- # '[' -z 887890 ']' 00:17:37.135 15:41:28 -- common/autotest_common.sh@940 -- # kill -0 887890 00:17:37.135 15:41:28 -- common/autotest_common.sh@941 -- # uname 00:17:37.135 15:41:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:37.135 15:41:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 887890 00:17:37.135 15:41:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:37.135 15:41:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:37.135 15:41:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 887890' 00:17:37.135 killing process with pid 887890 00:17:37.135 15:41:28 -- common/autotest_common.sh@955 -- # kill 887890 00:17:37.135 15:41:28 -- common/autotest_common.sh@960 -- # wait 887890 00:17:37.392 15:41:28 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:37.392 15:41:28 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:17:37.392 15:41:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:37.392 15:41:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:37.392 15:41:28 -- common/autotest_common.sh@10 -- # set +x 00:17:37.392 15:41:28 -- nvmf/common.sh@469 -- # nvmfpid=888190 00:17:37.392 15:41:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:37.392 15:41:28 -- nvmf/common.sh@470 -- # waitforlisten 888190 00:17:37.392 15:41:28 -- common/autotest_common.sh@829 -- # '[' -z 888190 ']' 00:17:37.392 15:41:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:37.392 15:41:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:37.392 15:41:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:37.392 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:37.392 15:41:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:37.392 15:41:28 -- common/autotest_common.sh@10 -- # set +x 00:17:37.392 [2024-11-26 15:41:28.791120] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:37.392 [2024-11-26 15:41:28.791186] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:37.392 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.650 [2024-11-26 15:41:28.861088] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:37.650 [2024-11-26 15:41:28.978053] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:37.650 [2024-11-26 15:41:28.978236] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:37.650 [2024-11-26 15:41:28.978254] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:37.650 [2024-11-26 15:41:28.978283] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:37.650 [2024-11-26 15:41:28.978323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:38.584 15:41:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:38.584 15:41:29 -- common/autotest_common.sh@862 -- # return 0 00:17:38.584 15:41:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:38.584 15:41:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:38.584 15:41:29 -- common/autotest_common.sh@10 -- # set +x 00:17:38.584 15:41:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:38.584 15:41:29 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:38.584 15:41:29 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:38.584 15:41:29 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:38.842 [2024-11-26 15:41:30.080225] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:38.842 15:41:30 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:39.100 15:41:30 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:39.357 [2024-11-26 15:41:30.597609] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:39.357 [2024-11-26 15:41:30.597901] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:39.357 15:41:30 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:39.616 malloc0 00:17:39.616 15:41:30 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:39.873 15:41:31 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:40.132 15:41:31 -- target/tls.sh@197 -- # bdevperf_pid=888595 00:17:40.132 15:41:31 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:40.132 15:41:31 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:40.132 15:41:31 -- target/tls.sh@200 -- # waitforlisten 888595 /var/tmp/bdevperf.sock 00:17:40.132 15:41:31 -- common/autotest_common.sh@829 -- # '[' -z 888595 ']' 00:17:40.132 15:41:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:40.132 15:41:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:40.132 15:41:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:40.132 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:40.132 15:41:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:40.132 15:41:31 -- common/autotest_common.sh@10 -- # set +x 00:17:40.132 [2024-11-26 15:41:31.409569] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:40.132 [2024-11-26 15:41:31.409635] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid888595 ] 00:17:40.132 EAL: No free 2048 kB hugepages reported on node 1 00:17:40.132 [2024-11-26 15:41:31.465036] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:40.132 [2024-11-26 15:41:31.567163] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:41.067 15:41:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:41.067 15:41:32 -- common/autotest_common.sh@862 -- # return 0 00:17:41.067 15:41:32 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:41.326 [2024-11-26 15:41:32.602135] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:41.326 TLSTESTn1 00:17:41.326 15:41:32 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:17:41.584 15:41:33 -- target/tls.sh@205 -- # tgtconf='{ 00:17:41.584 "subsystems": [ 00:17:41.584 { 00:17:41.584 "subsystem": "iobuf", 00:17:41.584 "config": [ 00:17:41.584 { 00:17:41.584 "method": "iobuf_set_options", 00:17:41.584 "params": { 00:17:41.584 "small_pool_count": 8192, 00:17:41.584 "large_pool_count": 1024, 00:17:41.584 "small_bufsize": 8192, 00:17:41.584 "large_bufsize": 135168 00:17:41.584 } 00:17:41.584 } 00:17:41.584 ] 00:17:41.584 }, 00:17:41.584 { 00:17:41.584 "subsystem": "sock", 00:17:41.584 "config": [ 00:17:41.584 { 00:17:41.584 "method": "sock_impl_set_options", 00:17:41.584 "params": { 00:17:41.584 "impl_name": "posix", 00:17:41.584 "recv_buf_size": 2097152, 00:17:41.584 "send_buf_size": 2097152, 00:17:41.584 "enable_recv_pipe": true, 00:17:41.584 "enable_quickack": false, 00:17:41.584 "enable_placement_id": 0, 00:17:41.584 "enable_zerocopy_send_server": true, 00:17:41.584 "enable_zerocopy_send_client": false, 00:17:41.584 "zerocopy_threshold": 0, 00:17:41.584 "tls_version": 0, 00:17:41.584 "enable_ktls": false 00:17:41.584 } 00:17:41.584 }, 00:17:41.584 { 00:17:41.584 "method": "sock_impl_set_options", 00:17:41.584 "params": { 00:17:41.584 "impl_name": "ssl", 00:17:41.584 "recv_buf_size": 4096, 00:17:41.584 "send_buf_size": 4096, 00:17:41.584 "enable_recv_pipe": true, 00:17:41.584 "enable_quickack": false, 00:17:41.584 "enable_placement_id": 0, 00:17:41.584 "enable_zerocopy_send_server": true, 00:17:41.584 "enable_zerocopy_send_client": false, 00:17:41.584 "zerocopy_threshold": 0, 00:17:41.584 "tls_version": 0, 00:17:41.584 "enable_ktls": false 00:17:41.584 } 00:17:41.584 } 00:17:41.584 ] 00:17:41.584 }, 00:17:41.584 { 00:17:41.584 "subsystem": "vmd", 00:17:41.584 "config": [] 00:17:41.584 }, 00:17:41.584 { 00:17:41.584 "subsystem": "accel", 00:17:41.584 "config": [ 00:17:41.584 { 00:17:41.584 "method": "accel_set_options", 00:17:41.584 "params": { 00:17:41.584 "small_cache_size": 128, 00:17:41.584 "large_cache_size": 16, 00:17:41.584 "task_count": 2048, 00:17:41.584 "sequence_count": 2048, 00:17:41.584 "buf_count": 2048 00:17:41.584 } 00:17:41.584 } 00:17:41.584 ] 00:17:41.584 }, 00:17:41.584 { 00:17:41.584 "subsystem": "bdev", 00:17:41.584 "config": [ 00:17:41.584 { 00:17:41.584 "method": "bdev_set_options", 00:17:41.584 "params": { 00:17:41.584 "bdev_io_pool_size": 65535, 00:17:41.584 "bdev_io_cache_size": 256, 00:17:41.584 "bdev_auto_examine": true, 00:17:41.584 "iobuf_small_cache_size": 128, 00:17:41.584 "iobuf_large_cache_size": 16 00:17:41.584 } 00:17:41.584 }, 00:17:41.584 { 00:17:41.584 "method": "bdev_raid_set_options", 00:17:41.584 "params": { 00:17:41.584 "process_window_size_kb": 1024 00:17:41.584 } 00:17:41.584 }, 00:17:41.584 { 00:17:41.584 "method": "bdev_iscsi_set_options", 00:17:41.584 "params": { 00:17:41.584 "timeout_sec": 30 00:17:41.584 } 00:17:41.584 }, 00:17:41.584 { 00:17:41.584 "method": "bdev_nvme_set_options", 00:17:41.584 "params": { 00:17:41.584 "action_on_timeout": "none", 00:17:41.584 "timeout_us": 0, 00:17:41.584 "timeout_admin_us": 0, 00:17:41.584 "keep_alive_timeout_ms": 10000, 00:17:41.584 "transport_retry_count": 4, 00:17:41.584 "arbitration_burst": 0, 00:17:41.584 "low_priority_weight": 0, 00:17:41.584 "medium_priority_weight": 0, 00:17:41.584 "high_priority_weight": 0, 00:17:41.584 "nvme_adminq_poll_period_us": 10000, 00:17:41.584 "nvme_ioq_poll_period_us": 0, 00:17:41.584 "io_queue_requests": 0, 00:17:41.584 "delay_cmd_submit": true, 00:17:41.584 "bdev_retry_count": 3, 00:17:41.584 "transport_ack_timeout": 0, 00:17:41.584 "ctrlr_loss_timeout_sec": 0, 00:17:41.584 "reconnect_delay_sec": 0, 00:17:41.585 "fast_io_fail_timeout_sec": 0, 00:17:41.585 "generate_uuids": false, 00:17:41.585 "transport_tos": 0, 00:17:41.585 "io_path_stat": false, 00:17:41.585 "allow_accel_sequence": false 00:17:41.585 } 00:17:41.585 }, 00:17:41.585 { 00:17:41.585 "method": "bdev_nvme_set_hotplug", 00:17:41.585 "params": { 00:17:41.585 "period_us": 100000, 00:17:41.585 "enable": false 00:17:41.585 } 00:17:41.585 }, 00:17:41.585 { 00:17:41.585 "method": "bdev_malloc_create", 00:17:41.585 "params": { 00:17:41.585 "name": "malloc0", 00:17:41.585 "num_blocks": 8192, 00:17:41.585 "block_size": 4096, 00:17:41.585 "physical_block_size": 4096, 00:17:41.585 "uuid": "09a7e9fd-d4ec-4ec1-a271-bf2dc51831fb", 00:17:41.585 "optimal_io_boundary": 0 00:17:41.585 } 00:17:41.585 }, 00:17:41.585 { 00:17:41.585 "method": "bdev_wait_for_examine" 00:17:41.585 } 00:17:41.585 ] 00:17:41.585 }, 00:17:41.585 { 00:17:41.585 "subsystem": "nbd", 00:17:41.585 "config": [] 00:17:41.585 }, 00:17:41.585 { 00:17:41.585 "subsystem": "scheduler", 00:17:41.585 "config": [ 00:17:41.585 { 00:17:41.585 "method": "framework_set_scheduler", 00:17:41.585 "params": { 00:17:41.585 "name": "static" 00:17:41.585 } 00:17:41.585 } 00:17:41.585 ] 00:17:41.585 }, 00:17:41.585 { 00:17:41.585 "subsystem": "nvmf", 00:17:41.585 "config": [ 00:17:41.585 { 00:17:41.585 "method": "nvmf_set_config", 00:17:41.585 "params": { 00:17:41.585 "discovery_filter": "match_any", 00:17:41.585 "admin_cmd_passthru": { 00:17:41.585 "identify_ctrlr": false 00:17:41.585 } 00:17:41.585 } 00:17:41.585 }, 00:17:41.585 { 00:17:41.585 "method": "nvmf_set_max_subsystems", 00:17:41.585 "params": { 00:17:41.585 "max_subsystems": 1024 00:17:41.585 } 00:17:41.585 }, 00:17:41.585 { 00:17:41.585 "method": "nvmf_set_crdt", 00:17:41.585 "params": { 00:17:41.585 "crdt1": 0, 00:17:41.585 "crdt2": 0, 00:17:41.585 "crdt3": 0 00:17:41.585 } 00:17:41.585 }, 00:17:41.585 { 00:17:41.585 "method": "nvmf_create_transport", 00:17:41.585 "params": { 00:17:41.585 "trtype": "TCP", 00:17:41.585 "max_queue_depth": 128, 00:17:41.585 "max_io_qpairs_per_ctrlr": 127, 00:17:41.585 "in_capsule_data_size": 4096, 00:17:41.585 "max_io_size": 131072, 00:17:41.585 "io_unit_size": 131072, 00:17:41.585 "max_aq_depth": 128, 00:17:41.585 "num_shared_buffers": 511, 00:17:41.585 "buf_cache_size": 4294967295, 00:17:41.585 "dif_insert_or_strip": false, 00:17:41.585 "zcopy": false, 00:17:41.585 "c2h_success": false, 00:17:41.585 "sock_priority": 0, 00:17:41.585 "abort_timeout_sec": 1 00:17:41.585 } 00:17:41.585 }, 00:17:41.585 { 00:17:41.585 "method": "nvmf_create_subsystem", 00:17:41.585 "params": { 00:17:41.585 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:41.585 "allow_any_host": false, 00:17:41.585 "serial_number": "SPDK00000000000001", 00:17:41.585 "model_number": "SPDK bdev Controller", 00:17:41.585 "max_namespaces": 10, 00:17:41.585 "min_cntlid": 1, 00:17:41.585 "max_cntlid": 65519, 00:17:41.585 "ana_reporting": false 00:17:41.585 } 00:17:41.585 }, 00:17:41.585 { 00:17:41.585 "method": "nvmf_subsystem_add_host", 00:17:41.585 "params": { 00:17:41.585 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:41.585 "host": "nqn.2016-06.io.spdk:host1", 00:17:41.585 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:41.585 } 00:17:41.585 }, 00:17:41.585 { 00:17:41.585 "method": "nvmf_subsystem_add_ns", 00:17:41.585 "params": { 00:17:41.585 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:41.585 "namespace": { 00:17:41.585 "nsid": 1, 00:17:41.585 "bdev_name": "malloc0", 00:17:41.585 "nguid": "09A7E9FDD4EC4EC1A271BF2DC51831FB", 00:17:41.585 "uuid": "09a7e9fd-d4ec-4ec1-a271-bf2dc51831fb" 00:17:41.585 } 00:17:41.585 } 00:17:41.585 }, 00:17:41.585 { 00:17:41.585 "method": "nvmf_subsystem_add_listener", 00:17:41.585 "params": { 00:17:41.585 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:41.585 "listen_address": { 00:17:41.585 "trtype": "TCP", 00:17:41.585 "adrfam": "IPv4", 00:17:41.585 "traddr": "10.0.0.2", 00:17:41.585 "trsvcid": "4420" 00:17:41.585 }, 00:17:41.585 "secure_channel": true 00:17:41.585 } 00:17:41.585 } 00:17:41.585 ] 00:17:41.585 } 00:17:41.585 ] 00:17:41.585 }' 00:17:41.585 15:41:33 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:17:42.153 15:41:33 -- target/tls.sh@206 -- # bdevperfconf='{ 00:17:42.153 "subsystems": [ 00:17:42.153 { 00:17:42.153 "subsystem": "iobuf", 00:17:42.153 "config": [ 00:17:42.153 { 00:17:42.153 "method": "iobuf_set_options", 00:17:42.153 "params": { 00:17:42.153 "small_pool_count": 8192, 00:17:42.153 "large_pool_count": 1024, 00:17:42.153 "small_bufsize": 8192, 00:17:42.153 "large_bufsize": 135168 00:17:42.153 } 00:17:42.153 } 00:17:42.153 ] 00:17:42.153 }, 00:17:42.153 { 00:17:42.153 "subsystem": "sock", 00:17:42.153 "config": [ 00:17:42.153 { 00:17:42.153 "method": "sock_impl_set_options", 00:17:42.153 "params": { 00:17:42.153 "impl_name": "posix", 00:17:42.153 "recv_buf_size": 2097152, 00:17:42.153 "send_buf_size": 2097152, 00:17:42.153 "enable_recv_pipe": true, 00:17:42.153 "enable_quickack": false, 00:17:42.153 "enable_placement_id": 0, 00:17:42.153 "enable_zerocopy_send_server": true, 00:17:42.153 "enable_zerocopy_send_client": false, 00:17:42.153 "zerocopy_threshold": 0, 00:17:42.153 "tls_version": 0, 00:17:42.153 "enable_ktls": false 00:17:42.153 } 00:17:42.153 }, 00:17:42.153 { 00:17:42.153 "method": "sock_impl_set_options", 00:17:42.153 "params": { 00:17:42.153 "impl_name": "ssl", 00:17:42.153 "recv_buf_size": 4096, 00:17:42.153 "send_buf_size": 4096, 00:17:42.153 "enable_recv_pipe": true, 00:17:42.153 "enable_quickack": false, 00:17:42.153 "enable_placement_id": 0, 00:17:42.153 "enable_zerocopy_send_server": true, 00:17:42.153 "enable_zerocopy_send_client": false, 00:17:42.153 "zerocopy_threshold": 0, 00:17:42.153 "tls_version": 0, 00:17:42.153 "enable_ktls": false 00:17:42.153 } 00:17:42.153 } 00:17:42.153 ] 00:17:42.153 }, 00:17:42.153 { 00:17:42.153 "subsystem": "vmd", 00:17:42.153 "config": [] 00:17:42.153 }, 00:17:42.153 { 00:17:42.153 "subsystem": "accel", 00:17:42.153 "config": [ 00:17:42.153 { 00:17:42.153 "method": "accel_set_options", 00:17:42.153 "params": { 00:17:42.153 "small_cache_size": 128, 00:17:42.153 "large_cache_size": 16, 00:17:42.153 "task_count": 2048, 00:17:42.153 "sequence_count": 2048, 00:17:42.153 "buf_count": 2048 00:17:42.153 } 00:17:42.153 } 00:17:42.153 ] 00:17:42.153 }, 00:17:42.153 { 00:17:42.153 "subsystem": "bdev", 00:17:42.153 "config": [ 00:17:42.153 { 00:17:42.153 "method": "bdev_set_options", 00:17:42.153 "params": { 00:17:42.153 "bdev_io_pool_size": 65535, 00:17:42.153 "bdev_io_cache_size": 256, 00:17:42.153 "bdev_auto_examine": true, 00:17:42.153 "iobuf_small_cache_size": 128, 00:17:42.153 "iobuf_large_cache_size": 16 00:17:42.153 } 00:17:42.153 }, 00:17:42.153 { 00:17:42.153 "method": "bdev_raid_set_options", 00:17:42.153 "params": { 00:17:42.153 "process_window_size_kb": 1024 00:17:42.153 } 00:17:42.153 }, 00:17:42.153 { 00:17:42.153 "method": "bdev_iscsi_set_options", 00:17:42.153 "params": { 00:17:42.153 "timeout_sec": 30 00:17:42.153 } 00:17:42.153 }, 00:17:42.153 { 00:17:42.153 "method": "bdev_nvme_set_options", 00:17:42.153 "params": { 00:17:42.153 "action_on_timeout": "none", 00:17:42.153 "timeout_us": 0, 00:17:42.153 "timeout_admin_us": 0, 00:17:42.153 "keep_alive_timeout_ms": 10000, 00:17:42.153 "transport_retry_count": 4, 00:17:42.153 "arbitration_burst": 0, 00:17:42.153 "low_priority_weight": 0, 00:17:42.153 "medium_priority_weight": 0, 00:17:42.153 "high_priority_weight": 0, 00:17:42.153 "nvme_adminq_poll_period_us": 10000, 00:17:42.153 "nvme_ioq_poll_period_us": 0, 00:17:42.153 "io_queue_requests": 512, 00:17:42.153 "delay_cmd_submit": true, 00:17:42.153 "bdev_retry_count": 3, 00:17:42.153 "transport_ack_timeout": 0, 00:17:42.153 "ctrlr_loss_timeout_sec": 0, 00:17:42.153 "reconnect_delay_sec": 0, 00:17:42.153 "fast_io_fail_timeout_sec": 0, 00:17:42.153 "generate_uuids": false, 00:17:42.153 "transport_tos": 0, 00:17:42.153 "io_path_stat": false, 00:17:42.153 "allow_accel_sequence": false 00:17:42.153 } 00:17:42.153 }, 00:17:42.153 { 00:17:42.153 "method": "bdev_nvme_attach_controller", 00:17:42.153 "params": { 00:17:42.153 "name": "TLSTEST", 00:17:42.153 "trtype": "TCP", 00:17:42.153 "adrfam": "IPv4", 00:17:42.153 "traddr": "10.0.0.2", 00:17:42.153 "trsvcid": "4420", 00:17:42.153 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:42.153 "prchk_reftag": false, 00:17:42.153 "prchk_guard": false, 00:17:42.153 "ctrlr_loss_timeout_sec": 0, 00:17:42.153 "reconnect_delay_sec": 0, 00:17:42.153 "fast_io_fail_timeout_sec": 0, 00:17:42.153 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:42.153 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:42.153 "hdgst": false, 00:17:42.153 "ddgst": false 00:17:42.153 } 00:17:42.153 }, 00:17:42.153 { 00:17:42.153 "method": "bdev_nvme_set_hotplug", 00:17:42.153 "params": { 00:17:42.153 "period_us": 100000, 00:17:42.153 "enable": false 00:17:42.153 } 00:17:42.153 }, 00:17:42.153 { 00:17:42.153 "method": "bdev_wait_for_examine" 00:17:42.153 } 00:17:42.153 ] 00:17:42.153 }, 00:17:42.153 { 00:17:42.153 "subsystem": "nbd", 00:17:42.153 "config": [] 00:17:42.153 } 00:17:42.153 ] 00:17:42.153 }' 00:17:42.153 15:41:33 -- target/tls.sh@208 -- # killprocess 888595 00:17:42.153 15:41:33 -- common/autotest_common.sh@936 -- # '[' -z 888595 ']' 00:17:42.153 15:41:33 -- common/autotest_common.sh@940 -- # kill -0 888595 00:17:42.153 15:41:33 -- common/autotest_common.sh@941 -- # uname 00:17:42.153 15:41:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:42.153 15:41:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 888595 00:17:42.153 15:41:33 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:42.153 15:41:33 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:42.153 15:41:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 888595' 00:17:42.153 killing process with pid 888595 00:17:42.153 15:41:33 -- common/autotest_common.sh@955 -- # kill 888595 00:17:42.153 Received shutdown signal, test time was about 0.612832 seconds 00:17:42.153 00:17:42.153 Latency(us) 00:17:42.153 [2024-11-26T14:41:33.606Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:42.153 [2024-11-26T14:41:33.606Z] =================================================================================================================== 00:17:42.153 [2024-11-26T14:41:33.606Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:42.153 15:41:33 -- common/autotest_common.sh@960 -- # wait 888595 00:17:42.412 15:41:33 -- target/tls.sh@209 -- # killprocess 888190 00:17:42.412 15:41:33 -- common/autotest_common.sh@936 -- # '[' -z 888190 ']' 00:17:42.412 15:41:33 -- common/autotest_common.sh@940 -- # kill -0 888190 00:17:42.412 15:41:33 -- common/autotest_common.sh@941 -- # uname 00:17:42.412 15:41:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:42.412 15:41:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 888190 00:17:42.412 15:41:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:42.412 15:41:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:42.412 15:41:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 888190' 00:17:42.412 killing process with pid 888190 00:17:42.412 15:41:33 -- common/autotest_common.sh@955 -- # kill 888190 00:17:42.412 15:41:33 -- common/autotest_common.sh@960 -- # wait 888190 00:17:42.671 15:41:33 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:17:42.671 15:41:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:42.671 15:41:33 -- target/tls.sh@212 -- # echo '{ 00:17:42.671 "subsystems": [ 00:17:42.671 { 00:17:42.671 "subsystem": "iobuf", 00:17:42.671 "config": [ 00:17:42.671 { 00:17:42.671 "method": "iobuf_set_options", 00:17:42.671 "params": { 00:17:42.671 "small_pool_count": 8192, 00:17:42.671 "large_pool_count": 1024, 00:17:42.671 "small_bufsize": 8192, 00:17:42.671 "large_bufsize": 135168 00:17:42.671 } 00:17:42.671 } 00:17:42.671 ] 00:17:42.671 }, 00:17:42.671 { 00:17:42.671 "subsystem": "sock", 00:17:42.671 "config": [ 00:17:42.671 { 00:17:42.671 "method": "sock_impl_set_options", 00:17:42.671 "params": { 00:17:42.671 "impl_name": "posix", 00:17:42.671 "recv_buf_size": 2097152, 00:17:42.671 "send_buf_size": 2097152, 00:17:42.671 "enable_recv_pipe": true, 00:17:42.671 "enable_quickack": false, 00:17:42.671 "enable_placement_id": 0, 00:17:42.671 "enable_zerocopy_send_server": true, 00:17:42.671 "enable_zerocopy_send_client": false, 00:17:42.671 "zerocopy_threshold": 0, 00:17:42.671 "tls_version": 0, 00:17:42.671 "enable_ktls": false 00:17:42.671 } 00:17:42.671 }, 00:17:42.671 { 00:17:42.671 "method": "sock_impl_set_options", 00:17:42.671 "params": { 00:17:42.671 "impl_name": "ssl", 00:17:42.671 "recv_buf_size": 4096, 00:17:42.671 "send_buf_size": 4096, 00:17:42.671 "enable_recv_pipe": true, 00:17:42.671 "enable_quickack": false, 00:17:42.671 "enable_placement_id": 0, 00:17:42.671 "enable_zerocopy_send_server": true, 00:17:42.671 "enable_zerocopy_send_client": false, 00:17:42.671 "zerocopy_threshold": 0, 00:17:42.671 "tls_version": 0, 00:17:42.671 "enable_ktls": false 00:17:42.671 } 00:17:42.671 } 00:17:42.671 ] 00:17:42.671 }, 00:17:42.671 { 00:17:42.671 "subsystem": "vmd", 00:17:42.671 "config": [] 00:17:42.671 }, 00:17:42.671 { 00:17:42.671 "subsystem": "accel", 00:17:42.671 "config": [ 00:17:42.671 { 00:17:42.671 "method": "accel_set_options", 00:17:42.671 "params": { 00:17:42.671 "small_cache_size": 128, 00:17:42.671 "large_cache_size": 16, 00:17:42.671 "task_count": 2048, 00:17:42.671 "sequence_count": 2048, 00:17:42.671 "buf_count": 2048 00:17:42.671 } 00:17:42.671 } 00:17:42.671 ] 00:17:42.671 }, 00:17:42.671 { 00:17:42.671 "subsystem": "bdev", 00:17:42.671 "config": [ 00:17:42.671 { 00:17:42.671 "method": "bdev_set_options", 00:17:42.671 "params": { 00:17:42.671 "bdev_io_pool_size": 65535, 00:17:42.671 "bdev_io_cache_size": 256, 00:17:42.671 "bdev_auto_examine": true, 00:17:42.671 "iobuf_small_cache_size": 128, 00:17:42.671 "iobuf_large_cache_size": 16 00:17:42.671 } 00:17:42.671 }, 00:17:42.671 { 00:17:42.671 "method": "bdev_raid_set_options", 00:17:42.671 "params": { 00:17:42.671 "process_window_size_kb": 1024 00:17:42.671 } 00:17:42.671 }, 00:17:42.671 { 00:17:42.671 "method": "bdev_iscsi_set_options", 00:17:42.671 "params": { 00:17:42.671 "timeout_sec": 30 00:17:42.671 } 00:17:42.671 }, 00:17:42.671 { 00:17:42.671 "method": "bdev_nvme_set_options", 00:17:42.671 "params": { 00:17:42.671 "action_on_timeout": "none", 00:17:42.671 "timeout_us": 0, 00:17:42.671 "timeout_admin_us": 0, 00:17:42.671 "keep_alive_timeout_ms": 10000, 00:17:42.671 "transport_retry_count": 4, 00:17:42.671 "arbitration_burst": 0, 00:17:42.671 "low_priority_weight": 0, 00:17:42.671 "medium_priority_weight": 0, 00:17:42.671 "high_priority_weight": 0, 00:17:42.671 "nvme_adminq_poll_period_us": 10000, 00:17:42.671 "nvme_ioq_poll_period_us": 0, 00:17:42.671 "io_queue_requests": 0, 00:17:42.671 "delay_cmd_submit": true, 00:17:42.671 "bdev_retry_count": 3, 00:17:42.671 "transport_ack_timeout": 0, 00:17:42.671 "ctrlr_loss_timeout_sec": 0, 00:17:42.671 "reconnect_delay_sec": 0, 00:17:42.671 "fast_io_fail_timeout_sec": 0, 00:17:42.671 "generate_uuids": false, 00:17:42.671 "transport_tos": 0, 00:17:42.671 "io_path_stat": false, 00:17:42.671 "allow_accel_sequence": false 00:17:42.671 } 00:17:42.671 }, 00:17:42.671 { 00:17:42.671 "method": "bdev_nvme_set_hotplug", 00:17:42.671 "params": { 00:17:42.671 "period_us": 100000, 00:17:42.671 "enable": false 00:17:42.671 } 00:17:42.671 }, 00:17:42.671 { 00:17:42.671 "method": "bdev_malloc_create", 00:17:42.671 "params": { 00:17:42.671 "name": "malloc0", 00:17:42.671 "num_blocks": 8192, 00:17:42.671 "block_size": 4096, 00:17:42.671 "physical_block_size": 4096, 00:17:42.671 "uuid": "09a7e9fd-d4ec-4ec1-a271-bf2dc51831fb", 00:17:42.671 "optimal_io_boundary": 0 00:17:42.671 } 00:17:42.671 }, 00:17:42.671 { 00:17:42.671 "method": "bdev_wait_for_examine" 00:17:42.671 } 00:17:42.671 ] 00:17:42.671 }, 00:17:42.671 { 00:17:42.671 "subsystem": "nbd", 00:17:42.671 "config": [] 00:17:42.671 }, 00:17:42.671 { 00:17:42.671 "subsystem": "scheduler", 00:17:42.671 "config": [ 00:17:42.671 { 00:17:42.671 "method": "framework_set_scheduler", 00:17:42.671 "params": { 00:17:42.671 "name": "static" 00:17:42.671 } 00:17:42.671 } 00:17:42.671 ] 00:17:42.671 }, 00:17:42.671 { 00:17:42.671 "subsystem": "nvmf", 00:17:42.671 "config": [ 00:17:42.671 { 00:17:42.671 "method": "nvmf_set_config", 00:17:42.671 "params": { 00:17:42.671 "discovery_filter": "match_any", 00:17:42.672 "admin_cmd_passthru": { 00:17:42.672 "identify_ctrlr": false 00:17:42.672 } 00:17:42.672 } 00:17:42.672 }, 00:17:42.672 { 00:17:42.672 "method": "nvmf_set_max_subsystems", 00:17:42.672 "params": { 00:17:42.672 "max_subsystems": 1024 00:17:42.672 } 00:17:42.672 }, 00:17:42.672 { 00:17:42.672 "method": "nvmf_set_crdt", 00:17:42.672 "params": { 00:17:42.672 "crdt1": 0, 00:17:42.672 "crdt2": 0, 00:17:42.672 "crdt3": 0 00:17:42.672 } 00:17:42.672 }, 00:17:42.672 { 00:17:42.672 "method": "nvmf_create_transport", 00:17:42.672 "params": { 00:17:42.672 "trtype": "TCP", 00:17:42.672 "max_queue_depth": 128, 00:17:42.672 "max_io_qpairs_per_ctrlr": 127, 00:17:42.672 "in_capsule_data_size": 4096, 00:17:42.672 "max_io_size": 131072, 00:17:42.672 "io_unit_size": 131072, 00:17:42.672 "max_aq_depth": 128, 00:17:42.672 "num_shared_buffers": 511, 00:17:42.672 "buf_cache_size": 4294967295, 00:17:42.672 "dif_insert_or_strip": false, 00:17:42.672 "zcopy": false, 00:17:42.672 "c2h_success": false, 00:17:42.672 "sock_priority": 0, 00:17:42.672 "abort_timeout_sec": 1 00:17:42.672 } 00:17:42.672 }, 00:17:42.672 { 00:17:42.672 "method": "nvmf_create_subsystem", 00:17:42.672 "params": { 00:17:42.672 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:42.672 "allow_any_host": false, 00:17:42.672 "serial_number": "SPDK00000000000001", 00:17:42.672 "model_number": "SPDK bdev Controller", 00:17:42.672 "max_namespaces": 10, 00:17:42.672 "min_cntlid": 1, 00:17:42.672 "max_cntlid": 65519, 00:17:42.672 "ana_reporting": false 00:17:42.672 } 00:17:42.672 }, 00:17:42.672 { 00:17:42.672 "method": "nvmf_subsystem_add_host", 00:17:42.672 "params": { 00:17:42.672 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:42.672 "host": "nqn.2016-06.io.spdk:host1", 00:17:42.672 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:42.672 } 00:17:42.672 }, 00:17:42.672 { 00:17:42.672 "method": "nvmf_subsystem_add_ns", 00:17:42.672 "params": { 00:17:42.672 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:42.672 "namespace": { 00:17:42.672 "nsid": 1, 00:17:42.672 "bdev_name": "malloc0", 00:17:42.672 "nguid": "09A7E9FDD4EC4EC1A271BF2DC51831FB", 00:17:42.672 "uuid": "09a7e9fd-d4ec-4ec1-a271-bf2dc51831fb" 00:17:42.672 } 00:17:42.672 } 00:17:42.672 }, 00:17:42.672 { 00:17:42.672 "method": "nvmf_subsystem_add_listener", 00:17:42.672 "params": { 00:17:42.672 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:42.672 "listen_address": { 00:17:42.672 "trtype": "TCP", 00:17:42.672 "adrfam": "IPv4", 00:17:42.672 "traddr": "10.0.0.2", 00:17:42.672 "trsvcid": "4420" 00:17:42.672 }, 00:17:42.672 "secure_channel": true 00:17:42.672 } 00:17:42.672 } 00:17:42.672 ] 00:17:42.672 } 00:17:42.672 ] 00:17:42.672 }' 00:17:42.672 15:41:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:42.672 15:41:33 -- common/autotest_common.sh@10 -- # set +x 00:17:42.672 15:41:33 -- nvmf/common.sh@469 -- # nvmfpid=888878 00:17:42.672 15:41:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:17:42.672 15:41:33 -- nvmf/common.sh@470 -- # waitforlisten 888878 00:17:42.672 15:41:33 -- common/autotest_common.sh@829 -- # '[' -z 888878 ']' 00:17:42.672 15:41:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:42.672 15:41:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:42.672 15:41:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:42.672 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:42.672 15:41:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:42.672 15:41:33 -- common/autotest_common.sh@10 -- # set +x 00:17:42.672 [2024-11-26 15:41:33.992843] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:42.672 [2024-11-26 15:41:33.992916] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:42.672 EAL: No free 2048 kB hugepages reported on node 1 00:17:42.672 [2024-11-26 15:41:34.059070] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:42.930 [2024-11-26 15:41:34.173806] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:42.931 [2024-11-26 15:41:34.173967] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:42.931 [2024-11-26 15:41:34.173986] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:42.931 [2024-11-26 15:41:34.174000] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:42.931 [2024-11-26 15:41:34.174053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:43.190 [2024-11-26 15:41:34.408878] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:43.190 [2024-11-26 15:41:34.440902] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:43.190 [2024-11-26 15:41:34.441202] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:43.757 15:41:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:43.757 15:41:34 -- common/autotest_common.sh@862 -- # return 0 00:17:43.757 15:41:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:43.757 15:41:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:43.757 15:41:34 -- common/autotest_common.sh@10 -- # set +x 00:17:43.757 15:41:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:43.757 15:41:35 -- target/tls.sh@216 -- # bdevperf_pid=889022 00:17:43.757 15:41:35 -- target/tls.sh@217 -- # waitforlisten 889022 /var/tmp/bdevperf.sock 00:17:43.757 15:41:35 -- common/autotest_common.sh@829 -- # '[' -z 889022 ']' 00:17:43.757 15:41:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:43.758 15:41:35 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:17:43.758 15:41:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:43.758 15:41:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:43.758 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:43.758 15:41:35 -- target/tls.sh@213 -- # echo '{ 00:17:43.758 "subsystems": [ 00:17:43.758 { 00:17:43.758 "subsystem": "iobuf", 00:17:43.758 "config": [ 00:17:43.758 { 00:17:43.758 "method": "iobuf_set_options", 00:17:43.758 "params": { 00:17:43.758 "small_pool_count": 8192, 00:17:43.758 "large_pool_count": 1024, 00:17:43.758 "small_bufsize": 8192, 00:17:43.758 "large_bufsize": 135168 00:17:43.758 } 00:17:43.758 } 00:17:43.758 ] 00:17:43.758 }, 00:17:43.758 { 00:17:43.758 "subsystem": "sock", 00:17:43.758 "config": [ 00:17:43.758 { 00:17:43.758 "method": "sock_impl_set_options", 00:17:43.758 "params": { 00:17:43.758 "impl_name": "posix", 00:17:43.758 "recv_buf_size": 2097152, 00:17:43.758 "send_buf_size": 2097152, 00:17:43.758 "enable_recv_pipe": true, 00:17:43.758 "enable_quickack": false, 00:17:43.758 "enable_placement_id": 0, 00:17:43.758 "enable_zerocopy_send_server": true, 00:17:43.758 "enable_zerocopy_send_client": false, 00:17:43.758 "zerocopy_threshold": 0, 00:17:43.758 "tls_version": 0, 00:17:43.758 "enable_ktls": false 00:17:43.758 } 00:17:43.758 }, 00:17:43.758 { 00:17:43.758 "method": "sock_impl_set_options", 00:17:43.758 "params": { 00:17:43.758 "impl_name": "ssl", 00:17:43.758 "recv_buf_size": 4096, 00:17:43.758 "send_buf_size": 4096, 00:17:43.758 "enable_recv_pipe": true, 00:17:43.758 "enable_quickack": false, 00:17:43.758 "enable_placement_id": 0, 00:17:43.758 "enable_zerocopy_send_server": true, 00:17:43.758 "enable_zerocopy_send_client": false, 00:17:43.758 "zerocopy_threshold": 0, 00:17:43.758 "tls_version": 0, 00:17:43.758 "enable_ktls": false 00:17:43.758 } 00:17:43.758 } 00:17:43.758 ] 00:17:43.758 }, 00:17:43.758 { 00:17:43.758 "subsystem": "vmd", 00:17:43.758 "config": [] 00:17:43.758 }, 00:17:43.758 { 00:17:43.758 "subsystem": "accel", 00:17:43.758 "config": [ 00:17:43.758 { 00:17:43.758 "method": "accel_set_options", 00:17:43.758 "params": { 00:17:43.758 "small_cache_size": 128, 00:17:43.758 "large_cache_size": 16, 00:17:43.758 "task_count": 2048, 00:17:43.758 "sequence_count": 2048, 00:17:43.758 "buf_count": 2048 00:17:43.758 } 00:17:43.758 } 00:17:43.758 ] 00:17:43.758 }, 00:17:43.758 { 00:17:43.758 "subsystem": "bdev", 00:17:43.758 "config": [ 00:17:43.758 { 00:17:43.758 "method": "bdev_set_options", 00:17:43.758 "params": { 00:17:43.758 "bdev_io_pool_size": 65535, 00:17:43.758 "bdev_io_cache_size": 256, 00:17:43.758 "bdev_auto_examine": true, 00:17:43.758 "iobuf_small_cache_size": 128, 00:17:43.758 "iobuf_large_cache_size": 16 00:17:43.758 } 00:17:43.758 }, 00:17:43.758 { 00:17:43.758 "method": "bdev_raid_set_options", 00:17:43.758 "params": { 00:17:43.758 "process_window_size_kb": 1024 00:17:43.758 } 00:17:43.758 }, 00:17:43.758 { 00:17:43.758 "method": "bdev_iscsi_set_options", 00:17:43.758 "params": { 00:17:43.758 "timeout_sec": 30 00:17:43.758 } 00:17:43.758 }, 00:17:43.758 { 00:17:43.758 "method": "bdev_nvme_set_options", 00:17:43.758 "params": { 00:17:43.758 "action_on_timeout": "none", 00:17:43.758 "timeout_us": 0, 00:17:43.758 "timeout_admin_us": 0, 00:17:43.758 "keep_alive_timeout_ms": 10000, 00:17:43.758 "transport_retry_count": 4, 00:17:43.758 "arbitration_burst": 0, 00:17:43.758 "low_priority_weight": 0, 00:17:43.758 "medium_priority_weight": 0, 00:17:43.758 "high_priority_weight": 0, 00:17:43.758 "nvme_adminq_poll_period_us": 10000, 00:17:43.758 "nvme_ioq_poll_period_us": 0, 00:17:43.758 "io_queue_requests": 512, 00:17:43.758 "delay_cmd_submit": true, 00:17:43.758 "bdev_retry_count": 3, 00:17:43.758 "transport_ack_timeout": 0, 00:17:43.758 "ctrlr_loss_timeout_sec": 0, 00:17:43.758 "reconnect_delay_sec": 0, 00:17:43.758 "fast_io_fail_timeout_sec": 0, 00:17:43.758 "generate_uuids": false, 00:17:43.758 "transport_tos": 0, 00:17:43.758 "io_path_stat": false, 00:17:43.758 "allow_accel_sequence": false 00:17:43.758 } 00:17:43.758 }, 00:17:43.758 { 00:17:43.758 "method": "bdev_nvme_attach_controller", 00:17:43.758 "params": { 00:17:43.758 "name": "TLSTEST", 00:17:43.758 "trtype": "TCP", 00:17:43.758 "adrfam": "IPv4", 00:17:43.758 "traddr": "10.0.0.2", 00:17:43.758 "trsvcid": "4420", 00:17:43.758 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:43.758 "prchk_reftag": false, 00:17:43.758 "prchk_guard": false, 00:17:43.758 "ctrlr_loss_timeout_sec": 0, 00:17:43.758 "reconnect_delay_sec": 0, 00:17:43.758 "fast_io_fail_timeout_sec": 0, 00:17:43.758 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:43.758 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:43.758 "hdgst": false, 00:17:43.758 "ddgst": false 00:17:43.758 } 00:17:43.758 }, 00:17:43.758 { 00:17:43.758 "method": "bdev_nvme_set_hotplug", 00:17:43.758 "params": { 00:17:43.758 "period_us": 100000, 00:17:43.758 "enable": false 00:17:43.758 } 00:17:43.758 }, 00:17:43.758 { 00:17:43.758 "method": "bdev_wait_for_examine" 00:17:43.758 } 00:17:43.758 ] 00:17:43.758 }, 00:17:43.758 { 00:17:43.758 "subsystem": "nbd", 00:17:43.758 "config": [] 00:17:43.758 } 00:17:43.758 ] 00:17:43.758 }' 00:17:43.758 15:41:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:43.758 15:41:35 -- common/autotest_common.sh@10 -- # set +x 00:17:43.758 [2024-11-26 15:41:35.056598] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:43.758 [2024-11-26 15:41:35.056696] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid889022 ] 00:17:43.758 EAL: No free 2048 kB hugepages reported on node 1 00:17:43.758 [2024-11-26 15:41:35.116340] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:44.017 [2024-11-26 15:41:35.220960] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:44.017 [2024-11-26 15:41:35.381812] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:44.583 15:41:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:44.583 15:41:36 -- common/autotest_common.sh@862 -- # return 0 00:17:44.583 15:41:36 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:44.841 Running I/O for 10 seconds... 00:17:54.807 00:17:54.807 Latency(us) 00:17:54.807 [2024-11-26T14:41:46.260Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:54.807 [2024-11-26T14:41:46.260Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:54.807 Verification LBA range: start 0x0 length 0x2000 00:17:54.807 TLSTESTn1 : 10.02 4276.78 16.71 0.00 0.00 29886.97 5995.33 44661.57 00:17:54.807 [2024-11-26T14:41:46.260Z] =================================================================================================================== 00:17:54.807 [2024-11-26T14:41:46.260Z] Total : 4276.78 16.71 0.00 0.00 29886.97 5995.33 44661.57 00:17:54.807 0 00:17:54.807 15:41:46 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:54.807 15:41:46 -- target/tls.sh@223 -- # killprocess 889022 00:17:54.807 15:41:46 -- common/autotest_common.sh@936 -- # '[' -z 889022 ']' 00:17:54.807 15:41:46 -- common/autotest_common.sh@940 -- # kill -0 889022 00:17:54.807 15:41:46 -- common/autotest_common.sh@941 -- # uname 00:17:54.807 15:41:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:54.807 15:41:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 889022 00:17:54.807 15:41:46 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:54.807 15:41:46 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:54.807 15:41:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 889022' 00:17:54.807 killing process with pid 889022 00:17:54.807 15:41:46 -- common/autotest_common.sh@955 -- # kill 889022 00:17:54.807 Received shutdown signal, test time was about 10.000000 seconds 00:17:54.807 00:17:54.807 Latency(us) 00:17:54.807 [2024-11-26T14:41:46.260Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:54.807 [2024-11-26T14:41:46.260Z] =================================================================================================================== 00:17:54.807 [2024-11-26T14:41:46.260Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:54.808 15:41:46 -- common/autotest_common.sh@960 -- # wait 889022 00:17:55.064 15:41:46 -- target/tls.sh@224 -- # killprocess 888878 00:17:55.064 15:41:46 -- common/autotest_common.sh@936 -- # '[' -z 888878 ']' 00:17:55.064 15:41:46 -- common/autotest_common.sh@940 -- # kill -0 888878 00:17:55.065 15:41:46 -- common/autotest_common.sh@941 -- # uname 00:17:55.065 15:41:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:55.065 15:41:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 888878 00:17:55.065 15:41:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:55.065 15:41:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:55.065 15:41:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 888878' 00:17:55.065 killing process with pid 888878 00:17:55.065 15:41:46 -- common/autotest_common.sh@955 -- # kill 888878 00:17:55.065 15:41:46 -- common/autotest_common.sh@960 -- # wait 888878 00:17:55.631 15:41:46 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:17:55.631 15:41:46 -- target/tls.sh@227 -- # cleanup 00:17:55.631 15:41:46 -- target/tls.sh@15 -- # process_shm --id 0 00:17:55.631 15:41:46 -- common/autotest_common.sh@806 -- # type=--id 00:17:55.631 15:41:46 -- common/autotest_common.sh@807 -- # id=0 00:17:55.631 15:41:46 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:17:55.631 15:41:46 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:55.631 15:41:46 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:17:55.631 15:41:46 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:17:55.631 15:41:46 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:17:55.631 15:41:46 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:55.631 nvmf_trace.0 00:17:55.631 15:41:46 -- common/autotest_common.sh@821 -- # return 0 00:17:55.631 15:41:46 -- target/tls.sh@16 -- # killprocess 889022 00:17:55.631 15:41:46 -- common/autotest_common.sh@936 -- # '[' -z 889022 ']' 00:17:55.631 15:41:46 -- common/autotest_common.sh@940 -- # kill -0 889022 00:17:55.631 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (889022) - No such process 00:17:55.631 15:41:46 -- common/autotest_common.sh@963 -- # echo 'Process with pid 889022 is not found' 00:17:55.631 Process with pid 889022 is not found 00:17:55.631 15:41:46 -- target/tls.sh@17 -- # nvmftestfini 00:17:55.631 15:41:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:55.631 15:41:46 -- nvmf/common.sh@116 -- # sync 00:17:55.631 15:41:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:55.631 15:41:46 -- nvmf/common.sh@119 -- # set +e 00:17:55.631 15:41:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:55.631 15:41:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:55.631 rmmod nvme_tcp 00:17:55.631 rmmod nvme_fabrics 00:17:55.631 rmmod nvme_keyring 00:17:55.631 15:41:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:55.631 15:41:46 -- nvmf/common.sh@123 -- # set -e 00:17:55.631 15:41:46 -- nvmf/common.sh@124 -- # return 0 00:17:55.631 15:41:46 -- nvmf/common.sh@477 -- # '[' -n 888878 ']' 00:17:55.631 15:41:46 -- nvmf/common.sh@478 -- # killprocess 888878 00:17:55.631 15:41:46 -- common/autotest_common.sh@936 -- # '[' -z 888878 ']' 00:17:55.631 15:41:46 -- common/autotest_common.sh@940 -- # kill -0 888878 00:17:55.631 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (888878) - No such process 00:17:55.631 15:41:46 -- common/autotest_common.sh@963 -- # echo 'Process with pid 888878 is not found' 00:17:55.631 Process with pid 888878 is not found 00:17:55.631 15:41:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:55.631 15:41:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:55.631 15:41:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:55.631 15:41:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:55.631 15:41:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:55.631 15:41:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:55.631 15:41:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:55.631 15:41:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:57.538 15:41:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:57.538 15:41:48 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:57.538 00:17:57.538 real 1m16.157s 00:17:57.538 user 2m2.610s 00:17:57.538 sys 0m24.224s 00:17:57.538 15:41:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:57.538 15:41:48 -- common/autotest_common.sh@10 -- # set +x 00:17:57.538 ************************************ 00:17:57.538 END TEST nvmf_tls 00:17:57.538 ************************************ 00:17:57.538 15:41:48 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:57.538 15:41:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:57.538 15:41:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:57.538 15:41:48 -- common/autotest_common.sh@10 -- # set +x 00:17:57.538 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:17:57.538 ************************************ 00:17:57.538 START TEST nvmf_fips 00:17:57.538 ************************************ 00:17:57.538 15:41:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:57.798 * Looking for test storage... 00:17:57.798 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:17:57.798 15:41:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:57.798 15:41:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:57.798 15:41:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:57.798 15:41:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:57.798 15:41:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:57.798 15:41:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:57.798 15:41:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:57.798 15:41:49 -- scripts/common.sh@335 -- # IFS=.-: 00:17:57.798 15:41:49 -- scripts/common.sh@335 -- # read -ra ver1 00:17:57.798 15:41:49 -- scripts/common.sh@336 -- # IFS=.-: 00:17:57.798 15:41:49 -- scripts/common.sh@336 -- # read -ra ver2 00:17:57.798 15:41:49 -- scripts/common.sh@337 -- # local 'op=<' 00:17:57.798 15:41:49 -- scripts/common.sh@339 -- # ver1_l=2 00:17:57.798 15:41:49 -- scripts/common.sh@340 -- # ver2_l=1 00:17:57.798 15:41:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:57.798 15:41:49 -- scripts/common.sh@343 -- # case "$op" in 00:17:57.798 15:41:49 -- scripts/common.sh@344 -- # : 1 00:17:57.798 15:41:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:57.798 15:41:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:57.798 15:41:49 -- scripts/common.sh@364 -- # decimal 1 00:17:57.798 15:41:49 -- scripts/common.sh@352 -- # local d=1 00:17:57.798 15:41:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:57.798 15:41:49 -- scripts/common.sh@354 -- # echo 1 00:17:57.798 15:41:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:57.798 15:41:49 -- scripts/common.sh@365 -- # decimal 2 00:17:57.798 15:41:49 -- scripts/common.sh@352 -- # local d=2 00:17:57.798 15:41:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:57.798 15:41:49 -- scripts/common.sh@354 -- # echo 2 00:17:57.798 15:41:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:57.798 15:41:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:57.798 15:41:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:57.798 15:41:49 -- scripts/common.sh@367 -- # return 0 00:17:57.798 15:41:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:57.798 15:41:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:57.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:57.798 --rc genhtml_branch_coverage=1 00:17:57.798 --rc genhtml_function_coverage=1 00:17:57.798 --rc genhtml_legend=1 00:17:57.798 --rc geninfo_all_blocks=1 00:17:57.798 --rc geninfo_unexecuted_blocks=1 00:17:57.798 00:17:57.798 ' 00:17:57.798 15:41:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:57.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:57.798 --rc genhtml_branch_coverage=1 00:17:57.798 --rc genhtml_function_coverage=1 00:17:57.798 --rc genhtml_legend=1 00:17:57.798 --rc geninfo_all_blocks=1 00:17:57.798 --rc geninfo_unexecuted_blocks=1 00:17:57.798 00:17:57.798 ' 00:17:57.798 15:41:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:57.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:57.798 --rc genhtml_branch_coverage=1 00:17:57.798 --rc genhtml_function_coverage=1 00:17:57.798 --rc genhtml_legend=1 00:17:57.798 --rc geninfo_all_blocks=1 00:17:57.798 --rc geninfo_unexecuted_blocks=1 00:17:57.798 00:17:57.798 ' 00:17:57.798 15:41:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:57.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:57.798 --rc genhtml_branch_coverage=1 00:17:57.798 --rc genhtml_function_coverage=1 00:17:57.798 --rc genhtml_legend=1 00:17:57.798 --rc geninfo_all_blocks=1 00:17:57.798 --rc geninfo_unexecuted_blocks=1 00:17:57.798 00:17:57.798 ' 00:17:57.798 15:41:49 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:57.798 15:41:49 -- nvmf/common.sh@7 -- # uname -s 00:17:57.798 15:41:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:57.798 15:41:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:57.798 15:41:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:57.798 15:41:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:57.798 15:41:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:57.798 15:41:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:57.798 15:41:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:57.798 15:41:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:57.798 15:41:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:57.798 15:41:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:57.798 15:41:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:57.798 15:41:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:57.798 15:41:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:57.798 15:41:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:57.798 15:41:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:57.798 15:41:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:57.798 15:41:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:57.798 15:41:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:57.798 15:41:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:57.798 15:41:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:57.798 15:41:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:57.798 15:41:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:57.798 15:41:49 -- paths/export.sh@5 -- # export PATH 00:17:57.798 15:41:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:57.798 15:41:49 -- nvmf/common.sh@46 -- # : 0 00:17:57.798 15:41:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:57.798 15:41:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:57.798 15:41:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:57.798 15:41:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:57.798 15:41:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:57.798 15:41:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:57.798 15:41:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:57.798 15:41:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:57.798 15:41:49 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:57.798 15:41:49 -- fips/fips.sh@89 -- # check_openssl_version 00:17:57.798 15:41:49 -- fips/fips.sh@83 -- # local target=3.0.0 00:17:57.798 15:41:49 -- fips/fips.sh@85 -- # openssl version 00:17:57.798 15:41:49 -- fips/fips.sh@85 -- # awk '{print $2}' 00:17:57.798 15:41:49 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:17:57.798 15:41:49 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:17:57.798 15:41:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:57.798 15:41:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:57.798 15:41:49 -- scripts/common.sh@335 -- # IFS=.-: 00:17:57.798 15:41:49 -- scripts/common.sh@335 -- # read -ra ver1 00:17:57.798 15:41:49 -- scripts/common.sh@336 -- # IFS=.-: 00:17:57.798 15:41:49 -- scripts/common.sh@336 -- # read -ra ver2 00:17:57.798 15:41:49 -- scripts/common.sh@337 -- # local 'op=>=' 00:17:57.798 15:41:49 -- scripts/common.sh@339 -- # ver1_l=3 00:17:57.798 15:41:49 -- scripts/common.sh@340 -- # ver2_l=3 00:17:57.799 15:41:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:57.799 15:41:49 -- scripts/common.sh@343 -- # case "$op" in 00:17:57.799 15:41:49 -- scripts/common.sh@347 -- # : 1 00:17:57.799 15:41:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:57.799 15:41:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:57.799 15:41:49 -- scripts/common.sh@364 -- # decimal 3 00:17:57.799 15:41:49 -- scripts/common.sh@352 -- # local d=3 00:17:57.799 15:41:49 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:57.799 15:41:49 -- scripts/common.sh@354 -- # echo 3 00:17:57.799 15:41:49 -- scripts/common.sh@364 -- # ver1[v]=3 00:17:57.799 15:41:49 -- scripts/common.sh@365 -- # decimal 3 00:17:57.799 15:41:49 -- scripts/common.sh@352 -- # local d=3 00:17:57.799 15:41:49 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:57.799 15:41:49 -- scripts/common.sh@354 -- # echo 3 00:17:57.799 15:41:49 -- scripts/common.sh@365 -- # ver2[v]=3 00:17:57.799 15:41:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:57.799 15:41:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:57.799 15:41:49 -- scripts/common.sh@363 -- # (( v++ )) 00:17:57.799 15:41:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:57.799 15:41:49 -- scripts/common.sh@364 -- # decimal 1 00:17:57.799 15:41:49 -- scripts/common.sh@352 -- # local d=1 00:17:57.799 15:41:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:57.799 15:41:49 -- scripts/common.sh@354 -- # echo 1 00:17:57.799 15:41:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:57.799 15:41:49 -- scripts/common.sh@365 -- # decimal 0 00:17:57.799 15:41:49 -- scripts/common.sh@352 -- # local d=0 00:17:57.799 15:41:49 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:17:57.799 15:41:49 -- scripts/common.sh@354 -- # echo 0 00:17:57.799 15:41:49 -- scripts/common.sh@365 -- # ver2[v]=0 00:17:57.799 15:41:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:57.799 15:41:49 -- scripts/common.sh@366 -- # return 0 00:17:57.799 15:41:49 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:17:57.799 15:41:49 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:17:57.799 15:41:49 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:17:57.799 15:41:49 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:17:57.799 15:41:49 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:17:57.799 15:41:49 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:17:57.799 15:41:49 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:17:57.799 15:41:49 -- fips/fips.sh@113 -- # build_openssl_config 00:17:57.799 15:41:49 -- fips/fips.sh@37 -- # cat 00:17:57.799 15:41:49 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:17:57.799 15:41:49 -- fips/fips.sh@58 -- # cat - 00:17:57.799 15:41:49 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:17:57.799 15:41:49 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:17:57.799 15:41:49 -- fips/fips.sh@116 -- # mapfile -t providers 00:17:57.799 15:41:49 -- fips/fips.sh@116 -- # openssl list -providers 00:17:57.799 15:41:49 -- fips/fips.sh@116 -- # grep name 00:17:57.799 15:41:49 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:17:57.799 15:41:49 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:17:57.799 15:41:49 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:17:57.799 15:41:49 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:17:57.799 15:41:49 -- fips/fips.sh@127 -- # : 00:17:57.799 15:41:49 -- common/autotest_common.sh@650 -- # local es=0 00:17:57.799 15:41:49 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:17:57.799 15:41:49 -- common/autotest_common.sh@638 -- # local arg=openssl 00:17:57.799 15:41:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:57.799 15:41:49 -- common/autotest_common.sh@642 -- # type -t openssl 00:17:57.799 15:41:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:57.799 15:41:49 -- common/autotest_common.sh@644 -- # type -P openssl 00:17:57.799 15:41:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:57.799 15:41:49 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:17:57.799 15:41:49 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:17:57.799 15:41:49 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:17:58.058 Error setting digest 00:17:58.058 40F212BCA17F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:17:58.058 40F212BCA17F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:17:58.058 15:41:49 -- common/autotest_common.sh@653 -- # es=1 00:17:58.058 15:41:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:58.058 15:41:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:58.058 15:41:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:58.058 15:41:49 -- fips/fips.sh@130 -- # nvmftestinit 00:17:58.058 15:41:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:58.058 15:41:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:58.058 15:41:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:58.058 15:41:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:58.058 15:41:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:58.058 15:41:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:58.058 15:41:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:58.058 15:41:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:58.058 15:41:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:58.058 15:41:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:58.058 15:41:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:58.058 15:41:49 -- common/autotest_common.sh@10 -- # set +x 00:17:59.961 15:41:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:59.961 15:41:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:59.961 15:41:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:59.961 15:41:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:59.961 15:41:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:59.961 15:41:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:59.961 15:41:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:59.961 15:41:51 -- nvmf/common.sh@294 -- # net_devs=() 00:17:59.961 15:41:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:59.961 15:41:51 -- nvmf/common.sh@295 -- # e810=() 00:17:59.961 15:41:51 -- nvmf/common.sh@295 -- # local -ga e810 00:17:59.961 15:41:51 -- nvmf/common.sh@296 -- # x722=() 00:17:59.961 15:41:51 -- nvmf/common.sh@296 -- # local -ga x722 00:17:59.961 15:41:51 -- nvmf/common.sh@297 -- # mlx=() 00:17:59.961 15:41:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:59.961 15:41:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:59.961 15:41:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:59.961 15:41:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:59.961 15:41:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:59.961 15:41:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:59.961 15:41:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:59.961 15:41:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:59.961 15:41:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:59.961 15:41:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:59.961 15:41:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:59.961 15:41:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:59.961 15:41:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:59.961 15:41:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:59.961 15:41:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:59.961 15:41:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:59.961 15:41:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:59.961 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:59.961 15:41:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:59.961 15:41:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:59.961 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:59.961 15:41:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:59.961 15:41:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:59.961 15:41:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:59.961 15:41:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:59.961 15:41:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:59.961 15:41:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:59.961 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:59.961 15:41:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:59.961 15:41:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:59.961 15:41:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:59.961 15:41:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:59.961 15:41:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:59.961 15:41:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:59.961 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:59.961 15:41:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:59.961 15:41:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:59.961 15:41:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:59.961 15:41:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:59.961 15:41:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:59.961 15:41:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:59.961 15:41:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:59.961 15:41:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:59.961 15:41:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:59.961 15:41:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:59.961 15:41:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:59.961 15:41:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:59.961 15:41:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:59.961 15:41:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:59.961 15:41:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:59.961 15:41:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:59.961 15:41:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:59.961 15:41:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:59.961 15:41:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:59.961 15:41:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:59.961 15:41:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:59.961 15:41:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:00.220 15:41:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:00.220 15:41:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:00.220 15:41:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:00.220 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:00.220 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.306 ms 00:18:00.220 00:18:00.220 --- 10.0.0.2 ping statistics --- 00:18:00.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:00.220 rtt min/avg/max/mdev = 0.306/0.306/0.306/0.000 ms 00:18:00.220 15:41:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:00.220 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:00.220 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:18:00.220 00:18:00.220 --- 10.0.0.1 ping statistics --- 00:18:00.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:00.220 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:18:00.220 15:41:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:00.220 15:41:51 -- nvmf/common.sh@410 -- # return 0 00:18:00.220 15:41:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:00.220 15:41:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:00.220 15:41:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:00.220 15:41:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:00.220 15:41:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:00.220 15:41:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:00.220 15:41:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:00.220 15:41:51 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:00.221 15:41:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:00.221 15:41:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:00.221 15:41:51 -- common/autotest_common.sh@10 -- # set +x 00:18:00.221 15:41:51 -- nvmf/common.sh@469 -- # nvmfpid=892392 00:18:00.221 15:41:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:00.221 15:41:51 -- nvmf/common.sh@470 -- # waitforlisten 892392 00:18:00.221 15:41:51 -- common/autotest_common.sh@829 -- # '[' -z 892392 ']' 00:18:00.221 15:41:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:00.221 15:41:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:00.221 15:41:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:00.221 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:00.221 15:41:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:00.221 15:41:51 -- common/autotest_common.sh@10 -- # set +x 00:18:00.221 [2024-11-26 15:41:51.658812] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:00.221 [2024-11-26 15:41:51.658897] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:00.480 EAL: No free 2048 kB hugepages reported on node 1 00:18:00.480 [2024-11-26 15:41:51.727738] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:00.480 [2024-11-26 15:41:51.840970] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:00.480 [2024-11-26 15:41:51.841165] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:00.480 [2024-11-26 15:41:51.841185] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:00.480 [2024-11-26 15:41:51.841200] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:00.480 [2024-11-26 15:41:51.841232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:01.415 15:41:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:01.415 15:41:52 -- common/autotest_common.sh@862 -- # return 0 00:18:01.415 15:41:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:01.415 15:41:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:01.415 15:41:52 -- common/autotest_common.sh@10 -- # set +x 00:18:01.415 15:41:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:01.415 15:41:52 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:01.415 15:41:52 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:01.415 15:41:52 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:01.415 15:41:52 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:01.415 15:41:52 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:01.415 15:41:52 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:01.415 15:41:52 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:01.415 15:41:52 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:01.673 [2024-11-26 15:41:52.918994] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:01.673 [2024-11-26 15:41:52.934977] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:01.673 [2024-11-26 15:41:52.935248] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:01.673 malloc0 00:18:01.673 15:41:52 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:01.673 15:41:52 -- fips/fips.sh@147 -- # bdevperf_pid=892541 00:18:01.673 15:41:52 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:01.673 15:41:52 -- fips/fips.sh@148 -- # waitforlisten 892541 /var/tmp/bdevperf.sock 00:18:01.673 15:41:52 -- common/autotest_common.sh@829 -- # '[' -z 892541 ']' 00:18:01.673 15:41:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:01.673 15:41:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:01.673 15:41:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:01.673 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:01.673 15:41:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:01.673 15:41:52 -- common/autotest_common.sh@10 -- # set +x 00:18:01.673 [2024-11-26 15:41:53.054809] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:01.673 [2024-11-26 15:41:53.054900] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid892541 ] 00:18:01.673 EAL: No free 2048 kB hugepages reported on node 1 00:18:01.673 [2024-11-26 15:41:53.113423] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:01.932 [2024-11-26 15:41:53.216996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:02.916 15:41:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:02.916 15:41:53 -- common/autotest_common.sh@862 -- # return 0 00:18:02.916 15:41:53 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:02.916 [2024-11-26 15:41:54.225905] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:02.916 TLSTESTn1 00:18:02.916 15:41:54 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:03.203 Running I/O for 10 seconds... 00:18:13.170 00:18:13.170 Latency(us) 00:18:13.170 [2024-11-26T14:42:04.623Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:13.170 [2024-11-26T14:42:04.623Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:13.170 Verification LBA range: start 0x0 length 0x2000 00:18:13.170 TLSTESTn1 : 10.02 4178.58 16.32 0.00 0.00 30589.59 6359.42 45438.29 00:18:13.170 [2024-11-26T14:42:04.623Z] =================================================================================================================== 00:18:13.170 [2024-11-26T14:42:04.623Z] Total : 4178.58 16.32 0.00 0.00 30589.59 6359.42 45438.29 00:18:13.170 0 00:18:13.170 15:42:04 -- fips/fips.sh@1 -- # cleanup 00:18:13.170 15:42:04 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:13.170 15:42:04 -- common/autotest_common.sh@806 -- # type=--id 00:18:13.170 15:42:04 -- common/autotest_common.sh@807 -- # id=0 00:18:13.170 15:42:04 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:13.170 15:42:04 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:13.170 15:42:04 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:13.170 15:42:04 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:13.170 15:42:04 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:13.170 15:42:04 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:13.170 nvmf_trace.0 00:18:13.170 15:42:04 -- common/autotest_common.sh@821 -- # return 0 00:18:13.170 15:42:04 -- fips/fips.sh@16 -- # killprocess 892541 00:18:13.170 15:42:04 -- common/autotest_common.sh@936 -- # '[' -z 892541 ']' 00:18:13.170 15:42:04 -- common/autotest_common.sh@940 -- # kill -0 892541 00:18:13.170 15:42:04 -- common/autotest_common.sh@941 -- # uname 00:18:13.170 15:42:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:13.170 15:42:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 892541 00:18:13.170 15:42:04 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:13.170 15:42:04 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:13.170 15:42:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 892541' 00:18:13.170 killing process with pid 892541 00:18:13.170 15:42:04 -- common/autotest_common.sh@955 -- # kill 892541 00:18:13.170 Received shutdown signal, test time was about 10.000000 seconds 00:18:13.170 00:18:13.170 Latency(us) 00:18:13.170 [2024-11-26T14:42:04.623Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:13.170 [2024-11-26T14:42:04.623Z] =================================================================================================================== 00:18:13.170 [2024-11-26T14:42:04.623Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:13.170 15:42:04 -- common/autotest_common.sh@960 -- # wait 892541 00:18:13.429 15:42:04 -- fips/fips.sh@17 -- # nvmftestfini 00:18:13.429 15:42:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:13.429 15:42:04 -- nvmf/common.sh@116 -- # sync 00:18:13.429 15:42:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:13.429 15:42:04 -- nvmf/common.sh@119 -- # set +e 00:18:13.429 15:42:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:13.429 15:42:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:13.429 rmmod nvme_tcp 00:18:13.429 rmmod nvme_fabrics 00:18:13.688 rmmod nvme_keyring 00:18:13.688 15:42:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:13.688 15:42:04 -- nvmf/common.sh@123 -- # set -e 00:18:13.688 15:42:04 -- nvmf/common.sh@124 -- # return 0 00:18:13.688 15:42:04 -- nvmf/common.sh@477 -- # '[' -n 892392 ']' 00:18:13.688 15:42:04 -- nvmf/common.sh@478 -- # killprocess 892392 00:18:13.688 15:42:04 -- common/autotest_common.sh@936 -- # '[' -z 892392 ']' 00:18:13.688 15:42:04 -- common/autotest_common.sh@940 -- # kill -0 892392 00:18:13.688 15:42:04 -- common/autotest_common.sh@941 -- # uname 00:18:13.688 15:42:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:13.688 15:42:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 892392 00:18:13.688 15:42:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:13.688 15:42:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:13.688 15:42:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 892392' 00:18:13.688 killing process with pid 892392 00:18:13.688 15:42:04 -- common/autotest_common.sh@955 -- # kill 892392 00:18:13.688 15:42:04 -- common/autotest_common.sh@960 -- # wait 892392 00:18:13.948 15:42:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:13.948 15:42:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:13.948 15:42:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:13.948 15:42:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:13.948 15:42:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:13.948 15:42:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:13.948 15:42:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:13.948 15:42:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:15.853 15:42:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:15.853 15:42:07 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:15.853 00:18:15.853 real 0m18.336s 00:18:15.853 user 0m23.487s 00:18:15.853 sys 0m6.280s 00:18:15.853 15:42:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:15.853 15:42:07 -- common/autotest_common.sh@10 -- # set +x 00:18:15.853 ************************************ 00:18:15.853 END TEST nvmf_fips 00:18:15.853 ************************************ 00:18:16.112 15:42:07 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:16.112 15:42:07 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:16.112 15:42:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:16.112 15:42:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:16.112 15:42:07 -- common/autotest_common.sh@10 -- # set +x 00:18:16.112 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:18:16.112 ************************************ 00:18:16.112 START TEST nvmf_fuzz 00:18:16.112 ************************************ 00:18:16.112 15:42:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:16.112 * Looking for test storage... 00:18:16.112 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:16.112 15:42:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:16.112 15:42:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:16.112 15:42:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:16.112 15:42:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:16.112 15:42:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:16.112 15:42:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:16.112 15:42:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:16.112 15:42:07 -- scripts/common.sh@335 -- # IFS=.-: 00:18:16.112 15:42:07 -- scripts/common.sh@335 -- # read -ra ver1 00:18:16.112 15:42:07 -- scripts/common.sh@336 -- # IFS=.-: 00:18:16.112 15:42:07 -- scripts/common.sh@336 -- # read -ra ver2 00:18:16.112 15:42:07 -- scripts/common.sh@337 -- # local 'op=<' 00:18:16.112 15:42:07 -- scripts/common.sh@339 -- # ver1_l=2 00:18:16.112 15:42:07 -- scripts/common.sh@340 -- # ver2_l=1 00:18:16.112 15:42:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:16.112 15:42:07 -- scripts/common.sh@343 -- # case "$op" in 00:18:16.112 15:42:07 -- scripts/common.sh@344 -- # : 1 00:18:16.112 15:42:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:16.112 15:42:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:16.112 15:42:07 -- scripts/common.sh@364 -- # decimal 1 00:18:16.112 15:42:07 -- scripts/common.sh@352 -- # local d=1 00:18:16.112 15:42:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:16.112 15:42:07 -- scripts/common.sh@354 -- # echo 1 00:18:16.112 15:42:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:16.112 15:42:07 -- scripts/common.sh@365 -- # decimal 2 00:18:16.112 15:42:07 -- scripts/common.sh@352 -- # local d=2 00:18:16.112 15:42:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:16.112 15:42:07 -- scripts/common.sh@354 -- # echo 2 00:18:16.112 15:42:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:16.112 15:42:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:16.112 15:42:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:16.112 15:42:07 -- scripts/common.sh@367 -- # return 0 00:18:16.112 15:42:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:16.112 15:42:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:16.112 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:16.112 --rc genhtml_branch_coverage=1 00:18:16.112 --rc genhtml_function_coverage=1 00:18:16.112 --rc genhtml_legend=1 00:18:16.112 --rc geninfo_all_blocks=1 00:18:16.112 --rc geninfo_unexecuted_blocks=1 00:18:16.112 00:18:16.112 ' 00:18:16.112 15:42:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:16.112 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:16.112 --rc genhtml_branch_coverage=1 00:18:16.112 --rc genhtml_function_coverage=1 00:18:16.112 --rc genhtml_legend=1 00:18:16.112 --rc geninfo_all_blocks=1 00:18:16.112 --rc geninfo_unexecuted_blocks=1 00:18:16.112 00:18:16.112 ' 00:18:16.112 15:42:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:16.112 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:16.112 --rc genhtml_branch_coverage=1 00:18:16.112 --rc genhtml_function_coverage=1 00:18:16.112 --rc genhtml_legend=1 00:18:16.112 --rc geninfo_all_blocks=1 00:18:16.112 --rc geninfo_unexecuted_blocks=1 00:18:16.112 00:18:16.112 ' 00:18:16.112 15:42:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:16.112 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:16.112 --rc genhtml_branch_coverage=1 00:18:16.112 --rc genhtml_function_coverage=1 00:18:16.112 --rc genhtml_legend=1 00:18:16.112 --rc geninfo_all_blocks=1 00:18:16.112 --rc geninfo_unexecuted_blocks=1 00:18:16.112 00:18:16.112 ' 00:18:16.112 15:42:07 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:16.112 15:42:07 -- nvmf/common.sh@7 -- # uname -s 00:18:16.112 15:42:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:16.112 15:42:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:16.112 15:42:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:16.112 15:42:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:16.112 15:42:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:16.112 15:42:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:16.112 15:42:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:16.112 15:42:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:16.112 15:42:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:16.112 15:42:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:16.112 15:42:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:16.113 15:42:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:16.113 15:42:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:16.113 15:42:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:16.113 15:42:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:16.113 15:42:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:16.113 15:42:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:16.113 15:42:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:16.113 15:42:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:16.113 15:42:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.113 15:42:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.113 15:42:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.113 15:42:07 -- paths/export.sh@5 -- # export PATH 00:18:16.113 15:42:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.113 15:42:07 -- nvmf/common.sh@46 -- # : 0 00:18:16.113 15:42:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:16.113 15:42:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:16.113 15:42:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:16.113 15:42:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:16.113 15:42:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:16.113 15:42:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:16.113 15:42:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:16.113 15:42:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:16.113 15:42:07 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:16.113 15:42:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:16.113 15:42:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:16.113 15:42:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:16.113 15:42:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:16.113 15:42:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:16.113 15:42:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:16.113 15:42:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:16.113 15:42:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:16.113 15:42:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:16.113 15:42:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:16.113 15:42:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:16.113 15:42:07 -- common/autotest_common.sh@10 -- # set +x 00:18:18.013 15:42:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:18.013 15:42:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:18.013 15:42:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:18.013 15:42:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:18.013 15:42:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:18.013 15:42:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:18.013 15:42:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:18.013 15:42:09 -- nvmf/common.sh@294 -- # net_devs=() 00:18:18.013 15:42:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:18.013 15:42:09 -- nvmf/common.sh@295 -- # e810=() 00:18:18.013 15:42:09 -- nvmf/common.sh@295 -- # local -ga e810 00:18:18.013 15:42:09 -- nvmf/common.sh@296 -- # x722=() 00:18:18.013 15:42:09 -- nvmf/common.sh@296 -- # local -ga x722 00:18:18.013 15:42:09 -- nvmf/common.sh@297 -- # mlx=() 00:18:18.013 15:42:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:18.013 15:42:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:18.013 15:42:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:18.013 15:42:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:18.013 15:42:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:18.013 15:42:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:18.013 15:42:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:18.013 15:42:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:18.013 15:42:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:18.013 15:42:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:18.013 15:42:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:18.013 15:42:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:18.013 15:42:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:18.013 15:42:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:18.013 15:42:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:18.013 15:42:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:18.013 15:42:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:18.013 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:18.013 15:42:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:18.013 15:42:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:18.013 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:18.013 15:42:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:18.013 15:42:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:18.013 15:42:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:18.013 15:42:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:18.013 15:42:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:18.013 15:42:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:18.013 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:18.013 15:42:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:18.013 15:42:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:18.013 15:42:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:18.013 15:42:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:18.013 15:42:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:18.013 15:42:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:18.013 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:18.013 15:42:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:18.013 15:42:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:18.013 15:42:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:18.013 15:42:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:18.013 15:42:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:18.013 15:42:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:18.013 15:42:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:18.013 15:42:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:18.013 15:42:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:18.013 15:42:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:18.013 15:42:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:18.013 15:42:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:18.013 15:42:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:18.013 15:42:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:18.013 15:42:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:18.013 15:42:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:18.013 15:42:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:18.013 15:42:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:18.271 15:42:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:18.271 15:42:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:18.271 15:42:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:18.271 15:42:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:18.271 15:42:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:18.271 15:42:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:18.271 15:42:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:18.271 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:18.271 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.319 ms 00:18:18.271 00:18:18.271 --- 10.0.0.2 ping statistics --- 00:18:18.271 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:18.271 rtt min/avg/max/mdev = 0.319/0.319/0.319/0.000 ms 00:18:18.271 15:42:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:18.271 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:18.271 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:18:18.271 00:18:18.271 --- 10.0.0.1 ping statistics --- 00:18:18.271 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:18.271 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:18:18.271 15:42:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:18.271 15:42:09 -- nvmf/common.sh@410 -- # return 0 00:18:18.271 15:42:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:18.271 15:42:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:18.271 15:42:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:18.271 15:42:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:18.271 15:42:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:18.271 15:42:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:18.271 15:42:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:18.271 15:42:09 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=896411 00:18:18.271 15:42:09 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:18.271 15:42:09 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:18.271 15:42:09 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 896411 00:18:18.271 15:42:09 -- common/autotest_common.sh@829 -- # '[' -z 896411 ']' 00:18:18.271 15:42:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:18.271 15:42:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:18.271 15:42:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:18.271 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:18.272 15:42:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:18.272 15:42:09 -- common/autotest_common.sh@10 -- # set +x 00:18:19.207 15:42:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:19.207 15:42:10 -- common/autotest_common.sh@862 -- # return 0 00:18:19.207 15:42:10 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:19.207 15:42:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:19.207 15:42:10 -- common/autotest_common.sh@10 -- # set +x 00:18:19.207 15:42:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:19.207 15:42:10 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:19.207 15:42:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:19.207 15:42:10 -- common/autotest_common.sh@10 -- # set +x 00:18:19.465 Malloc0 00:18:19.465 15:42:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:19.465 15:42:10 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:19.465 15:42:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:19.465 15:42:10 -- common/autotest_common.sh@10 -- # set +x 00:18:19.465 15:42:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:19.465 15:42:10 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:19.465 15:42:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:19.465 15:42:10 -- common/autotest_common.sh@10 -- # set +x 00:18:19.465 15:42:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:19.465 15:42:10 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:19.465 15:42:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:19.465 15:42:10 -- common/autotest_common.sh@10 -- # set +x 00:18:19.465 15:42:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:19.465 15:42:10 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:19.465 15:42:10 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:18:51.546 Fuzzing completed. Shutting down the fuzz application 00:18:51.546 00:18:51.546 Dumping successful admin opcodes: 00:18:51.546 8, 9, 10, 24, 00:18:51.546 Dumping successful io opcodes: 00:18:51.546 0, 9, 00:18:51.546 NS: 0x200003aeff00 I/O qp, Total commands completed: 475867, total successful commands: 2750, random_seed: 817167104 00:18:51.546 NS: 0x200003aeff00 admin qp, Total commands completed: 57408, total successful commands: 459, random_seed: 1012197952 00:18:51.546 15:42:41 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:18:51.546 Fuzzing completed. Shutting down the fuzz application 00:18:51.546 00:18:51.546 Dumping successful admin opcodes: 00:18:51.546 24, 00:18:51.546 Dumping successful io opcodes: 00:18:51.546 00:18:51.546 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 2062735414 00:18:51.546 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 2062882370 00:18:51.546 15:42:42 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:51.546 15:42:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:51.546 15:42:42 -- common/autotest_common.sh@10 -- # set +x 00:18:51.546 15:42:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:51.546 15:42:42 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:18:51.546 15:42:42 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:18:51.546 15:42:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:51.546 15:42:42 -- nvmf/common.sh@116 -- # sync 00:18:51.546 15:42:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:51.546 15:42:42 -- nvmf/common.sh@119 -- # set +e 00:18:51.546 15:42:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:51.546 15:42:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:51.546 rmmod nvme_tcp 00:18:51.546 rmmod nvme_fabrics 00:18:51.546 rmmod nvme_keyring 00:18:51.546 15:42:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:51.546 15:42:42 -- nvmf/common.sh@123 -- # set -e 00:18:51.546 15:42:42 -- nvmf/common.sh@124 -- # return 0 00:18:51.546 15:42:42 -- nvmf/common.sh@477 -- # '[' -n 896411 ']' 00:18:51.546 15:42:42 -- nvmf/common.sh@478 -- # killprocess 896411 00:18:51.546 15:42:42 -- common/autotest_common.sh@936 -- # '[' -z 896411 ']' 00:18:51.546 15:42:42 -- common/autotest_common.sh@940 -- # kill -0 896411 00:18:51.546 15:42:42 -- common/autotest_common.sh@941 -- # uname 00:18:51.546 15:42:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:51.546 15:42:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 896411 00:18:51.546 15:42:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:51.546 15:42:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:51.546 15:42:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 896411' 00:18:51.546 killing process with pid 896411 00:18:51.546 15:42:42 -- common/autotest_common.sh@955 -- # kill 896411 00:18:51.546 15:42:42 -- common/autotest_common.sh@960 -- # wait 896411 00:18:51.806 15:42:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:51.806 15:42:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:51.806 15:42:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:51.806 15:42:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:51.806 15:42:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:51.806 15:42:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:51.806 15:42:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:51.806 15:42:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:53.710 15:42:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:53.710 15:42:45 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:18:53.710 00:18:53.710 real 0m37.768s 00:18:53.710 user 0m52.576s 00:18:53.710 sys 0m14.683s 00:18:53.710 15:42:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:53.710 15:42:45 -- common/autotest_common.sh@10 -- # set +x 00:18:53.710 ************************************ 00:18:53.710 END TEST nvmf_fuzz 00:18:53.710 ************************************ 00:18:53.710 15:42:45 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:53.710 15:42:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:53.710 15:42:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:53.710 15:42:45 -- common/autotest_common.sh@10 -- # set +x 00:18:53.710 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:18:53.710 ************************************ 00:18:53.710 START TEST nvmf_multiconnection 00:18:53.710 ************************************ 00:18:53.710 15:42:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:53.969 * Looking for test storage... 00:18:53.969 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:53.969 15:42:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:53.969 15:42:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:53.969 15:42:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:53.969 15:42:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:53.969 15:42:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:53.969 15:42:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:53.969 15:42:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:53.969 15:42:45 -- scripts/common.sh@335 -- # IFS=.-: 00:18:53.969 15:42:45 -- scripts/common.sh@335 -- # read -ra ver1 00:18:53.969 15:42:45 -- scripts/common.sh@336 -- # IFS=.-: 00:18:53.969 15:42:45 -- scripts/common.sh@336 -- # read -ra ver2 00:18:53.969 15:42:45 -- scripts/common.sh@337 -- # local 'op=<' 00:18:53.969 15:42:45 -- scripts/common.sh@339 -- # ver1_l=2 00:18:53.969 15:42:45 -- scripts/common.sh@340 -- # ver2_l=1 00:18:53.969 15:42:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:53.969 15:42:45 -- scripts/common.sh@343 -- # case "$op" in 00:18:53.969 15:42:45 -- scripts/common.sh@344 -- # : 1 00:18:53.969 15:42:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:53.969 15:42:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:53.969 15:42:45 -- scripts/common.sh@364 -- # decimal 1 00:18:53.969 15:42:45 -- scripts/common.sh@352 -- # local d=1 00:18:53.969 15:42:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:53.969 15:42:45 -- scripts/common.sh@354 -- # echo 1 00:18:53.969 15:42:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:53.969 15:42:45 -- scripts/common.sh@365 -- # decimal 2 00:18:53.969 15:42:45 -- scripts/common.sh@352 -- # local d=2 00:18:53.969 15:42:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:53.969 15:42:45 -- scripts/common.sh@354 -- # echo 2 00:18:53.969 15:42:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:53.969 15:42:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:53.969 15:42:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:53.969 15:42:45 -- scripts/common.sh@367 -- # return 0 00:18:53.969 15:42:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:53.969 15:42:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:53.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:53.969 --rc genhtml_branch_coverage=1 00:18:53.969 --rc genhtml_function_coverage=1 00:18:53.969 --rc genhtml_legend=1 00:18:53.969 --rc geninfo_all_blocks=1 00:18:53.969 --rc geninfo_unexecuted_blocks=1 00:18:53.969 00:18:53.969 ' 00:18:53.969 15:42:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:53.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:53.969 --rc genhtml_branch_coverage=1 00:18:53.969 --rc genhtml_function_coverage=1 00:18:53.969 --rc genhtml_legend=1 00:18:53.969 --rc geninfo_all_blocks=1 00:18:53.969 --rc geninfo_unexecuted_blocks=1 00:18:53.969 00:18:53.969 ' 00:18:53.969 15:42:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:53.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:53.969 --rc genhtml_branch_coverage=1 00:18:53.969 --rc genhtml_function_coverage=1 00:18:53.969 --rc genhtml_legend=1 00:18:53.969 --rc geninfo_all_blocks=1 00:18:53.969 --rc geninfo_unexecuted_blocks=1 00:18:53.969 00:18:53.969 ' 00:18:53.969 15:42:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:53.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:53.969 --rc genhtml_branch_coverage=1 00:18:53.969 --rc genhtml_function_coverage=1 00:18:53.969 --rc genhtml_legend=1 00:18:53.969 --rc geninfo_all_blocks=1 00:18:53.969 --rc geninfo_unexecuted_blocks=1 00:18:53.969 00:18:53.969 ' 00:18:53.969 15:42:45 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:53.969 15:42:45 -- nvmf/common.sh@7 -- # uname -s 00:18:53.969 15:42:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:53.969 15:42:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:53.969 15:42:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:53.969 15:42:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:53.969 15:42:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:53.969 15:42:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:53.969 15:42:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:53.969 15:42:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:53.970 15:42:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:53.970 15:42:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:53.970 15:42:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:53.970 15:42:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:53.970 15:42:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:53.970 15:42:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:53.970 15:42:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:53.970 15:42:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:53.970 15:42:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:53.970 15:42:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:53.970 15:42:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:53.970 15:42:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.970 15:42:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.970 15:42:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.970 15:42:45 -- paths/export.sh@5 -- # export PATH 00:18:53.970 15:42:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.970 15:42:45 -- nvmf/common.sh@46 -- # : 0 00:18:53.970 15:42:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:53.970 15:42:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:53.970 15:42:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:53.970 15:42:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:53.970 15:42:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:53.970 15:42:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:53.970 15:42:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:53.970 15:42:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:53.970 15:42:45 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:53.970 15:42:45 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:53.970 15:42:45 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:18:53.970 15:42:45 -- target/multiconnection.sh@16 -- # nvmftestinit 00:18:53.970 15:42:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:53.970 15:42:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:53.970 15:42:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:53.970 15:42:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:53.970 15:42:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:53.970 15:42:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:53.970 15:42:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:53.970 15:42:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:53.970 15:42:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:53.970 15:42:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:53.970 15:42:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:53.970 15:42:45 -- common/autotest_common.sh@10 -- # set +x 00:18:55.872 15:42:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:55.872 15:42:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:55.872 15:42:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:55.872 15:42:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:55.872 15:42:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:56.131 15:42:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:56.131 15:42:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:56.131 15:42:47 -- nvmf/common.sh@294 -- # net_devs=() 00:18:56.131 15:42:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:56.131 15:42:47 -- nvmf/common.sh@295 -- # e810=() 00:18:56.131 15:42:47 -- nvmf/common.sh@295 -- # local -ga e810 00:18:56.131 15:42:47 -- nvmf/common.sh@296 -- # x722=() 00:18:56.131 15:42:47 -- nvmf/common.sh@296 -- # local -ga x722 00:18:56.131 15:42:47 -- nvmf/common.sh@297 -- # mlx=() 00:18:56.131 15:42:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:56.131 15:42:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:56.131 15:42:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:56.131 15:42:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:56.131 15:42:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:56.131 15:42:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:56.131 15:42:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:56.131 15:42:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:56.131 15:42:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:56.131 15:42:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:56.131 15:42:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:56.131 15:42:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:56.131 15:42:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:56.131 15:42:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:56.131 15:42:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:56.131 15:42:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:56.131 15:42:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:56.131 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:56.131 15:42:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:56.131 15:42:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:56.131 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:56.131 15:42:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:56.131 15:42:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:56.131 15:42:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:56.131 15:42:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:56.131 15:42:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:56.131 15:42:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:56.131 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:56.131 15:42:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:56.131 15:42:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:56.131 15:42:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:56.131 15:42:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:56.131 15:42:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:56.131 15:42:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:56.131 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:56.131 15:42:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:56.131 15:42:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:56.131 15:42:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:56.131 15:42:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:56.131 15:42:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:56.131 15:42:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:56.131 15:42:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:56.131 15:42:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:56.131 15:42:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:56.131 15:42:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:56.131 15:42:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:56.131 15:42:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:56.131 15:42:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:56.131 15:42:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:56.131 15:42:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:56.131 15:42:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:56.131 15:42:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:56.131 15:42:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:56.131 15:42:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:56.131 15:42:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:56.131 15:42:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:56.131 15:42:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:56.390 15:42:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:56.390 15:42:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:56.390 15:42:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:56.390 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:56.390 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.334 ms 00:18:56.390 00:18:56.390 --- 10.0.0.2 ping statistics --- 00:18:56.390 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:56.390 rtt min/avg/max/mdev = 0.334/0.334/0.334/0.000 ms 00:18:56.390 15:42:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:56.390 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:56.390 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.184 ms 00:18:56.390 00:18:56.390 --- 10.0.0.1 ping statistics --- 00:18:56.390 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:56.390 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:18:56.390 15:42:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:56.390 15:42:47 -- nvmf/common.sh@410 -- # return 0 00:18:56.390 15:42:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:56.390 15:42:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:56.390 15:42:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:56.390 15:42:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:56.390 15:42:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:56.390 15:42:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:56.390 15:42:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:56.390 15:42:47 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:18:56.390 15:42:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:56.390 15:42:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:56.390 15:42:47 -- common/autotest_common.sh@10 -- # set +x 00:18:56.390 15:42:47 -- nvmf/common.sh@469 -- # nvmfpid=902170 00:18:56.390 15:42:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:56.390 15:42:47 -- nvmf/common.sh@470 -- # waitforlisten 902170 00:18:56.390 15:42:47 -- common/autotest_common.sh@829 -- # '[' -z 902170 ']' 00:18:56.390 15:42:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:56.390 15:42:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:56.390 15:42:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:56.390 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:56.390 15:42:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:56.390 15:42:47 -- common/autotest_common.sh@10 -- # set +x 00:18:56.390 [2024-11-26 15:42:47.664657] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:56.390 [2024-11-26 15:42:47.664752] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:56.390 EAL: No free 2048 kB hugepages reported on node 1 00:18:56.390 [2024-11-26 15:42:47.728200] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:56.390 [2024-11-26 15:42:47.836389] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:56.390 [2024-11-26 15:42:47.836534] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:56.390 [2024-11-26 15:42:47.836561] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:56.390 [2024-11-26 15:42:47.836588] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:56.390 [2024-11-26 15:42:47.836653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:56.390 [2024-11-26 15:42:47.836705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:56.390 [2024-11-26 15:42:47.836750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:56.390 [2024-11-26 15:42:47.836755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:57.326 15:42:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:57.326 15:42:48 -- common/autotest_common.sh@862 -- # return 0 00:18:57.326 15:42:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:57.326 15:42:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:57.326 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.326 15:42:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:57.326 15:42:48 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:57.326 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.326 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.326 [2024-11-26 15:42:48.708507] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:57.326 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.326 15:42:48 -- target/multiconnection.sh@21 -- # seq 1 11 00:18:57.326 15:42:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:57.326 15:42:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:18:57.326 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.326 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.326 Malloc1 00:18:57.326 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.326 15:42:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:18:57.326 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.326 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.326 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.326 15:42:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:18:57.326 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.326 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.326 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.326 15:42:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:57.326 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.326 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.326 [2024-11-26 15:42:48.766397] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:57.326 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.326 15:42:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:57.326 15:42:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:18:57.326 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.326 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.585 Malloc2 00:18:57.585 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.585 15:42:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:57.585 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.585 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.585 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.585 15:42:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:18:57.585 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.585 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.585 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.585 15:42:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:18:57.585 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.585 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.585 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.585 15:42:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:57.585 15:42:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:18:57.585 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.585 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.585 Malloc3 00:18:57.585 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.585 15:42:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:18:57.585 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.585 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.585 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.585 15:42:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:18:57.585 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.586 15:42:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:18:57.586 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.586 15:42:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:57.586 15:42:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:18:57.586 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 Malloc4 00:18:57.586 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.586 15:42:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:18:57.586 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.586 15:42:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:18:57.586 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.586 15:42:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:18:57.586 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.586 15:42:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:57.586 15:42:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:18:57.586 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 Malloc5 00:18:57.586 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.586 15:42:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:18:57.586 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.586 15:42:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:18:57.586 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.586 15:42:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:18:57.586 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.586 15:42:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:57.586 15:42:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:18:57.586 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 Malloc6 00:18:57.586 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.586 15:42:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:18:57.586 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 15:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.586 15:42:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:18:57.586 15:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:48 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.586 15:42:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:18:57.586 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.586 15:42:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:57.586 15:42:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:18:57.586 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.586 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.586 Malloc7 00:18:57.868 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.868 15:42:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:18:57.868 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.869 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.869 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.869 15:42:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:18:57.869 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.869 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.869 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.869 15:42:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:18:57.869 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.869 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.869 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.869 15:42:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:57.869 15:42:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:18:57.869 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.869 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.869 Malloc8 00:18:57.869 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.869 15:42:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:18:57.869 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.869 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.869 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.869 15:42:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:18:57.869 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.869 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.869 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.869 15:42:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:18:57.869 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.869 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.869 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.869 15:42:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:57.869 15:42:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:18:57.869 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.869 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.869 Malloc9 00:18:57.869 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.869 15:42:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:18:57.869 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.869 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.869 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.869 15:42:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:18:57.869 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.869 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.869 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.869 15:42:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:18:57.869 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.869 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.869 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.869 15:42:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:57.869 15:42:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:18:57.870 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.870 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.870 Malloc10 00:18:57.870 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.870 15:42:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:18:57.870 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.870 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.870 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.870 15:42:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:18:57.870 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.870 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.870 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.870 15:42:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:18:57.870 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.870 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.870 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.870 15:42:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:57.870 15:42:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:18:57.870 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.870 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.870 Malloc11 00:18:57.870 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.870 15:42:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:18:57.870 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.870 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.870 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.870 15:42:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:18:57.870 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.870 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.870 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.870 15:42:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:18:57.870 15:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.870 15:42:49 -- common/autotest_common.sh@10 -- # set +x 00:18:57.870 15:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.870 15:42:49 -- target/multiconnection.sh@28 -- # seq 1 11 00:18:57.870 15:42:49 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:57.870 15:42:49 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:18:58.810 15:42:49 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:18:58.811 15:42:49 -- common/autotest_common.sh@1187 -- # local i=0 00:18:58.811 15:42:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:18:58.811 15:42:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:18:58.811 15:42:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:00.707 15:42:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:00.707 15:42:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:00.707 15:42:51 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:00.707 15:42:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:00.707 15:42:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:00.707 15:42:51 -- common/autotest_common.sh@1197 -- # return 0 00:19:00.707 15:42:51 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:00.707 15:42:51 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:01.273 15:42:52 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:01.273 15:42:52 -- common/autotest_common.sh@1187 -- # local i=0 00:19:01.273 15:42:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:01.273 15:42:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:01.273 15:42:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:03.801 15:42:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:03.801 15:42:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:03.801 15:42:54 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:03.801 15:42:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:03.801 15:42:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:03.801 15:42:54 -- common/autotest_common.sh@1197 -- # return 0 00:19:03.801 15:42:54 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:03.802 15:42:54 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:04.059 15:42:55 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:04.059 15:42:55 -- common/autotest_common.sh@1187 -- # local i=0 00:19:04.059 15:42:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:04.059 15:42:55 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:04.059 15:42:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:05.976 15:42:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:05.976 15:42:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:05.976 15:42:57 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:05.976 15:42:57 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:05.976 15:42:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:05.976 15:42:57 -- common/autotest_common.sh@1197 -- # return 0 00:19:05.976 15:42:57 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:05.976 15:42:57 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:06.909 15:42:58 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:06.909 15:42:58 -- common/autotest_common.sh@1187 -- # local i=0 00:19:06.909 15:42:58 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:06.909 15:42:58 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:06.909 15:42:58 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:08.806 15:43:00 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:08.806 15:43:00 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:08.806 15:43:00 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:08.806 15:43:00 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:08.806 15:43:00 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:08.806 15:43:00 -- common/autotest_common.sh@1197 -- # return 0 00:19:08.806 15:43:00 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:08.806 15:43:00 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:09.739 15:43:00 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:09.739 15:43:00 -- common/autotest_common.sh@1187 -- # local i=0 00:19:09.739 15:43:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:09.739 15:43:00 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:09.739 15:43:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:11.693 15:43:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:11.693 15:43:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:11.693 15:43:02 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:11.693 15:43:02 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:11.693 15:43:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:11.693 15:43:02 -- common/autotest_common.sh@1197 -- # return 0 00:19:11.693 15:43:02 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:11.693 15:43:02 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:12.259 15:43:03 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:12.259 15:43:03 -- common/autotest_common.sh@1187 -- # local i=0 00:19:12.259 15:43:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:12.259 15:43:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:12.259 15:43:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:14.787 15:43:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:14.787 15:43:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:14.787 15:43:05 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:14.787 15:43:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:14.787 15:43:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:14.787 15:43:05 -- common/autotest_common.sh@1197 -- # return 0 00:19:14.787 15:43:05 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:14.787 15:43:05 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:15.045 15:43:06 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:15.045 15:43:06 -- common/autotest_common.sh@1187 -- # local i=0 00:19:15.045 15:43:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:15.045 15:43:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:15.045 15:43:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:17.571 15:43:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:17.571 15:43:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:17.571 15:43:08 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:17.571 15:43:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:17.571 15:43:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:17.571 15:43:08 -- common/autotest_common.sh@1197 -- # return 0 00:19:17.571 15:43:08 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:17.571 15:43:08 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:18.136 15:43:09 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:18.136 15:43:09 -- common/autotest_common.sh@1187 -- # local i=0 00:19:18.136 15:43:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:18.136 15:43:09 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:18.136 15:43:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:20.035 15:43:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:20.035 15:43:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:20.035 15:43:11 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:20.035 15:43:11 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:20.035 15:43:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:20.035 15:43:11 -- common/autotest_common.sh@1197 -- # return 0 00:19:20.035 15:43:11 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:20.035 15:43:11 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:20.968 15:43:12 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:20.968 15:43:12 -- common/autotest_common.sh@1187 -- # local i=0 00:19:20.968 15:43:12 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:20.968 15:43:12 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:20.968 15:43:12 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:22.866 15:43:14 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:22.866 15:43:14 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:22.866 15:43:14 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:19:23.124 15:43:14 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:23.124 15:43:14 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:23.124 15:43:14 -- common/autotest_common.sh@1197 -- # return 0 00:19:23.124 15:43:14 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.124 15:43:14 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:24.068 15:43:15 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:24.068 15:43:15 -- common/autotest_common.sh@1187 -- # local i=0 00:19:24.068 15:43:15 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:24.068 15:43:15 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:24.068 15:43:15 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:25.968 15:43:17 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:25.968 15:43:17 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:25.968 15:43:17 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:19:25.968 15:43:17 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:25.968 15:43:17 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:25.968 15:43:17 -- common/autotest_common.sh@1197 -- # return 0 00:19:25.968 15:43:17 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:25.968 15:43:17 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:19:26.902 15:43:18 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:19:26.902 15:43:18 -- common/autotest_common.sh@1187 -- # local i=0 00:19:26.902 15:43:18 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:26.902 15:43:18 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:26.902 15:43:18 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:28.805 15:43:20 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:28.805 15:43:20 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:28.805 15:43:20 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:19:28.805 15:43:20 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:28.805 15:43:20 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:28.805 15:43:20 -- common/autotest_common.sh@1197 -- # return 0 00:19:28.805 15:43:20 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:19:28.805 [global] 00:19:28.805 thread=1 00:19:28.805 invalidate=1 00:19:28.805 rw=read 00:19:28.805 time_based=1 00:19:28.805 runtime=10 00:19:28.805 ioengine=libaio 00:19:28.805 direct=1 00:19:28.805 bs=262144 00:19:28.805 iodepth=64 00:19:28.805 norandommap=1 00:19:28.805 numjobs=1 00:19:28.805 00:19:28.805 [job0] 00:19:28.805 filename=/dev/nvme0n1 00:19:28.805 [job1] 00:19:28.805 filename=/dev/nvme10n1 00:19:28.805 [job2] 00:19:28.805 filename=/dev/nvme1n1 00:19:28.805 [job3] 00:19:28.805 filename=/dev/nvme2n1 00:19:28.805 [job4] 00:19:28.805 filename=/dev/nvme3n1 00:19:28.805 [job5] 00:19:28.805 filename=/dev/nvme4n1 00:19:28.805 [job6] 00:19:28.805 filename=/dev/nvme5n1 00:19:28.805 [job7] 00:19:28.805 filename=/dev/nvme6n1 00:19:28.805 [job8] 00:19:28.805 filename=/dev/nvme7n1 00:19:28.805 [job9] 00:19:28.805 filename=/dev/nvme8n1 00:19:28.805 [job10] 00:19:28.805 filename=/dev/nvme9n1 00:19:29.063 Could not set queue depth (nvme0n1) 00:19:29.063 Could not set queue depth (nvme10n1) 00:19:29.063 Could not set queue depth (nvme1n1) 00:19:29.063 Could not set queue depth (nvme2n1) 00:19:29.063 Could not set queue depth (nvme3n1) 00:19:29.063 Could not set queue depth (nvme4n1) 00:19:29.063 Could not set queue depth (nvme5n1) 00:19:29.063 Could not set queue depth (nvme6n1) 00:19:29.063 Could not set queue depth (nvme7n1) 00:19:29.063 Could not set queue depth (nvme8n1) 00:19:29.063 Could not set queue depth (nvme9n1) 00:19:29.063 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:29.063 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:29.063 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:29.063 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:29.063 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:29.063 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:29.063 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:29.063 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:29.063 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:29.063 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:29.063 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:29.063 fio-3.35 00:19:29.063 Starting 11 threads 00:19:41.267 00:19:41.267 job0: (groupid=0, jobs=1): err= 0: pid=906514: Tue Nov 26 15:43:30 2024 00:19:41.267 read: IOPS=576, BW=144MiB/s (151MB/s)(1453MiB/10086msec) 00:19:41.267 slat (usec): min=14, max=66774, avg=1705.89, stdev=5072.02 00:19:41.267 clat (msec): min=2, max=260, avg=109.31, stdev=43.94 00:19:41.267 lat (msec): min=2, max=260, avg=111.01, stdev=44.61 00:19:41.267 clat percentiles (msec): 00:19:41.267 | 1.00th=[ 30], 5.00th=[ 34], 10.00th=[ 53], 20.00th=[ 70], 00:19:41.267 | 30.00th=[ 84], 40.00th=[ 96], 50.00th=[ 108], 60.00th=[ 117], 00:19:41.267 | 70.00th=[ 134], 80.00th=[ 150], 90.00th=[ 167], 95.00th=[ 182], 00:19:41.267 | 99.00th=[ 218], 99.50th=[ 228], 99.90th=[ 243], 99.95th=[ 243], 00:19:41.267 | 99.99th=[ 262] 00:19:41.267 bw ( KiB/s): min=92160, max=344064, per=8.37%, avg=147118.25, stdev=61174.10, samples=20 00:19:41.267 iops : min= 360, max= 1344, avg=574.60, stdev=238.99, samples=20 00:19:41.267 lat (msec) : 4=0.17%, 50=9.26%, 100=33.37%, 250=57.16%, 500=0.03% 00:19:41.267 cpu : usr=0.40%, sys=2.05%, ctx=987, majf=0, minf=4097 00:19:41.267 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:41.267 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.267 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:41.267 issued rwts: total=5810,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.267 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:41.267 job1: (groupid=0, jobs=1): err= 0: pid=906515: Tue Nov 26 15:43:30 2024 00:19:41.267 read: IOPS=538, BW=135MiB/s (141MB/s)(1358MiB/10090msec) 00:19:41.267 slat (usec): min=9, max=95109, avg=1647.20, stdev=5727.42 00:19:41.267 clat (usec): min=1823, max=390990, avg=117155.19, stdev=64361.99 00:19:41.267 lat (usec): min=1844, max=431794, avg=118802.39, stdev=65399.90 00:19:41.267 clat percentiles (msec): 00:19:41.267 | 1.00th=[ 6], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 71], 00:19:41.267 | 30.00th=[ 90], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 127], 00:19:41.267 | 70.00th=[ 138], 80.00th=[ 153], 90.00th=[ 182], 95.00th=[ 241], 00:19:41.267 | 99.00th=[ 338], 99.50th=[ 355], 99.90th=[ 368], 99.95th=[ 380], 00:19:41.267 | 99.99th=[ 393] 00:19:41.267 bw ( KiB/s): min=45568, max=400896, per=7.82%, avg=137420.80, stdev=73434.06, samples=20 00:19:41.267 iops : min= 178, max= 1566, avg=536.80, stdev=286.85, samples=20 00:19:41.267 lat (msec) : 2=0.02%, 4=0.66%, 10=1.44%, 20=1.36%, 50=12.26% 00:19:41.267 lat (msec) : 100=21.45%, 250=58.26%, 500=4.55% 00:19:41.267 cpu : usr=0.35%, sys=1.86%, ctx=1032, majf=0, minf=4097 00:19:41.267 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:41.267 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.267 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:41.267 issued rwts: total=5431,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.267 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:41.267 job2: (groupid=0, jobs=1): err= 0: pid=906516: Tue Nov 26 15:43:30 2024 00:19:41.267 read: IOPS=736, BW=184MiB/s (193MB/s)(1857MiB/10085msec) 00:19:41.267 slat (usec): min=9, max=95426, avg=921.52, stdev=4442.90 00:19:41.267 clat (usec): min=834, max=287250, avg=85893.90, stdev=52754.03 00:19:41.267 lat (usec): min=891, max=287281, avg=86815.42, stdev=53418.77 00:19:41.267 clat percentiles (msec): 00:19:41.267 | 1.00th=[ 4], 5.00th=[ 10], 10.00th=[ 18], 20.00th=[ 38], 00:19:41.267 | 30.00th=[ 55], 40.00th=[ 63], 50.00th=[ 75], 60.00th=[ 94], 00:19:41.267 | 70.00th=[ 114], 80.00th=[ 138], 90.00th=[ 163], 95.00th=[ 182], 00:19:41.267 | 99.00th=[ 207], 99.50th=[ 220], 99.90th=[ 247], 99.95th=[ 249], 00:19:41.267 | 99.99th=[ 288] 00:19:41.267 bw ( KiB/s): min=100352, max=318976, per=10.73%, avg=188579.95, stdev=72321.16, samples=20 00:19:41.267 iops : min= 392, max= 1246, avg=736.60, stdev=282.55, samples=20 00:19:41.267 lat (usec) : 1000=0.04% 00:19:41.268 lat (msec) : 2=0.07%, 4=1.47%, 10=3.84%, 20=5.56%, 50=15.83% 00:19:41.268 lat (msec) : 100=36.63%, 250=36.53%, 500=0.04% 00:19:41.268 cpu : usr=0.34%, sys=2.08%, ctx=1458, majf=0, minf=4097 00:19:41.268 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:41.268 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.268 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:41.268 issued rwts: total=7429,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.268 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:41.268 job3: (groupid=0, jobs=1): err= 0: pid=906517: Tue Nov 26 15:43:30 2024 00:19:41.268 read: IOPS=749, BW=187MiB/s (197MB/s)(1888MiB/10073msec) 00:19:41.268 slat (usec): min=9, max=92533, avg=1040.04, stdev=4809.88 00:19:41.268 clat (usec): min=748, max=270187, avg=84251.98, stdev=56397.05 00:19:41.268 lat (usec): min=789, max=270232, avg=85292.02, stdev=57113.32 00:19:41.268 clat percentiles (msec): 00:19:41.268 | 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 12], 20.00th=[ 25], 00:19:41.268 | 30.00th=[ 39], 40.00th=[ 59], 50.00th=[ 87], 60.00th=[ 104], 00:19:41.268 | 70.00th=[ 118], 80.00th=[ 140], 90.00th=[ 163], 95.00th=[ 180], 00:19:41.268 | 99.00th=[ 211], 99.50th=[ 215], 99.90th=[ 236], 99.95th=[ 236], 00:19:41.268 | 99.99th=[ 271] 00:19:41.268 bw ( KiB/s): min=83968, max=378880, per=10.91%, avg=191689.40, stdev=84573.28, samples=20 00:19:41.268 iops : min= 328, max= 1480, avg=748.75, stdev=330.32, samples=20 00:19:41.268 lat (usec) : 750=0.01%, 1000=0.07% 00:19:41.268 lat (msec) : 2=0.09%, 4=0.97%, 10=7.36%, 20=7.08%, 50=20.19% 00:19:41.268 lat (msec) : 100=22.88%, 250=41.31%, 500=0.03% 00:19:41.268 cpu : usr=0.37%, sys=2.24%, ctx=1429, majf=0, minf=3721 00:19:41.268 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:41.268 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.268 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:41.268 issued rwts: total=7552,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.268 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:41.268 job4: (groupid=0, jobs=1): err= 0: pid=906518: Tue Nov 26 15:43:30 2024 00:19:41.268 read: IOPS=425, BW=106MiB/s (112MB/s)(1073MiB/10084msec) 00:19:41.268 slat (usec): min=9, max=86288, avg=2019.84, stdev=6835.45 00:19:41.268 clat (msec): min=6, max=394, avg=148.17, stdev=53.71 00:19:41.268 lat (msec): min=6, max=407, avg=150.18, stdev=54.72 00:19:41.268 clat percentiles (msec): 00:19:41.268 | 1.00th=[ 33], 5.00th=[ 87], 10.00th=[ 99], 20.00th=[ 112], 00:19:41.268 | 30.00th=[ 123], 40.00th=[ 132], 50.00th=[ 140], 60.00th=[ 148], 00:19:41.268 | 70.00th=[ 161], 80.00th=[ 176], 90.00th=[ 207], 95.00th=[ 266], 00:19:41.268 | 99.00th=[ 338], 99.50th=[ 351], 99.90th=[ 388], 99.95th=[ 397], 00:19:41.268 | 99.99th=[ 397] 00:19:41.268 bw ( KiB/s): min=47104, max=154624, per=6.16%, avg=108273.25, stdev=27758.85, samples=20 00:19:41.268 iops : min= 184, max= 604, avg=422.90, stdev=108.37, samples=20 00:19:41.268 lat (msec) : 10=0.30%, 20=0.54%, 50=0.72%, 100=9.27%, 250=83.74% 00:19:41.268 lat (msec) : 500=5.43% 00:19:41.268 cpu : usr=0.18%, sys=1.59%, ctx=859, majf=0, minf=4097 00:19:41.268 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:19:41.268 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.268 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:41.268 issued rwts: total=4293,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.268 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:41.268 job5: (groupid=0, jobs=1): err= 0: pid=906519: Tue Nov 26 15:43:30 2024 00:19:41.268 read: IOPS=482, BW=121MiB/s (127MB/s)(1218MiB/10087msec) 00:19:41.268 slat (usec): min=14, max=94716, avg=1911.15, stdev=6381.58 00:19:41.268 clat (usec): min=1976, max=377087, avg=130483.60, stdev=62421.75 00:19:41.268 lat (msec): min=2, max=425, avg=132.39, stdev=63.53 00:19:41.268 clat percentiles (msec): 00:19:41.268 | 1.00th=[ 8], 5.00th=[ 35], 10.00th=[ 51], 20.00th=[ 85], 00:19:41.268 | 30.00th=[ 105], 40.00th=[ 116], 50.00th=[ 127], 60.00th=[ 144], 00:19:41.268 | 70.00th=[ 155], 80.00th=[ 167], 90.00th=[ 186], 95.00th=[ 257], 00:19:41.268 | 99.00th=[ 330], 99.50th=[ 338], 99.90th=[ 376], 99.95th=[ 376], 00:19:41.268 | 99.99th=[ 376] 00:19:41.268 bw ( KiB/s): min=47104, max=324096, per=7.00%, avg=123070.70, stdev=56612.60, samples=20 00:19:41.268 iops : min= 184, max= 1266, avg=480.70, stdev=221.13, samples=20 00:19:41.268 lat (msec) : 2=0.02%, 4=0.41%, 10=0.72%, 20=0.94%, 50=7.76% 00:19:41.268 lat (msec) : 100=17.96%, 250=66.89%, 500=5.30% 00:19:41.268 cpu : usr=0.39%, sys=1.79%, ctx=955, majf=0, minf=4097 00:19:41.268 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:41.268 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.268 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:41.268 issued rwts: total=4871,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.268 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:41.268 job6: (groupid=0, jobs=1): err= 0: pid=906520: Tue Nov 26 15:43:30 2024 00:19:41.268 read: IOPS=897, BW=224MiB/s (235MB/s)(2256MiB/10051msec) 00:19:41.268 slat (usec): min=8, max=107690, avg=646.25, stdev=3412.14 00:19:41.268 clat (usec): min=1042, max=253349, avg=70586.04, stdev=56994.24 00:19:41.268 lat (usec): min=1058, max=257967, avg=71232.30, stdev=57489.78 00:19:41.268 clat percentiles (msec): 00:19:41.268 | 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 12], 20.00th=[ 23], 00:19:41.268 | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 42], 60.00th=[ 70], 00:19:41.268 | 70.00th=[ 109], 80.00th=[ 133], 90.00th=[ 157], 95.00th=[ 171], 00:19:41.268 | 99.00th=[ 213], 99.50th=[ 230], 99.90th=[ 241], 99.95th=[ 243], 00:19:41.268 | 99.99th=[ 253] 00:19:41.268 bw ( KiB/s): min=104448, max=585216, per=13.05%, avg=229338.10, stdev=156443.62, samples=20 00:19:41.268 iops : min= 408, max= 2286, avg=895.85, stdev=611.11, samples=20 00:19:41.268 lat (msec) : 2=0.60%, 4=1.05%, 10=7.19%, 20=9.29%, 50=35.60% 00:19:41.268 lat (msec) : 100=13.46%, 250=32.78%, 500=0.03% 00:19:41.268 cpu : usr=0.32%, sys=2.49%, ctx=1879, majf=0, minf=4097 00:19:41.268 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:41.268 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.268 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:41.268 issued rwts: total=9022,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.268 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:41.268 job7: (groupid=0, jobs=1): err= 0: pid=906521: Tue Nov 26 15:43:30 2024 00:19:41.268 read: IOPS=619, BW=155MiB/s (162MB/s)(1551MiB/10019msec) 00:19:41.268 slat (usec): min=9, max=76706, avg=1286.62, stdev=4850.70 00:19:41.268 clat (usec): min=804, max=400656, avg=101980.53, stdev=70325.95 00:19:41.268 lat (usec): min=839, max=400702, avg=103267.15, stdev=71401.55 00:19:41.268 clat percentiles (msec): 00:19:41.268 | 1.00th=[ 6], 5.00th=[ 12], 10.00th=[ 22], 20.00th=[ 37], 00:19:41.268 | 30.00th=[ 51], 40.00th=[ 65], 50.00th=[ 103], 60.00th=[ 120], 00:19:41.268 | 70.00th=[ 136], 80.00th=[ 153], 90.00th=[ 182], 95.00th=[ 222], 00:19:41.268 | 99.00th=[ 334], 99.50th=[ 342], 99.90th=[ 368], 99.95th=[ 380], 00:19:41.268 | 99.99th=[ 401] 00:19:41.268 bw ( KiB/s): min=47104, max=369664, per=8.95%, avg=157227.70, stdev=92309.33, samples=20 00:19:41.268 iops : min= 184, max= 1444, avg=614.15, stdev=360.55, samples=20 00:19:41.268 lat (usec) : 1000=0.02% 00:19:41.268 lat (msec) : 2=0.06%, 4=0.69%, 10=2.35%, 20=6.30%, 50=20.65% 00:19:41.268 lat (msec) : 100=18.67%, 250=47.37%, 500=3.88% 00:19:41.268 cpu : usr=0.24%, sys=2.19%, ctx=1266, majf=0, minf=4097 00:19:41.268 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:41.268 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.268 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:41.268 issued rwts: total=6204,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.268 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:41.268 job8: (groupid=0, jobs=1): err= 0: pid=906522: Tue Nov 26 15:43:30 2024 00:19:41.268 read: IOPS=679, BW=170MiB/s (178MB/s)(1708MiB/10048msec) 00:19:41.268 slat (usec): min=9, max=207564, avg=767.58, stdev=5033.58 00:19:41.268 clat (usec): min=985, max=537866, avg=93316.01, stdev=67570.08 00:19:41.268 lat (usec): min=1021, max=537936, avg=94083.60, stdev=68216.66 00:19:41.268 clat percentiles (usec): 00:19:41.268 | 1.00th=[ 1991], 5.00th=[ 4817], 10.00th=[ 17171], 20.00th=[ 31589], 00:19:41.268 | 30.00th=[ 50594], 40.00th=[ 61080], 50.00th=[ 76022], 60.00th=[101188], 00:19:41.268 | 70.00th=[127402], 80.00th=[149947], 90.00th=[177210], 95.00th=[200279], 00:19:41.268 | 99.00th=[329253], 99.50th=[337642], 99.90th=[350225], 99.95th=[354419], 00:19:41.268 | 99.99th=[541066] 00:19:41.268 bw ( KiB/s): min=36352, max=376320, per=9.86%, avg=173235.20, stdev=84194.16, samples=20 00:19:41.268 iops : min= 142, max= 1470, avg=676.70, stdev=328.88, samples=20 00:19:41.268 lat (usec) : 1000=0.04% 00:19:41.268 lat (msec) : 2=0.98%, 4=3.51%, 10=2.71%, 20=3.44%, 50=18.74% 00:19:41.268 lat (msec) : 100=29.93%, 250=38.05%, 500=2.56%, 750=0.03% 00:19:41.268 cpu : usr=0.28%, sys=2.12%, ctx=1608, majf=0, minf=4097 00:19:41.268 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:41.268 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.268 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:41.268 issued rwts: total=6830,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.268 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:41.268 job9: (groupid=0, jobs=1): err= 0: pid=906523: Tue Nov 26 15:43:30 2024 00:19:41.268 read: IOPS=572, BW=143MiB/s (150MB/s)(1445MiB/10098msec) 00:19:41.268 slat (usec): min=9, max=243321, avg=1566.60, stdev=7566.37 00:19:41.268 clat (msec): min=3, max=559, avg=110.16, stdev=63.43 00:19:41.268 lat (msec): min=3, max=559, avg=111.73, stdev=64.56 00:19:41.268 clat percentiles (msec): 00:19:41.268 | 1.00th=[ 7], 5.00th=[ 22], 10.00th=[ 29], 20.00th=[ 72], 00:19:41.268 | 30.00th=[ 82], 40.00th=[ 91], 50.00th=[ 102], 60.00th=[ 113], 00:19:41.268 | 70.00th=[ 128], 80.00th=[ 144], 90.00th=[ 180], 95.00th=[ 228], 00:19:41.268 | 99.00th=[ 334], 99.50th=[ 338], 99.90th=[ 435], 99.95th=[ 535], 00:19:41.268 | 99.99th=[ 558] 00:19:41.268 bw ( KiB/s): min=41984, max=249344, per=8.33%, avg=146327.65, stdev=51211.19, samples=20 00:19:41.268 iops : min= 164, max= 974, avg=571.55, stdev=200.08, samples=20 00:19:41.268 lat (msec) : 4=0.16%, 10=2.25%, 20=1.68%, 50=9.05%, 100=35.91% 00:19:41.268 lat (msec) : 250=46.57%, 500=4.33%, 750=0.07% 00:19:41.268 cpu : usr=0.34%, sys=2.05%, ctx=1100, majf=0, minf=4097 00:19:41.268 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:41.269 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.269 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:41.269 issued rwts: total=5779,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.269 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:41.269 job10: (groupid=0, jobs=1): err= 0: pid=906524: Tue Nov 26 15:43:30 2024 00:19:41.269 read: IOPS=602, BW=151MiB/s (158MB/s)(1520MiB/10094msec) 00:19:41.269 slat (usec): min=8, max=226519, avg=1457.40, stdev=6760.03 00:19:41.269 clat (usec): min=805, max=547539, avg=104701.02, stdev=62587.44 00:19:41.269 lat (usec): min=826, max=547581, avg=106158.42, stdev=63690.57 00:19:41.269 clat percentiles (msec): 00:19:41.269 | 1.00th=[ 6], 5.00th=[ 17], 10.00th=[ 32], 20.00th=[ 66], 00:19:41.269 | 30.00th=[ 77], 40.00th=[ 86], 50.00th=[ 95], 60.00th=[ 109], 00:19:41.269 | 70.00th=[ 121], 80.00th=[ 136], 90.00th=[ 174], 95.00th=[ 234], 00:19:41.269 | 99.00th=[ 342], 99.50th=[ 355], 99.90th=[ 372], 99.95th=[ 397], 00:19:41.269 | 99.99th=[ 550] 00:19:41.269 bw ( KiB/s): min=40448, max=265728, per=8.77%, avg=154022.25, stdev=60859.82, samples=20 00:19:41.269 iops : min= 158, max= 1038, avg=601.60, stdev=237.75, samples=20 00:19:41.269 lat (usec) : 1000=0.07% 00:19:41.269 lat (msec) : 2=0.02%, 4=0.49%, 10=2.17%, 20=3.67%, 50=8.82% 00:19:41.269 lat (msec) : 100=38.60%, 250=42.68%, 500=3.45%, 750=0.03% 00:19:41.269 cpu : usr=0.38%, sys=2.03%, ctx=1100, majf=0, minf=4098 00:19:41.269 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:41.269 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.269 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:41.269 issued rwts: total=6080,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.269 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:41.269 00:19:41.269 Run status group 0 (all jobs): 00:19:41.269 READ: bw=1716MiB/s (1799MB/s), 106MiB/s-224MiB/s (112MB/s-235MB/s), io=16.9GiB (18.2GB), run=10019-10098msec 00:19:41.269 00:19:41.269 Disk stats (read/write): 00:19:41.269 nvme0n1: ios=11426/0, merge=0/0, ticks=1234221/0, in_queue=1234221, util=97.31% 00:19:41.269 nvme10n1: ios=10674/0, merge=0/0, ticks=1233322/0, in_queue=1233322, util=97.51% 00:19:41.269 nvme1n1: ios=14652/0, merge=0/0, ticks=1239720/0, in_queue=1239720, util=97.76% 00:19:41.269 nvme2n1: ios=14848/0, merge=0/0, ticks=1241584/0, in_queue=1241584, util=97.91% 00:19:41.269 nvme3n1: ios=8396/0, merge=0/0, ticks=1233596/0, in_queue=1233596, util=97.99% 00:19:41.269 nvme4n1: ios=9566/0, merge=0/0, ticks=1234177/0, in_queue=1234177, util=98.29% 00:19:41.269 nvme5n1: ios=17813/0, merge=0/0, ticks=1245862/0, in_queue=1245862, util=98.44% 00:19:41.269 nvme6n1: ios=12154/0, merge=0/0, ticks=1239687/0, in_queue=1239687, util=98.53% 00:19:41.269 nvme7n1: ios=13426/0, merge=0/0, ticks=1246975/0, in_queue=1246975, util=98.93% 00:19:41.269 nvme8n1: ios=11391/0, merge=0/0, ticks=1235884/0, in_queue=1235884, util=99.11% 00:19:41.269 nvme9n1: ios=11984/0, merge=0/0, ticks=1234487/0, in_queue=1234487, util=99.23% 00:19:41.269 15:43:30 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:19:41.269 [global] 00:19:41.269 thread=1 00:19:41.269 invalidate=1 00:19:41.269 rw=randwrite 00:19:41.269 time_based=1 00:19:41.269 runtime=10 00:19:41.269 ioengine=libaio 00:19:41.269 direct=1 00:19:41.269 bs=262144 00:19:41.269 iodepth=64 00:19:41.269 norandommap=1 00:19:41.269 numjobs=1 00:19:41.269 00:19:41.269 [job0] 00:19:41.269 filename=/dev/nvme0n1 00:19:41.269 [job1] 00:19:41.269 filename=/dev/nvme10n1 00:19:41.269 [job2] 00:19:41.269 filename=/dev/nvme1n1 00:19:41.269 [job3] 00:19:41.269 filename=/dev/nvme2n1 00:19:41.269 [job4] 00:19:41.269 filename=/dev/nvme3n1 00:19:41.269 [job5] 00:19:41.269 filename=/dev/nvme4n1 00:19:41.269 [job6] 00:19:41.269 filename=/dev/nvme5n1 00:19:41.269 [job7] 00:19:41.269 filename=/dev/nvme6n1 00:19:41.269 [job8] 00:19:41.269 filename=/dev/nvme7n1 00:19:41.269 [job9] 00:19:41.269 filename=/dev/nvme8n1 00:19:41.269 [job10] 00:19:41.269 filename=/dev/nvme9n1 00:19:41.269 Could not set queue depth (nvme0n1) 00:19:41.269 Could not set queue depth (nvme10n1) 00:19:41.269 Could not set queue depth (nvme1n1) 00:19:41.269 Could not set queue depth (nvme2n1) 00:19:41.269 Could not set queue depth (nvme3n1) 00:19:41.269 Could not set queue depth (nvme4n1) 00:19:41.269 Could not set queue depth (nvme5n1) 00:19:41.269 Could not set queue depth (nvme6n1) 00:19:41.269 Could not set queue depth (nvme7n1) 00:19:41.269 Could not set queue depth (nvme8n1) 00:19:41.269 Could not set queue depth (nvme9n1) 00:19:41.269 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:41.269 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:41.269 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:41.269 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:41.269 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:41.269 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:41.269 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:41.269 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:41.269 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:41.269 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:41.269 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:41.269 fio-3.35 00:19:41.269 Starting 11 threads 00:19:51.254 00:19:51.254 job0: (groupid=0, jobs=1): err= 0: pid=907504: Tue Nov 26 15:43:41 2024 00:19:51.254 write: IOPS=320, BW=80.0MiB/s (83.9MB/s)(819MiB/10228msec); 0 zone resets 00:19:51.254 slat (usec): min=22, max=79720, avg=2515.35, stdev=6131.75 00:19:51.254 clat (msec): min=3, max=466, avg=197.27, stdev=75.23 00:19:51.254 lat (msec): min=3, max=466, avg=199.79, stdev=76.21 00:19:51.254 clat percentiles (msec): 00:19:51.254 | 1.00th=[ 18], 5.00th=[ 46], 10.00th=[ 77], 20.00th=[ 146], 00:19:51.254 | 30.00th=[ 174], 40.00th=[ 188], 50.00th=[ 211], 60.00th=[ 226], 00:19:51.254 | 70.00th=[ 243], 80.00th=[ 257], 90.00th=[ 271], 95.00th=[ 296], 00:19:51.254 | 99.00th=[ 359], 99.50th=[ 405], 99.90th=[ 451], 99.95th=[ 468], 00:19:51.254 | 99.99th=[ 468] 00:19:51.254 bw ( KiB/s): min=53248, max=129282, per=6.04%, avg=82188.90, stdev=21458.87, samples=20 00:19:51.254 iops : min= 208, max= 505, avg=321.05, stdev=83.82, samples=20 00:19:51.254 lat (msec) : 4=0.03%, 10=0.24%, 20=0.92%, 50=4.61%, 100=8.00% 00:19:51.254 lat (msec) : 250=61.55%, 500=24.65% 00:19:51.254 cpu : usr=1.13%, sys=1.17%, ctx=1549, majf=0, minf=1 00:19:51.254 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.5%, 32=1.0%, >=64=98.1% 00:19:51.254 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.254 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:51.254 issued rwts: total=0,3274,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.254 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:51.254 job1: (groupid=0, jobs=1): err= 0: pid=907521: Tue Nov 26 15:43:41 2024 00:19:51.254 write: IOPS=478, BW=120MiB/s (126MB/s)(1224MiB/10224msec); 0 zone resets 00:19:51.254 slat (usec): min=23, max=76922, avg=1248.10, stdev=3683.50 00:19:51.254 clat (usec): min=1355, max=472416, avg=132266.16, stdev=71650.35 00:19:51.254 lat (usec): min=1414, max=472479, avg=133514.26, stdev=72458.13 00:19:51.254 clat percentiles (msec): 00:19:51.254 | 1.00th=[ 3], 5.00th=[ 27], 10.00th=[ 48], 20.00th=[ 80], 00:19:51.254 | 30.00th=[ 103], 40.00th=[ 114], 50.00th=[ 124], 60.00th=[ 134], 00:19:51.254 | 70.00th=[ 148], 80.00th=[ 174], 90.00th=[ 247], 95.00th=[ 275], 00:19:51.254 | 99.00th=[ 342], 99.50th=[ 384], 99.90th=[ 460], 99.95th=[ 460], 00:19:51.254 | 99.99th=[ 472] 00:19:51.254 bw ( KiB/s): min=59904, max=215552, per=9.09%, avg=123763.10, stdev=38327.66, samples=20 00:19:51.254 iops : min= 234, max= 842, avg=483.40, stdev=149.71, samples=20 00:19:51.254 lat (msec) : 2=0.59%, 4=1.49%, 10=0.57%, 20=1.61%, 50=6.72% 00:19:51.254 lat (msec) : 100=18.24%, 250=61.59%, 500=9.19% 00:19:51.254 cpu : usr=1.76%, sys=1.79%, ctx=3048, majf=0, minf=1 00:19:51.254 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:51.254 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.254 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:51.254 issued rwts: total=0,4897,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.254 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:51.254 job2: (groupid=0, jobs=1): err= 0: pid=907542: Tue Nov 26 15:43:41 2024 00:19:51.254 write: IOPS=481, BW=120MiB/s (126MB/s)(1213MiB/10085msec); 0 zone resets 00:19:51.254 slat (usec): min=21, max=85346, avg=1164.81, stdev=4182.59 00:19:51.254 clat (usec): min=883, max=383285, avg=131789.22, stdev=82930.61 00:19:51.254 lat (usec): min=928, max=383370, avg=132954.04, stdev=83816.93 00:19:51.254 clat percentiles (msec): 00:19:51.254 | 1.00th=[ 6], 5.00th=[ 17], 10.00th=[ 27], 20.00th=[ 53], 00:19:51.254 | 30.00th=[ 81], 40.00th=[ 97], 50.00th=[ 112], 60.00th=[ 146], 00:19:51.254 | 70.00th=[ 182], 80.00th=[ 220], 90.00th=[ 251], 95.00th=[ 279], 00:19:51.254 | 99.00th=[ 305], 99.50th=[ 338], 99.90th=[ 368], 99.95th=[ 376], 00:19:51.254 | 99.99th=[ 384] 00:19:51.254 bw ( KiB/s): min=59392, max=220672, per=9.01%, avg=122611.00, stdev=50631.71, samples=20 00:19:51.254 iops : min= 232, max= 862, avg=478.90, stdev=197.78, samples=20 00:19:51.254 lat (usec) : 1000=0.04% 00:19:51.254 lat (msec) : 2=0.12%, 4=0.45%, 10=1.57%, 20=5.50%, 50=11.05% 00:19:51.254 lat (msec) : 100=24.24%, 250=46.76%, 500=10.26% 00:19:51.254 cpu : usr=1.56%, sys=1.79%, ctx=3148, majf=0, minf=1 00:19:51.254 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:51.254 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.254 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:51.254 issued rwts: total=0,4852,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.254 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:51.254 job3: (groupid=0, jobs=1): err= 0: pid=907556: Tue Nov 26 15:43:41 2024 00:19:51.254 write: IOPS=606, BW=152MiB/s (159MB/s)(1551MiB/10228msec); 0 zone resets 00:19:51.254 slat (usec): min=20, max=84990, avg=1094.34, stdev=3672.32 00:19:51.254 clat (msec): min=3, max=533, avg=104.33, stdev=71.99 00:19:51.254 lat (msec): min=3, max=533, avg=105.43, stdev=72.68 00:19:51.254 clat percentiles (msec): 00:19:51.254 | 1.00th=[ 16], 5.00th=[ 37], 10.00th=[ 44], 20.00th=[ 54], 00:19:51.254 | 30.00th=[ 60], 40.00th=[ 67], 50.00th=[ 86], 60.00th=[ 100], 00:19:51.254 | 70.00th=[ 113], 80.00th=[ 144], 90.00th=[ 201], 95.00th=[ 275], 00:19:51.254 | 99.00th=[ 351], 99.50th=[ 372], 99.90th=[ 439], 99.95th=[ 502], 00:19:51.254 | 99.99th=[ 535] 00:19:51.254 bw ( KiB/s): min=52736, max=341504, per=11.55%, avg=157235.20, stdev=67779.88, samples=20 00:19:51.254 iops : min= 206, max= 1334, avg=614.20, stdev=264.77, samples=20 00:19:51.254 lat (msec) : 4=0.03%, 10=0.47%, 20=1.21%, 50=16.42%, 100=43.19% 00:19:51.254 lat (msec) : 250=32.26%, 500=6.32%, 750=0.10% 00:19:51.254 cpu : usr=2.12%, sys=2.21%, ctx=3015, majf=0, minf=1 00:19:51.254 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:51.254 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.254 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:51.254 issued rwts: total=0,6205,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.254 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:51.254 job4: (groupid=0, jobs=1): err= 0: pid=907561: Tue Nov 26 15:43:41 2024 00:19:51.254 write: IOPS=568, BW=142MiB/s (149MB/s)(1431MiB/10073msec); 0 zone resets 00:19:51.254 slat (usec): min=21, max=32261, avg=1134.24, stdev=3047.31 00:19:51.254 clat (usec): min=1295, max=425784, avg=111414.17, stdev=60041.91 00:19:51.254 lat (usec): min=1328, max=429339, avg=112548.41, stdev=60713.32 00:19:51.254 clat percentiles (msec): 00:19:51.254 | 1.00th=[ 7], 5.00th=[ 22], 10.00th=[ 34], 20.00th=[ 59], 00:19:51.254 | 30.00th=[ 77], 40.00th=[ 92], 50.00th=[ 108], 60.00th=[ 125], 00:19:51.254 | 70.00th=[ 144], 80.00th=[ 161], 90.00th=[ 186], 95.00th=[ 209], 00:19:51.254 | 99.00th=[ 279], 99.50th=[ 317], 99.90th=[ 418], 99.95th=[ 422], 00:19:51.254 | 99.99th=[ 426] 00:19:51.254 bw ( KiB/s): min=92160, max=225280, per=10.65%, avg=144961.65, stdev=34548.84, samples=20 00:19:51.254 iops : min= 360, max= 880, avg=566.25, stdev=134.96, samples=20 00:19:51.254 lat (msec) : 2=0.09%, 4=0.42%, 10=1.26%, 20=2.85%, 50=12.17% 00:19:51.254 lat (msec) : 100=28.47%, 250=53.36%, 500=1.38% 00:19:51.255 cpu : usr=1.72%, sys=2.10%, ctx=3320, majf=0, minf=1 00:19:51.255 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:51.255 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.255 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:51.255 issued rwts: total=0,5725,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.255 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:51.255 job5: (groupid=0, jobs=1): err= 0: pid=907611: Tue Nov 26 15:43:41 2024 00:19:51.255 write: IOPS=519, BW=130MiB/s (136MB/s)(1309MiB/10073msec); 0 zone resets 00:19:51.255 slat (usec): min=23, max=64978, avg=1144.43, stdev=3326.61 00:19:51.255 clat (usec): min=1663, max=319067, avg=121918.05, stdev=59135.83 00:19:51.255 lat (usec): min=1785, max=322550, avg=123062.47, stdev=59735.01 00:19:51.255 clat percentiles (msec): 00:19:51.255 | 1.00th=[ 9], 5.00th=[ 26], 10.00th=[ 46], 20.00th=[ 77], 00:19:51.255 | 30.00th=[ 90], 40.00th=[ 108], 50.00th=[ 117], 60.00th=[ 131], 00:19:51.255 | 70.00th=[ 148], 80.00th=[ 169], 90.00th=[ 192], 95.00th=[ 228], 00:19:51.255 | 99.00th=[ 296], 99.50th=[ 309], 99.90th=[ 317], 99.95th=[ 317], 00:19:51.255 | 99.99th=[ 321] 00:19:51.255 bw ( KiB/s): min=56320, max=209408, per=9.73%, avg=132428.80, stdev=34397.09, samples=20 00:19:51.255 iops : min= 220, max= 818, avg=517.30, stdev=134.36, samples=20 00:19:51.255 lat (msec) : 2=0.02%, 4=0.21%, 10=1.11%, 20=2.08%, 50=7.62% 00:19:51.255 lat (msec) : 100=24.35%, 250=61.40%, 500=3.21% 00:19:51.255 cpu : usr=1.66%, sys=1.90%, ctx=3080, majf=0, minf=1 00:19:51.255 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:51.255 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.255 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:51.255 issued rwts: total=0,5236,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.255 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:51.255 job6: (groupid=0, jobs=1): err= 0: pid=907633: Tue Nov 26 15:43:41 2024 00:19:51.255 write: IOPS=438, BW=110MiB/s (115MB/s)(1120MiB/10228msec); 0 zone resets 00:19:51.255 slat (usec): min=25, max=96127, avg=1519.95, stdev=4687.47 00:19:51.255 clat (msec): min=2, max=493, avg=144.49, stdev=80.19 00:19:51.255 lat (msec): min=2, max=493, avg=146.01, stdev=81.29 00:19:51.255 clat percentiles (msec): 00:19:51.255 | 1.00th=[ 9], 5.00th=[ 23], 10.00th=[ 37], 20.00th=[ 70], 00:19:51.255 | 30.00th=[ 100], 40.00th=[ 116], 50.00th=[ 140], 60.00th=[ 165], 00:19:51.255 | 70.00th=[ 190], 80.00th=[ 220], 90.00th=[ 251], 95.00th=[ 275], 00:19:51.255 | 99.00th=[ 317], 99.50th=[ 405], 99.90th=[ 477], 99.95th=[ 477], 00:19:51.255 | 99.99th=[ 493] 00:19:51.255 bw ( KiB/s): min=55808, max=182784, per=8.31%, avg=113075.20, stdev=38805.58, samples=20 00:19:51.255 iops : min= 218, max= 714, avg=441.70, stdev=151.58, samples=20 00:19:51.255 lat (msec) : 4=0.07%, 10=1.16%, 20=3.10%, 50=9.75%, 100=16.50% 00:19:51.255 lat (msec) : 250=59.51%, 500=9.91% 00:19:51.255 cpu : usr=1.34%, sys=1.89%, ctx=2656, majf=0, minf=1 00:19:51.255 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:19:51.255 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.255 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:51.255 issued rwts: total=0,4480,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.255 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:51.255 job7: (groupid=0, jobs=1): err= 0: pid=907651: Tue Nov 26 15:43:41 2024 00:19:51.255 write: IOPS=573, BW=143MiB/s (150MB/s)(1468MiB/10240msec); 0 zone resets 00:19:51.255 slat (usec): min=21, max=119198, avg=1188.98, stdev=4127.39 00:19:51.255 clat (usec): min=1127, max=542070, avg=110320.52, stdev=85309.09 00:19:51.255 lat (usec): min=1202, max=542133, avg=111509.50, stdev=86221.84 00:19:51.255 clat percentiles (msec): 00:19:51.255 | 1.00th=[ 5], 5.00th=[ 22], 10.00th=[ 29], 20.00th=[ 43], 00:19:51.255 | 30.00th=[ 47], 40.00th=[ 58], 50.00th=[ 79], 60.00th=[ 108], 00:19:51.255 | 70.00th=[ 146], 80.00th=[ 192], 90.00th=[ 241], 95.00th=[ 262], 00:19:51.255 | 99.00th=[ 355], 99.50th=[ 435], 99.90th=[ 523], 99.95th=[ 523], 00:19:51.255 | 99.99th=[ 542] 00:19:51.255 bw ( KiB/s): min=40960, max=347136, per=10.92%, avg=148710.40, stdev=79724.77, samples=20 00:19:51.255 iops : min= 160, max= 1356, avg=580.90, stdev=311.42, samples=20 00:19:51.255 lat (msec) : 2=0.12%, 4=0.63%, 10=1.57%, 20=2.42%, 50=29.05% 00:19:51.255 lat (msec) : 100=24.28%, 250=34.07%, 500=7.70%, 750=0.17% 00:19:51.255 cpu : usr=1.86%, sys=2.31%, ctx=3232, majf=0, minf=1 00:19:51.255 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:19:51.255 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.255 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:51.255 issued rwts: total=0,5873,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.255 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:51.255 job8: (groupid=0, jobs=1): err= 0: pid=907680: Tue Nov 26 15:43:41 2024 00:19:51.255 write: IOPS=371, BW=92.8MiB/s (97.3MB/s)(950MiB/10232msec); 0 zone resets 00:19:51.255 slat (usec): min=24, max=66300, avg=1922.96, stdev=5325.21 00:19:51.255 clat (usec): min=1322, max=497789, avg=170351.75, stdev=87580.13 00:19:51.255 lat (usec): min=1361, max=497875, avg=172274.71, stdev=88857.96 00:19:51.255 clat percentiles (msec): 00:19:51.255 | 1.00th=[ 4], 5.00th=[ 16], 10.00th=[ 42], 20.00th=[ 80], 00:19:51.255 | 30.00th=[ 122], 40.00th=[ 155], 50.00th=[ 190], 60.00th=[ 211], 00:19:51.255 | 70.00th=[ 230], 80.00th=[ 247], 90.00th=[ 275], 95.00th=[ 292], 00:19:51.255 | 99.00th=[ 347], 99.50th=[ 388], 99.90th=[ 456], 99.95th=[ 498], 00:19:51.255 | 99.99th=[ 498] 00:19:51.255 bw ( KiB/s): min=57344, max=161280, per=7.02%, avg=95596.25, stdev=33631.05, samples=20 00:19:51.255 iops : min= 224, max= 630, avg=373.40, stdev=131.40, samples=20 00:19:51.255 lat (msec) : 2=0.13%, 4=0.87%, 10=1.92%, 20=3.77%, 50=5.34% 00:19:51.255 lat (msec) : 100=13.51%, 250=56.42%, 500=18.04% 00:19:51.255 cpu : usr=1.06%, sys=1.60%, ctx=2104, majf=0, minf=1 00:19:51.255 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.3% 00:19:51.255 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.255 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:51.255 issued rwts: total=0,3798,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.255 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:51.255 job9: (groupid=0, jobs=1): err= 0: pid=907681: Tue Nov 26 15:43:41 2024 00:19:51.255 write: IOPS=534, BW=134MiB/s (140MB/s)(1347MiB/10087msec); 0 zone resets 00:19:51.255 slat (usec): min=24, max=79918, avg=1258.79, stdev=3581.48 00:19:51.255 clat (msec): min=2, max=373, avg=118.49, stdev=68.41 00:19:51.255 lat (msec): min=2, max=376, avg=119.75, stdev=69.15 00:19:51.255 clat percentiles (msec): 00:19:51.255 | 1.00th=[ 10], 5.00th=[ 28], 10.00th=[ 42], 20.00th=[ 58], 00:19:51.255 | 30.00th=[ 74], 40.00th=[ 95], 50.00th=[ 112], 60.00th=[ 123], 00:19:51.255 | 70.00th=[ 142], 80.00th=[ 169], 90.00th=[ 222], 95.00th=[ 257], 00:19:51.255 | 99.00th=[ 317], 99.50th=[ 326], 99.90th=[ 338], 99.95th=[ 363], 00:19:51.255 | 99.99th=[ 376] 00:19:51.255 bw ( KiB/s): min=67584, max=247808, per=10.01%, avg=136320.00, stdev=41881.96, samples=20 00:19:51.255 iops : min= 264, max= 968, avg=532.50, stdev=163.60, samples=20 00:19:51.255 lat (msec) : 4=0.06%, 10=0.98%, 20=2.49%, 50=8.89%, 100=31.33% 00:19:51.255 lat (msec) : 250=50.26%, 500=5.99% 00:19:51.255 cpu : usr=1.88%, sys=2.08%, ctx=2824, majf=0, minf=1 00:19:51.255 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:51.255 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.255 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:51.255 issued rwts: total=0,5388,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.255 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:51.255 job10: (groupid=0, jobs=1): err= 0: pid=907682: Tue Nov 26 15:43:41 2024 00:19:51.255 write: IOPS=462, BW=116MiB/s (121MB/s)(1183MiB/10231msec); 0 zone resets 00:19:51.255 slat (usec): min=20, max=116535, avg=1533.62, stdev=4322.09 00:19:51.255 clat (usec): min=959, max=470095, avg=136739.20, stdev=77076.51 00:19:51.255 lat (usec): min=1033, max=470156, avg=138272.82, stdev=77880.84 00:19:51.255 clat percentiles (msec): 00:19:51.255 | 1.00th=[ 7], 5.00th=[ 18], 10.00th=[ 40], 20.00th=[ 73], 00:19:51.255 | 30.00th=[ 100], 40.00th=[ 111], 50.00th=[ 130], 60.00th=[ 146], 00:19:51.255 | 70.00th=[ 165], 80.00th=[ 186], 90.00th=[ 243], 95.00th=[ 296], 00:19:51.255 | 99.00th=[ 342], 99.50th=[ 380], 99.90th=[ 460], 99.95th=[ 460], 00:19:51.256 | 99.99th=[ 472] 00:19:51.256 bw ( KiB/s): min=55296, max=186368, per=8.78%, avg=119535.80, stdev=34784.83, samples=20 00:19:51.256 iops : min= 216, max= 728, avg=466.90, stdev=135.91, samples=20 00:19:51.256 lat (usec) : 1000=0.02% 00:19:51.256 lat (msec) : 2=0.17%, 4=0.36%, 10=1.33%, 20=3.83%, 50=7.86% 00:19:51.256 lat (msec) : 100=18.13%, 250=59.45%, 500=8.85% 00:19:51.256 cpu : usr=1.51%, sys=1.71%, ctx=2484, majf=0, minf=1 00:19:51.256 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:51.256 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:51.256 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:51.256 issued rwts: total=0,4732,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:51.256 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:51.256 00:19:51.256 Run status group 0 (all jobs): 00:19:51.256 WRITE: bw=1330MiB/s (1394MB/s), 80.0MiB/s-152MiB/s (83.9MB/s-159MB/s), io=13.3GiB (14.3GB), run=10073-10240msec 00:19:51.256 00:19:51.256 Disk stats (read/write): 00:19:51.256 nvme0n1: ios=53/6499, merge=0/0, ticks=1233/1234039, in_queue=1235272, util=100.00% 00:19:51.256 nvme10n1: ios=46/9756, merge=0/0, ticks=48/1247020, in_queue=1247068, util=97.44% 00:19:51.256 nvme1n1: ios=47/9458, merge=0/0, ticks=75/1226738, in_queue=1226813, util=97.65% 00:19:51.256 nvme2n1: ios=48/12361, merge=0/0, ticks=3110/1236564, in_queue=1239674, util=100.00% 00:19:51.256 nvme3n1: ios=13/11172, merge=0/0, ticks=341/1222980, in_queue=1223321, util=97.64% 00:19:51.256 nvme4n1: ios=23/10195, merge=0/0, ticks=187/1226650, in_queue=1226837, util=99.29% 00:19:51.256 nvme5n1: ios=0/8919, merge=0/0, ticks=0/1242125, in_queue=1242125, util=98.24% 00:19:51.256 nvme6n1: ios=0/11689, merge=0/0, ticks=0/1236819, in_queue=1236819, util=98.36% 00:19:51.256 nvme7n1: ios=39/7551, merge=0/0, ticks=1277/1239170, in_queue=1240447, util=99.89% 00:19:51.256 nvme8n1: ios=21/10526, merge=0/0, ticks=71/1220429, in_queue=1220500, util=99.38% 00:19:51.256 nvme9n1: ios=0/9421, merge=0/0, ticks=0/1241438, in_queue=1241438, util=99.12% 00:19:51.256 15:43:41 -- target/multiconnection.sh@36 -- # sync 00:19:51.256 15:43:41 -- target/multiconnection.sh@37 -- # seq 1 11 00:19:51.256 15:43:41 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:51.256 15:43:41 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:51.256 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:51.256 15:43:42 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:19:51.256 15:43:42 -- common/autotest_common.sh@1208 -- # local i=0 00:19:51.256 15:43:42 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:51.256 15:43:42 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:19:51.256 15:43:42 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:51.256 15:43:42 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:19:51.256 15:43:42 -- common/autotest_common.sh@1220 -- # return 0 00:19:51.256 15:43:42 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:51.256 15:43:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:51.256 15:43:42 -- common/autotest_common.sh@10 -- # set +x 00:19:51.256 15:43:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:51.256 15:43:42 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:51.256 15:43:42 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:19:51.256 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:19:51.256 15:43:42 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:19:51.256 15:43:42 -- common/autotest_common.sh@1208 -- # local i=0 00:19:51.256 15:43:42 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:51.256 15:43:42 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:19:51.256 15:43:42 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:51.256 15:43:42 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:19:51.256 15:43:42 -- common/autotest_common.sh@1220 -- # return 0 00:19:51.256 15:43:42 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:19:51.256 15:43:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:51.256 15:43:42 -- common/autotest_common.sh@10 -- # set +x 00:19:51.256 15:43:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:51.256 15:43:42 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:51.256 15:43:42 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:19:51.515 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:19:51.515 15:43:42 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:19:51.515 15:43:42 -- common/autotest_common.sh@1208 -- # local i=0 00:19:51.515 15:43:42 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:51.515 15:43:42 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:19:51.515 15:43:42 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:51.515 15:43:42 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:19:51.515 15:43:42 -- common/autotest_common.sh@1220 -- # return 0 00:19:51.515 15:43:42 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:19:51.515 15:43:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:51.515 15:43:42 -- common/autotest_common.sh@10 -- # set +x 00:19:51.515 15:43:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:51.515 15:43:42 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:51.515 15:43:42 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:19:51.775 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:19:51.775 15:43:43 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:19:51.775 15:43:43 -- common/autotest_common.sh@1208 -- # local i=0 00:19:51.775 15:43:43 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:51.775 15:43:43 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:19:51.775 15:43:43 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:51.775 15:43:43 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:19:51.775 15:43:43 -- common/autotest_common.sh@1220 -- # return 0 00:19:51.775 15:43:43 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:19:51.775 15:43:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:51.775 15:43:43 -- common/autotest_common.sh@10 -- # set +x 00:19:51.775 15:43:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:51.775 15:43:43 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:51.775 15:43:43 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:19:52.034 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:19:52.034 15:43:43 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:19:52.034 15:43:43 -- common/autotest_common.sh@1208 -- # local i=0 00:19:52.034 15:43:43 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:52.034 15:43:43 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:19:52.034 15:43:43 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:52.034 15:43:43 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:19:52.034 15:43:43 -- common/autotest_common.sh@1220 -- # return 0 00:19:52.034 15:43:43 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:19:52.034 15:43:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.034 15:43:43 -- common/autotest_common.sh@10 -- # set +x 00:19:52.034 15:43:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.034 15:43:43 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:52.034 15:43:43 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:19:52.293 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:19:52.293 15:43:43 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:19:52.293 15:43:43 -- common/autotest_common.sh@1208 -- # local i=0 00:19:52.293 15:43:43 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:52.293 15:43:43 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:19:52.293 15:43:43 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:52.293 15:43:43 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:19:52.293 15:43:43 -- common/autotest_common.sh@1220 -- # return 0 00:19:52.293 15:43:43 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:19:52.293 15:43:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.293 15:43:43 -- common/autotest_common.sh@10 -- # set +x 00:19:52.293 15:43:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.293 15:43:43 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:52.293 15:43:43 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:19:52.551 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:19:52.551 15:43:43 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:19:52.551 15:43:43 -- common/autotest_common.sh@1208 -- # local i=0 00:19:52.551 15:43:43 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:52.552 15:43:43 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:19:52.552 15:43:43 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:52.552 15:43:43 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:19:52.552 15:43:43 -- common/autotest_common.sh@1220 -- # return 0 00:19:52.552 15:43:43 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:19:52.552 15:43:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.552 15:43:43 -- common/autotest_common.sh@10 -- # set +x 00:19:52.552 15:43:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.552 15:43:43 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:52.552 15:43:43 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:19:52.552 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:19:52.552 15:43:43 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:19:52.552 15:43:43 -- common/autotest_common.sh@1208 -- # local i=0 00:19:52.552 15:43:43 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:52.552 15:43:43 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:19:52.552 15:43:43 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:52.552 15:43:43 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:19:52.552 15:43:43 -- common/autotest_common.sh@1220 -- # return 0 00:19:52.552 15:43:43 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:19:52.552 15:43:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.552 15:43:43 -- common/autotest_common.sh@10 -- # set +x 00:19:52.810 15:43:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.810 15:43:44 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:52.810 15:43:44 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:19:52.810 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:19:52.810 15:43:44 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:19:52.810 15:43:44 -- common/autotest_common.sh@1208 -- # local i=0 00:19:52.810 15:43:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:52.810 15:43:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:19:52.810 15:43:44 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:52.810 15:43:44 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:19:52.810 15:43:44 -- common/autotest_common.sh@1220 -- # return 0 00:19:52.810 15:43:44 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:19:52.810 15:43:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.811 15:43:44 -- common/autotest_common.sh@10 -- # set +x 00:19:52.811 15:43:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.811 15:43:44 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:52.811 15:43:44 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:19:53.069 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:19:53.069 15:43:44 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:19:53.069 15:43:44 -- common/autotest_common.sh@1208 -- # local i=0 00:19:53.069 15:43:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:53.069 15:43:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:19:53.069 15:43:44 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:53.069 15:43:44 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:19:53.069 15:43:44 -- common/autotest_common.sh@1220 -- # return 0 00:19:53.069 15:43:44 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:19:53.069 15:43:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.069 15:43:44 -- common/autotest_common.sh@10 -- # set +x 00:19:53.069 15:43:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.069 15:43:44 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:53.069 15:43:44 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:19:53.069 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:19:53.069 15:43:44 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:19:53.069 15:43:44 -- common/autotest_common.sh@1208 -- # local i=0 00:19:53.069 15:43:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:53.069 15:43:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:19:53.069 15:43:44 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:53.069 15:43:44 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:19:53.069 15:43:44 -- common/autotest_common.sh@1220 -- # return 0 00:19:53.069 15:43:44 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:19:53.069 15:43:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.069 15:43:44 -- common/autotest_common.sh@10 -- # set +x 00:19:53.069 15:43:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.069 15:43:44 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:19:53.069 15:43:44 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:19:53.069 15:43:44 -- target/multiconnection.sh@47 -- # nvmftestfini 00:19:53.069 15:43:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:53.069 15:43:44 -- nvmf/common.sh@116 -- # sync 00:19:53.069 15:43:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:53.069 15:43:44 -- nvmf/common.sh@119 -- # set +e 00:19:53.069 15:43:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:53.069 15:43:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:53.069 rmmod nvme_tcp 00:19:53.069 rmmod nvme_fabrics 00:19:53.069 rmmod nvme_keyring 00:19:53.329 15:43:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:53.329 15:43:44 -- nvmf/common.sh@123 -- # set -e 00:19:53.329 15:43:44 -- nvmf/common.sh@124 -- # return 0 00:19:53.329 15:43:44 -- nvmf/common.sh@477 -- # '[' -n 902170 ']' 00:19:53.329 15:43:44 -- nvmf/common.sh@478 -- # killprocess 902170 00:19:53.329 15:43:44 -- common/autotest_common.sh@936 -- # '[' -z 902170 ']' 00:19:53.329 15:43:44 -- common/autotest_common.sh@940 -- # kill -0 902170 00:19:53.329 15:43:44 -- common/autotest_common.sh@941 -- # uname 00:19:53.329 15:43:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:53.329 15:43:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 902170 00:19:53.329 15:43:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:53.329 15:43:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:53.329 15:43:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 902170' 00:19:53.329 killing process with pid 902170 00:19:53.329 15:43:44 -- common/autotest_common.sh@955 -- # kill 902170 00:19:53.329 15:43:44 -- common/autotest_common.sh@960 -- # wait 902170 00:19:53.898 15:43:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:53.898 15:43:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:53.898 15:43:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:53.898 15:43:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:53.898 15:43:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:53.898 15:43:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:53.898 15:43:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:53.898 15:43:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:55.804 15:43:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:55.804 00:19:55.804 real 1m2.096s 00:19:55.804 user 3m26.572s 00:19:55.804 sys 0m25.902s 00:19:55.804 15:43:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:55.804 15:43:47 -- common/autotest_common.sh@10 -- # set +x 00:19:55.804 ************************************ 00:19:55.804 END TEST nvmf_multiconnection 00:19:55.804 ************************************ 00:19:55.804 15:43:47 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:19:55.804 15:43:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:55.804 15:43:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:55.804 15:43:47 -- common/autotest_common.sh@10 -- # set +x 00:19:55.804 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:19:55.804 ************************************ 00:19:55.804 START TEST nvmf_initiator_timeout 00:19:55.804 ************************************ 00:19:55.804 15:43:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:19:56.063 * Looking for test storage... 00:19:56.063 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:56.063 15:43:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:56.063 15:43:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:56.063 15:43:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:56.063 15:43:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:56.063 15:43:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:56.063 15:43:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:56.063 15:43:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:56.063 15:43:47 -- scripts/common.sh@335 -- # IFS=.-: 00:19:56.063 15:43:47 -- scripts/common.sh@335 -- # read -ra ver1 00:19:56.063 15:43:47 -- scripts/common.sh@336 -- # IFS=.-: 00:19:56.063 15:43:47 -- scripts/common.sh@336 -- # read -ra ver2 00:19:56.063 15:43:47 -- scripts/common.sh@337 -- # local 'op=<' 00:19:56.064 15:43:47 -- scripts/common.sh@339 -- # ver1_l=2 00:19:56.064 15:43:47 -- scripts/common.sh@340 -- # ver2_l=1 00:19:56.064 15:43:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:56.064 15:43:47 -- scripts/common.sh@343 -- # case "$op" in 00:19:56.064 15:43:47 -- scripts/common.sh@344 -- # : 1 00:19:56.064 15:43:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:56.064 15:43:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:56.064 15:43:47 -- scripts/common.sh@364 -- # decimal 1 00:19:56.064 15:43:47 -- scripts/common.sh@352 -- # local d=1 00:19:56.064 15:43:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:56.064 15:43:47 -- scripts/common.sh@354 -- # echo 1 00:19:56.064 15:43:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:56.064 15:43:47 -- scripts/common.sh@365 -- # decimal 2 00:19:56.064 15:43:47 -- scripts/common.sh@352 -- # local d=2 00:19:56.064 15:43:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:56.064 15:43:47 -- scripts/common.sh@354 -- # echo 2 00:19:56.064 15:43:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:56.064 15:43:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:56.064 15:43:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:56.064 15:43:47 -- scripts/common.sh@367 -- # return 0 00:19:56.064 15:43:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:56.064 15:43:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:56.064 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:56.064 --rc genhtml_branch_coverage=1 00:19:56.064 --rc genhtml_function_coverage=1 00:19:56.064 --rc genhtml_legend=1 00:19:56.064 --rc geninfo_all_blocks=1 00:19:56.064 --rc geninfo_unexecuted_blocks=1 00:19:56.064 00:19:56.064 ' 00:19:56.064 15:43:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:56.064 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:56.064 --rc genhtml_branch_coverage=1 00:19:56.064 --rc genhtml_function_coverage=1 00:19:56.064 --rc genhtml_legend=1 00:19:56.064 --rc geninfo_all_blocks=1 00:19:56.064 --rc geninfo_unexecuted_blocks=1 00:19:56.064 00:19:56.064 ' 00:19:56.064 15:43:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:56.064 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:56.064 --rc genhtml_branch_coverage=1 00:19:56.064 --rc genhtml_function_coverage=1 00:19:56.064 --rc genhtml_legend=1 00:19:56.064 --rc geninfo_all_blocks=1 00:19:56.064 --rc geninfo_unexecuted_blocks=1 00:19:56.064 00:19:56.064 ' 00:19:56.064 15:43:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:56.064 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:56.064 --rc genhtml_branch_coverage=1 00:19:56.064 --rc genhtml_function_coverage=1 00:19:56.064 --rc genhtml_legend=1 00:19:56.064 --rc geninfo_all_blocks=1 00:19:56.064 --rc geninfo_unexecuted_blocks=1 00:19:56.064 00:19:56.064 ' 00:19:56.064 15:43:47 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:56.064 15:43:47 -- nvmf/common.sh@7 -- # uname -s 00:19:56.064 15:43:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:56.064 15:43:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:56.064 15:43:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:56.064 15:43:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:56.064 15:43:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:56.064 15:43:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:56.064 15:43:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:56.064 15:43:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:56.064 15:43:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:56.064 15:43:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:56.064 15:43:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:56.064 15:43:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:56.064 15:43:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:56.064 15:43:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:56.064 15:43:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:56.064 15:43:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:56.064 15:43:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:56.064 15:43:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:56.064 15:43:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:56.064 15:43:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.064 15:43:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.064 15:43:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.064 15:43:47 -- paths/export.sh@5 -- # export PATH 00:19:56.064 15:43:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.064 15:43:47 -- nvmf/common.sh@46 -- # : 0 00:19:56.064 15:43:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:56.064 15:43:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:56.064 15:43:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:56.064 15:43:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:56.064 15:43:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:56.064 15:43:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:56.064 15:43:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:56.064 15:43:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:56.064 15:43:47 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:56.064 15:43:47 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:56.064 15:43:47 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:19:56.064 15:43:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:56.064 15:43:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:56.064 15:43:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:56.064 15:43:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:56.064 15:43:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:56.064 15:43:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:56.064 15:43:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:56.064 15:43:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:56.064 15:43:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:56.064 15:43:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:56.064 15:43:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:56.064 15:43:47 -- common/autotest_common.sh@10 -- # set +x 00:19:57.977 15:43:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:57.977 15:43:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:57.977 15:43:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:57.977 15:43:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:57.977 15:43:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:57.977 15:43:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:57.977 15:43:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:57.977 15:43:49 -- nvmf/common.sh@294 -- # net_devs=() 00:19:57.977 15:43:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:57.977 15:43:49 -- nvmf/common.sh@295 -- # e810=() 00:19:57.977 15:43:49 -- nvmf/common.sh@295 -- # local -ga e810 00:19:57.977 15:43:49 -- nvmf/common.sh@296 -- # x722=() 00:19:57.977 15:43:49 -- nvmf/common.sh@296 -- # local -ga x722 00:19:57.977 15:43:49 -- nvmf/common.sh@297 -- # mlx=() 00:19:57.977 15:43:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:57.977 15:43:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:57.977 15:43:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:57.977 15:43:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:57.977 15:43:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:57.977 15:43:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:57.977 15:43:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:57.977 15:43:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:57.977 15:43:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:57.977 15:43:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:57.977 15:43:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:57.977 15:43:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:57.977 15:43:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:57.977 15:43:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:57.977 15:43:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:57.977 15:43:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:57.977 15:43:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:57.977 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:57.977 15:43:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:57.977 15:43:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:57.977 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:57.977 15:43:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:57.977 15:43:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:57.977 15:43:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:57.977 15:43:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:57.977 15:43:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:57.977 15:43:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:57.977 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:57.977 15:43:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:57.977 15:43:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:57.977 15:43:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:57.977 15:43:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:57.977 15:43:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:57.977 15:43:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:57.977 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:57.977 15:43:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:57.977 15:43:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:57.977 15:43:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:57.977 15:43:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:57.977 15:43:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:57.977 15:43:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:57.977 15:43:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:57.977 15:43:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:57.977 15:43:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:57.977 15:43:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:57.977 15:43:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:57.977 15:43:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:57.977 15:43:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:57.977 15:43:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:57.978 15:43:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:57.978 15:43:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:57.978 15:43:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:57.978 15:43:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:58.236 15:43:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:58.236 15:43:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:58.236 15:43:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:58.236 15:43:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:58.236 15:43:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:58.236 15:43:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:58.236 15:43:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:58.236 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:58.236 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.262 ms 00:19:58.236 00:19:58.236 --- 10.0.0.2 ping statistics --- 00:19:58.236 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:58.236 rtt min/avg/max/mdev = 0.262/0.262/0.262/0.000 ms 00:19:58.236 15:43:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:58.236 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:58.236 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:19:58.236 00:19:58.236 --- 10.0.0.1 ping statistics --- 00:19:58.236 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:58.236 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:19:58.236 15:43:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:58.236 15:43:49 -- nvmf/common.sh@410 -- # return 0 00:19:58.236 15:43:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:58.236 15:43:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:58.236 15:43:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:58.236 15:43:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:58.236 15:43:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:58.236 15:43:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:58.236 15:43:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:58.236 15:43:49 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:19:58.236 15:43:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:58.236 15:43:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:58.236 15:43:49 -- common/autotest_common.sh@10 -- # set +x 00:19:58.236 15:43:49 -- nvmf/common.sh@469 -- # nvmfpid=910952 00:19:58.236 15:43:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:58.236 15:43:49 -- nvmf/common.sh@470 -- # waitforlisten 910952 00:19:58.236 15:43:49 -- common/autotest_common.sh@829 -- # '[' -z 910952 ']' 00:19:58.236 15:43:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:58.236 15:43:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:58.236 15:43:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:58.236 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:58.236 15:43:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:58.236 15:43:49 -- common/autotest_common.sh@10 -- # set +x 00:19:58.236 [2024-11-26 15:43:49.661115] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:58.236 [2024-11-26 15:43:49.661197] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:58.495 EAL: No free 2048 kB hugepages reported on node 1 00:19:58.495 [2024-11-26 15:43:49.727065] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:58.495 [2024-11-26 15:43:49.841931] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:58.495 [2024-11-26 15:43:49.842096] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:58.495 [2024-11-26 15:43:49.842121] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:58.495 [2024-11-26 15:43:49.842148] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:58.495 [2024-11-26 15:43:49.842241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:58.495 [2024-11-26 15:43:49.842312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:58.495 [2024-11-26 15:43:49.842401] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:58.495 [2024-11-26 15:43:49.842404] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:59.432 15:43:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:59.432 15:43:50 -- common/autotest_common.sh@862 -- # return 0 00:19:59.432 15:43:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:59.432 15:43:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:59.432 15:43:50 -- common/autotest_common.sh@10 -- # set +x 00:19:59.432 15:43:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:59.432 15:43:50 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:19:59.432 15:43:50 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:59.432 15:43:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.432 15:43:50 -- common/autotest_common.sh@10 -- # set +x 00:19:59.432 Malloc0 00:19:59.432 15:43:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.432 15:43:50 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:19:59.432 15:43:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.432 15:43:50 -- common/autotest_common.sh@10 -- # set +x 00:19:59.432 Delay0 00:19:59.432 15:43:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.432 15:43:50 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:59.432 15:43:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.432 15:43:50 -- common/autotest_common.sh@10 -- # set +x 00:19:59.432 [2024-11-26 15:43:50.727451] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:59.432 15:43:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.432 15:43:50 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:59.432 15:43:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.432 15:43:50 -- common/autotest_common.sh@10 -- # set +x 00:19:59.432 15:43:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.432 15:43:50 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:19:59.432 15:43:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.432 15:43:50 -- common/autotest_common.sh@10 -- # set +x 00:19:59.432 15:43:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.432 15:43:50 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:59.432 15:43:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.432 15:43:50 -- common/autotest_common.sh@10 -- # set +x 00:19:59.432 [2024-11-26 15:43:50.755766] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:59.432 15:43:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.432 15:43:50 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:00.001 15:43:51 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:00.001 15:43:51 -- common/autotest_common.sh@1187 -- # local i=0 00:20:00.001 15:43:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:00.001 15:43:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:00.001 15:43:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:01.978 15:43:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:01.978 15:43:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:01.978 15:43:53 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:01.978 15:43:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:01.978 15:43:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:01.978 15:43:53 -- common/autotest_common.sh@1197 -- # return 0 00:20:01.978 15:43:53 -- target/initiator_timeout.sh@35 -- # fio_pid=911397 00:20:01.978 15:43:53 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:01.978 15:43:53 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:01.978 [global] 00:20:01.978 thread=1 00:20:01.978 invalidate=1 00:20:01.978 rw=write 00:20:01.978 time_based=1 00:20:01.978 runtime=60 00:20:01.978 ioengine=libaio 00:20:01.978 direct=1 00:20:01.978 bs=4096 00:20:01.978 iodepth=1 00:20:01.978 norandommap=0 00:20:01.978 numjobs=1 00:20:01.978 00:20:01.978 verify_dump=1 00:20:01.978 verify_backlog=512 00:20:01.978 verify_state_save=0 00:20:01.978 do_verify=1 00:20:01.978 verify=crc32c-intel 00:20:01.978 [job0] 00:20:01.978 filename=/dev/nvme0n1 00:20:01.978 Could not set queue depth (nvme0n1) 00:20:02.237 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:02.237 fio-3.35 00:20:02.237 Starting 1 thread 00:20:05.531 15:43:56 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:05.531 15:43:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:05.531 15:43:56 -- common/autotest_common.sh@10 -- # set +x 00:20:05.531 true 00:20:05.531 15:43:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:05.531 15:43:56 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:05.531 15:43:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:05.531 15:43:56 -- common/autotest_common.sh@10 -- # set +x 00:20:05.531 true 00:20:05.531 15:43:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:05.531 15:43:56 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:05.531 15:43:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:05.531 15:43:56 -- common/autotest_common.sh@10 -- # set +x 00:20:05.531 true 00:20:05.531 15:43:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:05.531 15:43:56 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:05.531 15:43:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:05.531 15:43:56 -- common/autotest_common.sh@10 -- # set +x 00:20:05.531 true 00:20:05.531 15:43:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:05.531 15:43:56 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:08.067 15:43:59 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:08.067 15:43:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:08.067 15:43:59 -- common/autotest_common.sh@10 -- # set +x 00:20:08.067 true 00:20:08.067 15:43:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:08.067 15:43:59 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:08.067 15:43:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:08.067 15:43:59 -- common/autotest_common.sh@10 -- # set +x 00:20:08.067 true 00:20:08.067 15:43:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:08.067 15:43:59 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:08.067 15:43:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:08.067 15:43:59 -- common/autotest_common.sh@10 -- # set +x 00:20:08.068 true 00:20:08.068 15:43:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:08.068 15:43:59 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:08.068 15:43:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:08.068 15:43:59 -- common/autotest_common.sh@10 -- # set +x 00:20:08.068 true 00:20:08.068 15:43:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:08.068 15:43:59 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:08.068 15:43:59 -- target/initiator_timeout.sh@54 -- # wait 911397 00:21:04.316 00:21:04.316 job0: (groupid=0, jobs=1): err= 0: pid=911579: Tue Nov 26 15:44:53 2024 00:21:04.316 read: IOPS=145, BW=581KiB/s (595kB/s)(34.1MiB/60033msec) 00:21:04.316 slat (nsec): min=4471, max=66997, avg=15011.56, stdev=7365.02 00:21:04.316 clat (usec): min=258, max=40947k, avg=6583.53, stdev=438622.59 00:21:04.316 lat (usec): min=267, max=40947k, avg=6598.54, stdev=438622.86 00:21:04.316 clat percentiles (usec): 00:21:04.316 | 1.00th=[ 277], 5.00th=[ 289], 10.00th=[ 293], 00:21:04.316 | 20.00th=[ 302], 30.00th=[ 314], 40.00th=[ 322], 00:21:04.316 | 50.00th=[ 330], 60.00th=[ 338], 70.00th=[ 351], 00:21:04.316 | 80.00th=[ 379], 90.00th=[ 478], 95.00th=[ 519], 00:21:04.316 | 99.00th=[ 41157], 99.50th=[ 41157], 99.90th=[ 41157], 00:21:04.316 | 99.95th=[ 41157], 99.99th=[17112761] 00:21:04.316 write: IOPS=153, BW=614KiB/s (629kB/s)(36.0MiB/60033msec); 0 zone resets 00:21:04.316 slat (usec): min=6, max=27936, avg=23.19, stdev=335.72 00:21:04.316 clat (usec): min=176, max=3284, avg=240.58, stdev=57.08 00:21:04.316 lat (usec): min=184, max=28276, avg=263.77, stdev=342.93 00:21:04.316 clat percentiles (usec): 00:21:04.316 | 1.00th=[ 188], 5.00th=[ 194], 10.00th=[ 198], 20.00th=[ 204], 00:21:04.316 | 30.00th=[ 210], 40.00th=[ 221], 50.00th=[ 233], 60.00th=[ 241], 00:21:04.316 | 70.00th=[ 249], 80.00th=[ 265], 90.00th=[ 289], 95.00th=[ 330], 00:21:04.316 | 99.00th=[ 404], 99.50th=[ 424], 99.90th=[ 510], 99.95th=[ 750], 00:21:04.316 | 99.99th=[ 3294] 00:21:04.316 bw ( KiB/s): min= 2816, max= 8192, per=100.00%, avg=4915.20, stdev=1476.99, samples=15 00:21:04.316 iops : min= 704, max= 2048, avg=1228.80, stdev=369.25, samples=15 00:21:04.316 lat (usec) : 250=36.06%, 500=60.92%, 750=1.13%, 1000=0.02% 00:21:04.316 lat (msec) : 2=0.01%, 4=0.01%, 50=1.85%, >=2000=0.01% 00:21:04.316 cpu : usr=0.30%, sys=0.65%, ctx=17939, majf=0, minf=1 00:21:04.316 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:04.316 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:04.316 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:04.316 issued rwts: total=8717,9216,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:04.316 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:04.316 00:21:04.316 Run status group 0 (all jobs): 00:21:04.316 READ: bw=581KiB/s (595kB/s), 581KiB/s-581KiB/s (595kB/s-595kB/s), io=34.1MiB (35.7MB), run=60033-60033msec 00:21:04.317 WRITE: bw=614KiB/s (629kB/s), 614KiB/s-614KiB/s (629kB/s-629kB/s), io=36.0MiB (37.7MB), run=60033-60033msec 00:21:04.317 00:21:04.317 Disk stats (read/write): 00:21:04.317 nvme0n1: ios=8765/9216, merge=0/0, ticks=17522/2127, in_queue=19649, util=99.98% 00:21:04.317 15:44:53 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:04.317 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:04.317 15:44:53 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:04.317 15:44:53 -- common/autotest_common.sh@1208 -- # local i=0 00:21:04.317 15:44:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:04.317 15:44:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:04.317 15:44:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:04.317 15:44:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:04.317 15:44:53 -- common/autotest_common.sh@1220 -- # return 0 00:21:04.317 15:44:53 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:04.317 15:44:53 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:04.317 nvmf hotplug test: fio successful as expected 00:21:04.317 15:44:53 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:04.317 15:44:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:04.317 15:44:53 -- common/autotest_common.sh@10 -- # set +x 00:21:04.317 15:44:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:04.317 15:44:53 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:04.317 15:44:53 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:04.317 15:44:53 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:04.317 15:44:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:04.317 15:44:53 -- nvmf/common.sh@116 -- # sync 00:21:04.317 15:44:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:04.317 15:44:53 -- nvmf/common.sh@119 -- # set +e 00:21:04.317 15:44:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:04.317 15:44:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:04.317 rmmod nvme_tcp 00:21:04.317 rmmod nvme_fabrics 00:21:04.317 rmmod nvme_keyring 00:21:04.317 15:44:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:04.317 15:44:53 -- nvmf/common.sh@123 -- # set -e 00:21:04.317 15:44:53 -- nvmf/common.sh@124 -- # return 0 00:21:04.317 15:44:53 -- nvmf/common.sh@477 -- # '[' -n 910952 ']' 00:21:04.317 15:44:53 -- nvmf/common.sh@478 -- # killprocess 910952 00:21:04.317 15:44:53 -- common/autotest_common.sh@936 -- # '[' -z 910952 ']' 00:21:04.317 15:44:53 -- common/autotest_common.sh@940 -- # kill -0 910952 00:21:04.317 15:44:53 -- common/autotest_common.sh@941 -- # uname 00:21:04.317 15:44:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:04.317 15:44:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 910952 00:21:04.317 15:44:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:04.317 15:44:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:04.317 15:44:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 910952' 00:21:04.317 killing process with pid 910952 00:21:04.317 15:44:53 -- common/autotest_common.sh@955 -- # kill 910952 00:21:04.317 15:44:53 -- common/autotest_common.sh@960 -- # wait 910952 00:21:04.317 15:44:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:04.317 15:44:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:04.317 15:44:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:04.317 15:44:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:04.317 15:44:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:04.317 15:44:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:04.317 15:44:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:04.317 15:44:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:04.884 15:44:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:04.884 00:21:04.884 real 1m9.053s 00:21:04.884 user 4m14.008s 00:21:04.884 sys 0m6.744s 00:21:04.884 15:44:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:04.884 15:44:56 -- common/autotest_common.sh@10 -- # set +x 00:21:04.884 ************************************ 00:21:04.884 END TEST nvmf_initiator_timeout 00:21:04.884 ************************************ 00:21:04.884 15:44:56 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:04.884 15:44:56 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:04.884 15:44:56 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:04.884 15:44:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:04.884 15:44:56 -- common/autotest_common.sh@10 -- # set +x 00:21:07.414 15:44:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:07.414 15:44:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:07.414 15:44:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:07.414 15:44:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:07.414 15:44:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:07.414 15:44:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:07.414 15:44:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:07.414 15:44:58 -- nvmf/common.sh@294 -- # net_devs=() 00:21:07.414 15:44:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:07.414 15:44:58 -- nvmf/common.sh@295 -- # e810=() 00:21:07.414 15:44:58 -- nvmf/common.sh@295 -- # local -ga e810 00:21:07.414 15:44:58 -- nvmf/common.sh@296 -- # x722=() 00:21:07.414 15:44:58 -- nvmf/common.sh@296 -- # local -ga x722 00:21:07.414 15:44:58 -- nvmf/common.sh@297 -- # mlx=() 00:21:07.414 15:44:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:07.414 15:44:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:07.414 15:44:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:07.414 15:44:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:07.414 15:44:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:07.414 15:44:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:07.414 15:44:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:07.414 15:44:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:07.414 15:44:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:07.414 15:44:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:07.414 15:44:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:07.414 15:44:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:07.414 15:44:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:07.414 15:44:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:07.414 15:44:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:07.414 15:44:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:07.414 15:44:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:07.414 15:44:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:07.414 15:44:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:07.414 15:44:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:07.414 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:07.414 15:44:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:07.414 15:44:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:07.414 15:44:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:07.415 15:44:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:07.415 15:44:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:07.415 15:44:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:07.415 15:44:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:07.415 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:07.415 15:44:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:07.415 15:44:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:07.415 15:44:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:07.415 15:44:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:07.415 15:44:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:07.415 15:44:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:07.415 15:44:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:07.415 15:44:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:07.415 15:44:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:07.415 15:44:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:07.415 15:44:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:07.415 15:44:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:07.415 15:44:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:07.415 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:07.415 15:44:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:07.415 15:44:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:07.415 15:44:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:07.415 15:44:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:07.415 15:44:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:07.415 15:44:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:07.415 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:07.415 15:44:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:07.415 15:44:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:07.415 15:44:58 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:07.415 15:44:58 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:07.415 15:44:58 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:07.415 15:44:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:07.415 15:44:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:07.415 15:44:58 -- common/autotest_common.sh@10 -- # set +x 00:21:07.415 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:21:07.415 ************************************ 00:21:07.415 START TEST nvmf_perf_adq 00:21:07.415 ************************************ 00:21:07.415 15:44:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:07.415 * Looking for test storage... 00:21:07.415 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:07.415 15:44:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:07.415 15:44:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:07.415 15:44:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:07.415 15:44:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:07.415 15:44:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:07.415 15:44:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:07.415 15:44:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:07.415 15:44:58 -- scripts/common.sh@335 -- # IFS=.-: 00:21:07.415 15:44:58 -- scripts/common.sh@335 -- # read -ra ver1 00:21:07.415 15:44:58 -- scripts/common.sh@336 -- # IFS=.-: 00:21:07.415 15:44:58 -- scripts/common.sh@336 -- # read -ra ver2 00:21:07.415 15:44:58 -- scripts/common.sh@337 -- # local 'op=<' 00:21:07.415 15:44:58 -- scripts/common.sh@339 -- # ver1_l=2 00:21:07.415 15:44:58 -- scripts/common.sh@340 -- # ver2_l=1 00:21:07.415 15:44:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:07.415 15:44:58 -- scripts/common.sh@343 -- # case "$op" in 00:21:07.415 15:44:58 -- scripts/common.sh@344 -- # : 1 00:21:07.415 15:44:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:07.415 15:44:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:07.415 15:44:58 -- scripts/common.sh@364 -- # decimal 1 00:21:07.415 15:44:58 -- scripts/common.sh@352 -- # local d=1 00:21:07.415 15:44:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:07.415 15:44:58 -- scripts/common.sh@354 -- # echo 1 00:21:07.415 15:44:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:07.415 15:44:58 -- scripts/common.sh@365 -- # decimal 2 00:21:07.415 15:44:58 -- scripts/common.sh@352 -- # local d=2 00:21:07.415 15:44:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:07.415 15:44:58 -- scripts/common.sh@354 -- # echo 2 00:21:07.415 15:44:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:07.415 15:44:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:07.415 15:44:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:07.415 15:44:58 -- scripts/common.sh@367 -- # return 0 00:21:07.415 15:44:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:07.415 15:44:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:07.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:07.415 --rc genhtml_branch_coverage=1 00:21:07.415 --rc genhtml_function_coverage=1 00:21:07.415 --rc genhtml_legend=1 00:21:07.415 --rc geninfo_all_blocks=1 00:21:07.415 --rc geninfo_unexecuted_blocks=1 00:21:07.415 00:21:07.415 ' 00:21:07.415 15:44:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:07.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:07.415 --rc genhtml_branch_coverage=1 00:21:07.415 --rc genhtml_function_coverage=1 00:21:07.415 --rc genhtml_legend=1 00:21:07.415 --rc geninfo_all_blocks=1 00:21:07.415 --rc geninfo_unexecuted_blocks=1 00:21:07.415 00:21:07.415 ' 00:21:07.415 15:44:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:07.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:07.415 --rc genhtml_branch_coverage=1 00:21:07.415 --rc genhtml_function_coverage=1 00:21:07.415 --rc genhtml_legend=1 00:21:07.415 --rc geninfo_all_blocks=1 00:21:07.415 --rc geninfo_unexecuted_blocks=1 00:21:07.415 00:21:07.415 ' 00:21:07.415 15:44:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:07.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:07.415 --rc genhtml_branch_coverage=1 00:21:07.415 --rc genhtml_function_coverage=1 00:21:07.415 --rc genhtml_legend=1 00:21:07.415 --rc geninfo_all_blocks=1 00:21:07.415 --rc geninfo_unexecuted_blocks=1 00:21:07.415 00:21:07.415 ' 00:21:07.415 15:44:58 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:07.415 15:44:58 -- nvmf/common.sh@7 -- # uname -s 00:21:07.415 15:44:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:07.415 15:44:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:07.415 15:44:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:07.415 15:44:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:07.415 15:44:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:07.415 15:44:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:07.415 15:44:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:07.415 15:44:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:07.415 15:44:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:07.415 15:44:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:07.415 15:44:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:07.415 15:44:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:07.415 15:44:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:07.415 15:44:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:07.415 15:44:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:07.415 15:44:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:07.415 15:44:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:07.415 15:44:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:07.415 15:44:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:07.415 15:44:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:07.415 15:44:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:07.415 15:44:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:07.415 15:44:58 -- paths/export.sh@5 -- # export PATH 00:21:07.415 15:44:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:07.415 15:44:58 -- nvmf/common.sh@46 -- # : 0 00:21:07.415 15:44:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:07.415 15:44:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:07.415 15:44:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:07.415 15:44:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:07.415 15:44:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:07.415 15:44:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:07.415 15:44:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:07.415 15:44:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:07.416 15:44:58 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:07.416 15:44:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:07.416 15:44:58 -- common/autotest_common.sh@10 -- # set +x 00:21:09.319 15:45:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:09.319 15:45:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:09.319 15:45:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:09.319 15:45:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:09.319 15:45:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:09.319 15:45:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:09.319 15:45:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:09.319 15:45:00 -- nvmf/common.sh@294 -- # net_devs=() 00:21:09.319 15:45:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:09.319 15:45:00 -- nvmf/common.sh@295 -- # e810=() 00:21:09.319 15:45:00 -- nvmf/common.sh@295 -- # local -ga e810 00:21:09.319 15:45:00 -- nvmf/common.sh@296 -- # x722=() 00:21:09.319 15:45:00 -- nvmf/common.sh@296 -- # local -ga x722 00:21:09.319 15:45:00 -- nvmf/common.sh@297 -- # mlx=() 00:21:09.319 15:45:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:09.319 15:45:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:09.319 15:45:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:09.319 15:45:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:09.319 15:45:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:09.319 15:45:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:09.319 15:45:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:09.319 15:45:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:09.319 15:45:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:09.319 15:45:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:09.319 15:45:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:09.319 15:45:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:09.319 15:45:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:09.319 15:45:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:09.319 15:45:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:09.319 15:45:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:09.319 15:45:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:09.319 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:09.319 15:45:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:09.319 15:45:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:09.319 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:09.319 15:45:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:09.319 15:45:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:09.319 15:45:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:09.319 15:45:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:09.319 15:45:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:09.319 15:45:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:09.319 15:45:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:09.319 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:09.319 15:45:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:09.319 15:45:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:09.319 15:45:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:09.319 15:45:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:09.319 15:45:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:09.319 15:45:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:09.319 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:09.319 15:45:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:09.319 15:45:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:09.319 15:45:00 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:09.319 15:45:00 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:09.319 15:45:00 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:09.319 15:45:00 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:09.319 15:45:00 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:09.886 15:45:01 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:12.420 15:45:03 -- target/perf_adq.sh@54 -- # sleep 5 00:21:17.691 15:45:08 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:17.691 15:45:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:17.691 15:45:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:17.692 15:45:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:17.692 15:45:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:17.692 15:45:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:17.692 15:45:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:17.692 15:45:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:17.692 15:45:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:17.692 15:45:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:17.692 15:45:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:17.692 15:45:08 -- common/autotest_common.sh@10 -- # set +x 00:21:17.692 15:45:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:17.692 15:45:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:17.692 15:45:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:17.692 15:45:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:17.692 15:45:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:17.692 15:45:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:17.692 15:45:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:17.692 15:45:08 -- nvmf/common.sh@294 -- # net_devs=() 00:21:17.692 15:45:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:17.692 15:45:08 -- nvmf/common.sh@295 -- # e810=() 00:21:17.692 15:45:08 -- nvmf/common.sh@295 -- # local -ga e810 00:21:17.692 15:45:08 -- nvmf/common.sh@296 -- # x722=() 00:21:17.692 15:45:08 -- nvmf/common.sh@296 -- # local -ga x722 00:21:17.692 15:45:08 -- nvmf/common.sh@297 -- # mlx=() 00:21:17.692 15:45:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:17.692 15:45:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:17.692 15:45:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:17.692 15:45:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:17.692 15:45:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:17.692 15:45:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:17.692 15:45:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:17.692 15:45:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:17.692 15:45:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:17.692 15:45:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:17.692 15:45:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:17.692 15:45:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:17.692 15:45:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:17.692 15:45:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:17.692 15:45:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:17.692 15:45:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:17.692 15:45:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:17.692 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:17.692 15:45:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:17.692 15:45:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:17.692 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:17.692 15:45:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:17.692 15:45:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:17.692 15:45:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:17.692 15:45:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:17.692 15:45:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:17.692 15:45:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:17.692 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:17.692 15:45:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:17.692 15:45:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:17.692 15:45:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:17.692 15:45:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:17.692 15:45:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:17.692 15:45:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:17.692 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:17.692 15:45:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:17.692 15:45:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:17.692 15:45:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:17.692 15:45:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:17.692 15:45:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:17.692 15:45:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:17.692 15:45:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:17.692 15:45:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:17.692 15:45:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:17.692 15:45:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:17.692 15:45:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:17.692 15:45:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:17.692 15:45:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:17.692 15:45:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:17.692 15:45:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:17.692 15:45:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:17.692 15:45:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:17.692 15:45:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:17.692 15:45:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:17.692 15:45:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:17.692 15:45:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:17.692 15:45:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:17.692 15:45:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:17.692 15:45:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:17.692 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:17.692 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:21:17.692 00:21:17.692 --- 10.0.0.2 ping statistics --- 00:21:17.692 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:17.692 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:21:17.692 15:45:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:17.692 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:17.692 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:21:17.692 00:21:17.692 --- 10.0.0.1 ping statistics --- 00:21:17.692 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:17.692 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:21:17.692 15:45:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:17.692 15:45:08 -- nvmf/common.sh@410 -- # return 0 00:21:17.692 15:45:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:17.692 15:45:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:17.692 15:45:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:17.692 15:45:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:17.692 15:45:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:17.692 15:45:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:17.692 15:45:08 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:17.692 15:45:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:17.692 15:45:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:17.692 15:45:08 -- common/autotest_common.sh@10 -- # set +x 00:21:17.692 15:45:08 -- nvmf/common.sh@469 -- # nvmfpid=923672 00:21:17.692 15:45:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:17.692 15:45:08 -- nvmf/common.sh@470 -- # waitforlisten 923672 00:21:17.692 15:45:08 -- common/autotest_common.sh@829 -- # '[' -z 923672 ']' 00:21:17.692 15:45:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:17.692 15:45:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:17.692 15:45:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:17.692 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:17.692 15:45:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:17.692 15:45:08 -- common/autotest_common.sh@10 -- # set +x 00:21:17.692 [2024-11-26 15:45:08.839120] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:17.692 [2024-11-26 15:45:08.839210] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:17.692 EAL: No free 2048 kB hugepages reported on node 1 00:21:17.692 [2024-11-26 15:45:08.904590] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:17.692 [2024-11-26 15:45:09.011058] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:17.692 [2024-11-26 15:45:09.011214] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:17.692 [2024-11-26 15:45:09.011231] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:17.692 [2024-11-26 15:45:09.011243] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:17.692 [2024-11-26 15:45:09.011295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:17.692 [2024-11-26 15:45:09.011357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:17.692 [2024-11-26 15:45:09.011407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:17.692 [2024-11-26 15:45:09.011412] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:17.692 15:45:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:17.693 15:45:09 -- common/autotest_common.sh@862 -- # return 0 00:21:17.693 15:45:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:17.693 15:45:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:17.693 15:45:09 -- common/autotest_common.sh@10 -- # set +x 00:21:17.693 15:45:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:17.693 15:45:09 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:17.693 15:45:09 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:17.693 15:45:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:17.693 15:45:09 -- common/autotest_common.sh@10 -- # set +x 00:21:17.693 15:45:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:17.693 15:45:09 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:17.693 15:45:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:17.693 15:45:09 -- common/autotest_common.sh@10 -- # set +x 00:21:17.954 15:45:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:17.954 15:45:09 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:17.954 15:45:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:17.954 15:45:09 -- common/autotest_common.sh@10 -- # set +x 00:21:17.954 [2024-11-26 15:45:09.212345] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:17.954 15:45:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:17.954 15:45:09 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:17.954 15:45:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:17.954 15:45:09 -- common/autotest_common.sh@10 -- # set +x 00:21:17.954 Malloc1 00:21:17.954 15:45:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:17.954 15:45:09 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:17.954 15:45:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:17.954 15:45:09 -- common/autotest_common.sh@10 -- # set +x 00:21:17.954 15:45:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:17.954 15:45:09 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:17.954 15:45:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:17.954 15:45:09 -- common/autotest_common.sh@10 -- # set +x 00:21:17.954 15:45:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:17.954 15:45:09 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:17.954 15:45:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:17.954 15:45:09 -- common/autotest_common.sh@10 -- # set +x 00:21:17.954 [2024-11-26 15:45:09.263620] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:17.954 15:45:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:17.954 15:45:09 -- target/perf_adq.sh@73 -- # perfpid=923706 00:21:17.954 15:45:09 -- target/perf_adq.sh@74 -- # sleep 2 00:21:17.954 15:45:09 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:17.954 EAL: No free 2048 kB hugepages reported on node 1 00:21:19.856 15:45:11 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:19.856 15:45:11 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:19.856 15:45:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.856 15:45:11 -- target/perf_adq.sh@76 -- # wc -l 00:21:19.856 15:45:11 -- common/autotest_common.sh@10 -- # set +x 00:21:19.856 15:45:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:20.114 15:45:11 -- target/perf_adq.sh@76 -- # count=4 00:21:20.114 15:45:11 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:20.114 15:45:11 -- target/perf_adq.sh@81 -- # wait 923706 00:21:28.232 Initializing NVMe Controllers 00:21:28.232 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:28.232 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:28.232 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:28.232 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:28.232 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:28.232 Initialization complete. Launching workers. 00:21:28.232 ======================================================== 00:21:28.232 Latency(us) 00:21:28.232 Device Information : IOPS MiB/s Average min max 00:21:28.232 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11346.80 44.32 5640.62 1420.15 9119.82 00:21:28.232 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11412.80 44.58 5607.84 1606.69 9119.27 00:21:28.232 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 10033.30 39.19 6380.59 2157.26 10853.66 00:21:28.232 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11171.60 43.64 5730.09 1819.32 9326.41 00:21:28.232 ======================================================== 00:21:28.232 Total : 43964.49 171.74 5823.72 1420.15 10853.66 00:21:28.232 00:21:28.232 15:45:19 -- target/perf_adq.sh@82 -- # nvmftestfini 00:21:28.232 15:45:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:28.232 15:45:19 -- nvmf/common.sh@116 -- # sync 00:21:28.232 15:45:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:28.232 15:45:19 -- nvmf/common.sh@119 -- # set +e 00:21:28.232 15:45:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:28.232 15:45:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:28.232 rmmod nvme_tcp 00:21:28.232 rmmod nvme_fabrics 00:21:28.232 rmmod nvme_keyring 00:21:28.232 15:45:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:28.232 15:45:19 -- nvmf/common.sh@123 -- # set -e 00:21:28.232 15:45:19 -- nvmf/common.sh@124 -- # return 0 00:21:28.232 15:45:19 -- nvmf/common.sh@477 -- # '[' -n 923672 ']' 00:21:28.232 15:45:19 -- nvmf/common.sh@478 -- # killprocess 923672 00:21:28.232 15:45:19 -- common/autotest_common.sh@936 -- # '[' -z 923672 ']' 00:21:28.232 15:45:19 -- common/autotest_common.sh@940 -- # kill -0 923672 00:21:28.232 15:45:19 -- common/autotest_common.sh@941 -- # uname 00:21:28.232 15:45:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:28.232 15:45:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 923672 00:21:28.232 15:45:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:28.232 15:45:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:28.232 15:45:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 923672' 00:21:28.232 killing process with pid 923672 00:21:28.232 15:45:19 -- common/autotest_common.sh@955 -- # kill 923672 00:21:28.232 15:45:19 -- common/autotest_common.sh@960 -- # wait 923672 00:21:28.490 15:45:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:28.490 15:45:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:28.490 15:45:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:28.490 15:45:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:28.490 15:45:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:28.490 15:45:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:28.490 15:45:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:28.490 15:45:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:30.405 15:45:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:30.405 15:45:21 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:21:30.405 15:45:21 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:31.345 15:45:22 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:33.885 15:45:24 -- target/perf_adq.sh@54 -- # sleep 5 00:21:39.230 15:45:29 -- target/perf_adq.sh@87 -- # nvmftestinit 00:21:39.230 15:45:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:39.230 15:45:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:39.230 15:45:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:39.230 15:45:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:39.230 15:45:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:39.230 15:45:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:39.230 15:45:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:39.230 15:45:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:39.230 15:45:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:39.230 15:45:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:39.230 15:45:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:39.230 15:45:29 -- common/autotest_common.sh@10 -- # set +x 00:21:39.230 15:45:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:39.230 15:45:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:39.230 15:45:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:39.230 15:45:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:39.230 15:45:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:39.230 15:45:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:39.230 15:45:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:39.230 15:45:29 -- nvmf/common.sh@294 -- # net_devs=() 00:21:39.230 15:45:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:39.230 15:45:29 -- nvmf/common.sh@295 -- # e810=() 00:21:39.231 15:45:29 -- nvmf/common.sh@295 -- # local -ga e810 00:21:39.231 15:45:29 -- nvmf/common.sh@296 -- # x722=() 00:21:39.231 15:45:29 -- nvmf/common.sh@296 -- # local -ga x722 00:21:39.231 15:45:29 -- nvmf/common.sh@297 -- # mlx=() 00:21:39.231 15:45:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:39.231 15:45:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:39.231 15:45:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:39.231 15:45:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:39.231 15:45:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:39.231 15:45:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:39.231 15:45:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:39.231 15:45:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:39.231 15:45:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:39.231 15:45:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:39.231 15:45:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:39.231 15:45:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:39.231 15:45:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:39.231 15:45:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:39.231 15:45:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:39.231 15:45:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:39.231 15:45:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:39.231 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:39.231 15:45:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:39.231 15:45:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:39.231 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:39.231 15:45:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:39.231 15:45:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:39.231 15:45:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:39.231 15:45:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:39.231 15:45:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:39.231 15:45:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:39.231 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:39.231 15:45:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:39.231 15:45:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:39.231 15:45:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:39.231 15:45:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:39.231 15:45:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:39.231 15:45:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:39.231 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:39.231 15:45:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:39.231 15:45:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:39.231 15:45:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:39.231 15:45:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:39.231 15:45:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:39.231 15:45:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:39.231 15:45:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:39.231 15:45:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:39.231 15:45:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:39.231 15:45:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:39.231 15:45:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:39.231 15:45:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:39.231 15:45:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:39.231 15:45:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:39.231 15:45:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:39.231 15:45:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:39.231 15:45:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:39.231 15:45:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:39.231 15:45:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:39.231 15:45:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:39.231 15:45:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:39.231 15:45:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:39.231 15:45:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:39.231 15:45:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:39.231 15:45:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:39.231 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:39.231 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:21:39.231 00:21:39.231 --- 10.0.0.2 ping statistics --- 00:21:39.231 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:39.231 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:21:39.231 15:45:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:39.231 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:39.231 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:21:39.231 00:21:39.231 --- 10.0.0.1 ping statistics --- 00:21:39.231 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:39.231 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:21:39.231 15:45:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:39.231 15:45:30 -- nvmf/common.sh@410 -- # return 0 00:21:39.231 15:45:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:39.231 15:45:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:39.231 15:45:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:39.231 15:45:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:39.231 15:45:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:39.231 15:45:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:39.231 15:45:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:39.231 15:45:30 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:21:39.231 15:45:30 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:21:39.231 15:45:30 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:21:39.231 15:45:30 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:21:39.231 net.core.busy_poll = 1 00:21:39.231 15:45:30 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:21:39.231 net.core.busy_read = 1 00:21:39.231 15:45:30 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:21:39.231 15:45:30 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:21:39.231 15:45:30 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:21:39.231 15:45:30 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:21:39.231 15:45:30 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:21:39.231 15:45:30 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:39.231 15:45:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:39.231 15:45:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:39.231 15:45:30 -- common/autotest_common.sh@10 -- # set +x 00:21:39.231 15:45:30 -- nvmf/common.sh@469 -- # nvmfpid=926273 00:21:39.231 15:45:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:39.231 15:45:30 -- nvmf/common.sh@470 -- # waitforlisten 926273 00:21:39.231 15:45:30 -- common/autotest_common.sh@829 -- # '[' -z 926273 ']' 00:21:39.231 15:45:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:39.231 15:45:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:39.231 15:45:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:39.231 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:39.231 15:45:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:39.231 15:45:30 -- common/autotest_common.sh@10 -- # set +x 00:21:39.231 [2024-11-26 15:45:30.269401] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:39.231 [2024-11-26 15:45:30.269481] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:39.231 EAL: No free 2048 kB hugepages reported on node 1 00:21:39.231 [2024-11-26 15:45:30.336284] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:39.231 [2024-11-26 15:45:30.442886] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:39.231 [2024-11-26 15:45:30.443059] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:39.231 [2024-11-26 15:45:30.443076] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:39.231 [2024-11-26 15:45:30.443088] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:39.231 [2024-11-26 15:45:30.443151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:39.231 [2024-11-26 15:45:30.443215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:39.231 [2024-11-26 15:45:30.443280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:39.231 [2024-11-26 15:45:30.443282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:39.231 15:45:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:39.231 15:45:30 -- common/autotest_common.sh@862 -- # return 0 00:21:39.232 15:45:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:39.232 15:45:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:39.232 15:45:30 -- common/autotest_common.sh@10 -- # set +x 00:21:39.232 15:45:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:39.232 15:45:30 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:21:39.232 15:45:30 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:21:39.232 15:45:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.232 15:45:30 -- common/autotest_common.sh@10 -- # set +x 00:21:39.232 15:45:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.232 15:45:30 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:39.232 15:45:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.232 15:45:30 -- common/autotest_common.sh@10 -- # set +x 00:21:39.232 15:45:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.232 15:45:30 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:21:39.232 15:45:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.232 15:45:30 -- common/autotest_common.sh@10 -- # set +x 00:21:39.232 [2024-11-26 15:45:30.647593] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:39.232 15:45:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.232 15:45:30 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:39.232 15:45:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.232 15:45:30 -- common/autotest_common.sh@10 -- # set +x 00:21:39.489 Malloc1 00:21:39.489 15:45:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.489 15:45:30 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:39.489 15:45:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.489 15:45:30 -- common/autotest_common.sh@10 -- # set +x 00:21:39.489 15:45:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.489 15:45:30 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:39.489 15:45:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.489 15:45:30 -- common/autotest_common.sh@10 -- # set +x 00:21:39.489 15:45:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.489 15:45:30 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:39.489 15:45:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.489 15:45:30 -- common/autotest_common.sh@10 -- # set +x 00:21:39.489 [2024-11-26 15:45:30.701347] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:39.489 15:45:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.489 15:45:30 -- target/perf_adq.sh@94 -- # perfpid=926418 00:21:39.489 15:45:30 -- target/perf_adq.sh@95 -- # sleep 2 00:21:39.489 15:45:30 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:39.489 EAL: No free 2048 kB hugepages reported on node 1 00:21:41.414 15:45:32 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:21:41.414 15:45:32 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:21:41.414 15:45:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.414 15:45:32 -- target/perf_adq.sh@97 -- # wc -l 00:21:41.414 15:45:32 -- common/autotest_common.sh@10 -- # set +x 00:21:41.414 15:45:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.414 15:45:32 -- target/perf_adq.sh@97 -- # count=3 00:21:41.414 15:45:32 -- target/perf_adq.sh@98 -- # [[ 3 -lt 2 ]] 00:21:41.414 15:45:32 -- target/perf_adq.sh@103 -- # wait 926418 00:21:49.532 Initializing NVMe Controllers 00:21:49.532 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:49.532 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:49.532 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:49.532 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:49.532 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:49.532 Initialization complete. Launching workers. 00:21:49.532 ======================================================== 00:21:49.532 Latency(us) 00:21:49.532 Device Information : IOPS MiB/s Average min max 00:21:49.532 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5103.00 19.93 12588.56 1393.90 60652.06 00:21:49.532 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4968.90 19.41 12928.00 1961.51 62680.42 00:21:49.532 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 4920.10 19.22 13018.42 2589.13 60120.58 00:21:49.532 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 4785.30 18.69 13384.55 1973.66 59308.91 00:21:49.532 ======================================================== 00:21:49.532 Total : 19777.29 77.26 12973.38 1393.90 62680.42 00:21:49.532 00:21:49.532 15:45:40 -- target/perf_adq.sh@104 -- # nvmftestfini 00:21:49.532 15:45:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:49.532 15:45:40 -- nvmf/common.sh@116 -- # sync 00:21:49.532 15:45:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:49.532 15:45:40 -- nvmf/common.sh@119 -- # set +e 00:21:49.532 15:45:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:49.532 15:45:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:49.532 rmmod nvme_tcp 00:21:49.532 rmmod nvme_fabrics 00:21:49.532 rmmod nvme_keyring 00:21:49.532 15:45:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:49.532 15:45:40 -- nvmf/common.sh@123 -- # set -e 00:21:49.532 15:45:40 -- nvmf/common.sh@124 -- # return 0 00:21:49.532 15:45:40 -- nvmf/common.sh@477 -- # '[' -n 926273 ']' 00:21:49.532 15:45:40 -- nvmf/common.sh@478 -- # killprocess 926273 00:21:49.532 15:45:40 -- common/autotest_common.sh@936 -- # '[' -z 926273 ']' 00:21:49.532 15:45:40 -- common/autotest_common.sh@940 -- # kill -0 926273 00:21:49.532 15:45:40 -- common/autotest_common.sh@941 -- # uname 00:21:49.532 15:45:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:49.532 15:45:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 926273 00:21:49.790 15:45:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:49.790 15:45:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:49.790 15:45:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 926273' 00:21:49.790 killing process with pid 926273 00:21:49.790 15:45:40 -- common/autotest_common.sh@955 -- # kill 926273 00:21:49.790 15:45:40 -- common/autotest_common.sh@960 -- # wait 926273 00:21:50.051 15:45:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:50.051 15:45:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:50.051 15:45:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:50.051 15:45:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:50.051 15:45:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:50.051 15:45:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:50.051 15:45:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:50.051 15:45:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:51.958 15:45:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:51.958 15:45:43 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:21:51.958 00:21:51.958 real 0m44.991s 00:21:51.958 user 2m36.574s 00:21:51.958 sys 0m11.046s 00:21:51.958 15:45:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:51.958 15:45:43 -- common/autotest_common.sh@10 -- # set +x 00:21:51.958 ************************************ 00:21:51.958 END TEST nvmf_perf_adq 00:21:51.958 ************************************ 00:21:51.958 15:45:43 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:51.958 15:45:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:51.958 15:45:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:51.958 15:45:43 -- common/autotest_common.sh@10 -- # set +x 00:21:51.958 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:21:51.958 ************************************ 00:21:51.958 START TEST nvmf_shutdown 00:21:51.958 ************************************ 00:21:51.958 15:45:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:52.218 * Looking for test storage... 00:21:52.218 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:52.218 15:45:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:52.218 15:45:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:52.218 15:45:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:52.218 15:45:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:52.218 15:45:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:52.218 15:45:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:52.218 15:45:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:52.218 15:45:43 -- scripts/common.sh@335 -- # IFS=.-: 00:21:52.218 15:45:43 -- scripts/common.sh@335 -- # read -ra ver1 00:21:52.218 15:45:43 -- scripts/common.sh@336 -- # IFS=.-: 00:21:52.218 15:45:43 -- scripts/common.sh@336 -- # read -ra ver2 00:21:52.218 15:45:43 -- scripts/common.sh@337 -- # local 'op=<' 00:21:52.218 15:45:43 -- scripts/common.sh@339 -- # ver1_l=2 00:21:52.218 15:45:43 -- scripts/common.sh@340 -- # ver2_l=1 00:21:52.218 15:45:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:52.218 15:45:43 -- scripts/common.sh@343 -- # case "$op" in 00:21:52.218 15:45:43 -- scripts/common.sh@344 -- # : 1 00:21:52.218 15:45:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:52.218 15:45:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:52.218 15:45:43 -- scripts/common.sh@364 -- # decimal 1 00:21:52.218 15:45:43 -- scripts/common.sh@352 -- # local d=1 00:21:52.218 15:45:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:52.218 15:45:43 -- scripts/common.sh@354 -- # echo 1 00:21:52.218 15:45:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:52.218 15:45:43 -- scripts/common.sh@365 -- # decimal 2 00:21:52.218 15:45:43 -- scripts/common.sh@352 -- # local d=2 00:21:52.218 15:45:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:52.218 15:45:43 -- scripts/common.sh@354 -- # echo 2 00:21:52.218 15:45:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:52.218 15:45:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:52.218 15:45:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:52.218 15:45:43 -- scripts/common.sh@367 -- # return 0 00:21:52.218 15:45:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:52.218 15:45:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:52.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:52.218 --rc genhtml_branch_coverage=1 00:21:52.218 --rc genhtml_function_coverage=1 00:21:52.218 --rc genhtml_legend=1 00:21:52.218 --rc geninfo_all_blocks=1 00:21:52.218 --rc geninfo_unexecuted_blocks=1 00:21:52.218 00:21:52.218 ' 00:21:52.218 15:45:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:52.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:52.218 --rc genhtml_branch_coverage=1 00:21:52.218 --rc genhtml_function_coverage=1 00:21:52.218 --rc genhtml_legend=1 00:21:52.218 --rc geninfo_all_blocks=1 00:21:52.218 --rc geninfo_unexecuted_blocks=1 00:21:52.218 00:21:52.218 ' 00:21:52.218 15:45:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:52.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:52.218 --rc genhtml_branch_coverage=1 00:21:52.218 --rc genhtml_function_coverage=1 00:21:52.218 --rc genhtml_legend=1 00:21:52.218 --rc geninfo_all_blocks=1 00:21:52.218 --rc geninfo_unexecuted_blocks=1 00:21:52.218 00:21:52.218 ' 00:21:52.218 15:45:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:52.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:52.218 --rc genhtml_branch_coverage=1 00:21:52.218 --rc genhtml_function_coverage=1 00:21:52.218 --rc genhtml_legend=1 00:21:52.218 --rc geninfo_all_blocks=1 00:21:52.218 --rc geninfo_unexecuted_blocks=1 00:21:52.218 00:21:52.218 ' 00:21:52.218 15:45:43 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:52.218 15:45:43 -- nvmf/common.sh@7 -- # uname -s 00:21:52.218 15:45:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:52.218 15:45:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:52.218 15:45:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:52.218 15:45:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:52.218 15:45:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:52.218 15:45:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:52.218 15:45:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:52.218 15:45:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:52.218 15:45:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:52.218 15:45:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:52.218 15:45:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:52.218 15:45:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:52.218 15:45:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:52.219 15:45:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:52.219 15:45:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:52.219 15:45:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:52.219 15:45:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:52.219 15:45:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:52.219 15:45:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:52.219 15:45:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:52.219 15:45:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:52.219 15:45:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:52.219 15:45:43 -- paths/export.sh@5 -- # export PATH 00:21:52.219 15:45:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:52.219 15:45:43 -- nvmf/common.sh@46 -- # : 0 00:21:52.219 15:45:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:52.219 15:45:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:52.219 15:45:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:52.219 15:45:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:52.219 15:45:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:52.219 15:45:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:52.219 15:45:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:52.219 15:45:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:52.219 15:45:43 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:52.219 15:45:43 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:52.219 15:45:43 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:21:52.219 15:45:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:21:52.219 15:45:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:52.219 15:45:43 -- common/autotest_common.sh@10 -- # set +x 00:21:52.219 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:21:52.219 ************************************ 00:21:52.219 START TEST nvmf_shutdown_tc1 00:21:52.219 ************************************ 00:21:52.219 15:45:43 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:21:52.219 15:45:43 -- target/shutdown.sh@74 -- # starttarget 00:21:52.219 15:45:43 -- target/shutdown.sh@15 -- # nvmftestinit 00:21:52.219 15:45:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:52.219 15:45:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:52.219 15:45:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:52.219 15:45:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:52.219 15:45:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:52.219 15:45:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:52.219 15:45:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:52.219 15:45:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:52.219 15:45:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:52.219 15:45:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:52.219 15:45:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:52.219 15:45:43 -- common/autotest_common.sh@10 -- # set +x 00:21:54.128 15:45:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:54.128 15:45:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:54.128 15:45:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:54.128 15:45:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:54.128 15:45:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:54.128 15:45:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:54.128 15:45:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:54.128 15:45:45 -- nvmf/common.sh@294 -- # net_devs=() 00:21:54.128 15:45:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:54.128 15:45:45 -- nvmf/common.sh@295 -- # e810=() 00:21:54.128 15:45:45 -- nvmf/common.sh@295 -- # local -ga e810 00:21:54.128 15:45:45 -- nvmf/common.sh@296 -- # x722=() 00:21:54.128 15:45:45 -- nvmf/common.sh@296 -- # local -ga x722 00:21:54.128 15:45:45 -- nvmf/common.sh@297 -- # mlx=() 00:21:54.128 15:45:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:54.128 15:45:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:54.128 15:45:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:54.128 15:45:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:54.128 15:45:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:54.128 15:45:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:54.128 15:45:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:54.128 15:45:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:54.128 15:45:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:54.128 15:45:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:54.128 15:45:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:54.128 15:45:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:54.128 15:45:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:54.128 15:45:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:54.128 15:45:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:54.128 15:45:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:54.128 15:45:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:54.128 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:54.128 15:45:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:54.128 15:45:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:54.128 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:54.128 15:45:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:54.128 15:45:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:54.128 15:45:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:54.128 15:45:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:54.128 15:45:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:54.128 15:45:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:54.128 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:54.128 15:45:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:54.128 15:45:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:54.128 15:45:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:54.128 15:45:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:54.128 15:45:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:54.128 15:45:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:54.128 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:54.128 15:45:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:54.128 15:45:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:54.128 15:45:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:54.128 15:45:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:54.128 15:45:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:54.128 15:45:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:54.128 15:45:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:54.128 15:45:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:54.128 15:45:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:54.128 15:45:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:54.128 15:45:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:54.128 15:45:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:54.128 15:45:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:54.128 15:45:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:54.128 15:45:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:54.128 15:45:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:54.128 15:45:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:54.128 15:45:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:54.128 15:45:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:54.128 15:45:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:54.128 15:45:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:54.128 15:45:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:54.388 15:45:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:54.388 15:45:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:54.388 15:45:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:54.389 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:54.389 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.207 ms 00:21:54.389 00:21:54.389 --- 10.0.0.2 ping statistics --- 00:21:54.389 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:54.389 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:21:54.389 15:45:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:54.389 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:54.389 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:21:54.389 00:21:54.389 --- 10.0.0.1 ping statistics --- 00:21:54.389 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:54.389 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:21:54.389 15:45:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:54.389 15:45:45 -- nvmf/common.sh@410 -- # return 0 00:21:54.389 15:45:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:54.389 15:45:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:54.389 15:45:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:54.389 15:45:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:54.389 15:45:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:54.389 15:45:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:54.389 15:45:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:54.389 15:45:45 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:21:54.389 15:45:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:54.389 15:45:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:54.389 15:45:45 -- common/autotest_common.sh@10 -- # set +x 00:21:54.389 15:45:45 -- nvmf/common.sh@469 -- # nvmfpid=929541 00:21:54.389 15:45:45 -- nvmf/common.sh@470 -- # waitforlisten 929541 00:21:54.389 15:45:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:21:54.389 15:45:45 -- common/autotest_common.sh@829 -- # '[' -z 929541 ']' 00:21:54.389 15:45:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:54.389 15:45:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:54.389 15:45:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:54.389 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:54.389 15:45:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:54.389 15:45:45 -- common/autotest_common.sh@10 -- # set +x 00:21:54.389 [2024-11-26 15:45:45.667073] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:54.389 [2024-11-26 15:45:45.667171] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:54.389 EAL: No free 2048 kB hugepages reported on node 1 00:21:54.389 [2024-11-26 15:45:45.734842] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:54.649 [2024-11-26 15:45:45.843072] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:54.649 [2024-11-26 15:45:45.843223] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:54.649 [2024-11-26 15:45:45.843255] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:54.649 [2024-11-26 15:45:45.843267] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:54.649 [2024-11-26 15:45:45.843323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:54.649 [2024-11-26 15:45:45.843386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:54.649 [2024-11-26 15:45:45.843451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:54.649 [2024-11-26 15:45:45.843454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:55.214 15:45:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:55.214 15:45:46 -- common/autotest_common.sh@862 -- # return 0 00:21:55.214 15:45:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:55.214 15:45:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:55.214 15:45:46 -- common/autotest_common.sh@10 -- # set +x 00:21:55.214 15:45:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:55.214 15:45:46 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:55.214 15:45:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:55.214 15:45:46 -- common/autotest_common.sh@10 -- # set +x 00:21:55.472 [2024-11-26 15:45:46.664242] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:55.472 15:45:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:55.472 15:45:46 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:21:55.472 15:45:46 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:21:55.472 15:45:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:55.472 15:45:46 -- common/autotest_common.sh@10 -- # set +x 00:21:55.472 15:45:46 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:55.472 15:45:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:55.472 15:45:46 -- target/shutdown.sh@28 -- # cat 00:21:55.472 15:45:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:55.472 15:45:46 -- target/shutdown.sh@28 -- # cat 00:21:55.472 15:45:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:55.472 15:45:46 -- target/shutdown.sh@28 -- # cat 00:21:55.472 15:45:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:55.472 15:45:46 -- target/shutdown.sh@28 -- # cat 00:21:55.472 15:45:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:55.472 15:45:46 -- target/shutdown.sh@28 -- # cat 00:21:55.472 15:45:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:55.472 15:45:46 -- target/shutdown.sh@28 -- # cat 00:21:55.472 15:45:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:55.472 15:45:46 -- target/shutdown.sh@28 -- # cat 00:21:55.472 15:45:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:55.472 15:45:46 -- target/shutdown.sh@28 -- # cat 00:21:55.472 15:45:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:55.472 15:45:46 -- target/shutdown.sh@28 -- # cat 00:21:55.472 15:45:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:55.472 15:45:46 -- target/shutdown.sh@28 -- # cat 00:21:55.472 15:45:46 -- target/shutdown.sh@35 -- # rpc_cmd 00:21:55.472 15:45:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:55.472 15:45:46 -- common/autotest_common.sh@10 -- # set +x 00:21:55.472 Malloc1 00:21:55.472 [2024-11-26 15:45:46.739240] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:55.472 Malloc2 00:21:55.472 Malloc3 00:21:55.472 Malloc4 00:21:55.472 Malloc5 00:21:55.731 Malloc6 00:21:55.731 Malloc7 00:21:55.731 Malloc8 00:21:55.731 Malloc9 00:21:55.731 Malloc10 00:21:55.990 15:45:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:55.990 15:45:47 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:21:55.990 15:45:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:55.990 15:45:47 -- common/autotest_common.sh@10 -- # set +x 00:21:55.990 15:45:47 -- target/shutdown.sh@78 -- # perfpid=929728 00:21:55.990 15:45:47 -- target/shutdown.sh@79 -- # waitforlisten 929728 /var/tmp/bdevperf.sock 00:21:55.990 15:45:47 -- common/autotest_common.sh@829 -- # '[' -z 929728 ']' 00:21:55.990 15:45:47 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:21:55.990 15:45:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:55.990 15:45:47 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:55.990 15:45:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:55.990 15:45:47 -- nvmf/common.sh@520 -- # config=() 00:21:55.990 15:45:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:55.990 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:55.990 15:45:47 -- nvmf/common.sh@520 -- # local subsystem config 00:21:55.990 15:45:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:55.990 15:45:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:55.990 15:45:47 -- common/autotest_common.sh@10 -- # set +x 00:21:55.990 15:45:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:55.990 { 00:21:55.990 "params": { 00:21:55.990 "name": "Nvme$subsystem", 00:21:55.990 "trtype": "$TEST_TRANSPORT", 00:21:55.990 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:55.990 "adrfam": "ipv4", 00:21:55.990 "trsvcid": "$NVMF_PORT", 00:21:55.990 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:55.990 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:55.990 "hdgst": ${hdgst:-false}, 00:21:55.990 "ddgst": ${ddgst:-false} 00:21:55.990 }, 00:21:55.990 "method": "bdev_nvme_attach_controller" 00:21:55.990 } 00:21:55.990 EOF 00:21:55.990 )") 00:21:55.990 15:45:47 -- nvmf/common.sh@542 -- # cat 00:21:55.990 15:45:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:55.990 15:45:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:55.990 { 00:21:55.990 "params": { 00:21:55.990 "name": "Nvme$subsystem", 00:21:55.990 "trtype": "$TEST_TRANSPORT", 00:21:55.990 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:55.990 "adrfam": "ipv4", 00:21:55.990 "trsvcid": "$NVMF_PORT", 00:21:55.990 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:55.990 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:55.990 "hdgst": ${hdgst:-false}, 00:21:55.990 "ddgst": ${ddgst:-false} 00:21:55.990 }, 00:21:55.990 "method": "bdev_nvme_attach_controller" 00:21:55.990 } 00:21:55.990 EOF 00:21:55.990 )") 00:21:55.990 15:45:47 -- nvmf/common.sh@542 -- # cat 00:21:55.990 15:45:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:55.990 15:45:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:55.990 { 00:21:55.990 "params": { 00:21:55.990 "name": "Nvme$subsystem", 00:21:55.990 "trtype": "$TEST_TRANSPORT", 00:21:55.990 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:55.990 "adrfam": "ipv4", 00:21:55.990 "trsvcid": "$NVMF_PORT", 00:21:55.990 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:55.990 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:55.990 "hdgst": ${hdgst:-false}, 00:21:55.990 "ddgst": ${ddgst:-false} 00:21:55.990 }, 00:21:55.990 "method": "bdev_nvme_attach_controller" 00:21:55.990 } 00:21:55.990 EOF 00:21:55.990 )") 00:21:55.990 15:45:47 -- nvmf/common.sh@542 -- # cat 00:21:55.990 15:45:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:55.990 15:45:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:55.990 { 00:21:55.990 "params": { 00:21:55.990 "name": "Nvme$subsystem", 00:21:55.990 "trtype": "$TEST_TRANSPORT", 00:21:55.990 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:55.990 "adrfam": "ipv4", 00:21:55.990 "trsvcid": "$NVMF_PORT", 00:21:55.990 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:55.990 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:55.990 "hdgst": ${hdgst:-false}, 00:21:55.990 "ddgst": ${ddgst:-false} 00:21:55.990 }, 00:21:55.990 "method": "bdev_nvme_attach_controller" 00:21:55.990 } 00:21:55.990 EOF 00:21:55.990 )") 00:21:55.990 15:45:47 -- nvmf/common.sh@542 -- # cat 00:21:55.990 15:45:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:55.990 15:45:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:55.990 { 00:21:55.990 "params": { 00:21:55.990 "name": "Nvme$subsystem", 00:21:55.990 "trtype": "$TEST_TRANSPORT", 00:21:55.990 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:55.990 "adrfam": "ipv4", 00:21:55.990 "trsvcid": "$NVMF_PORT", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:55.991 "hdgst": ${hdgst:-false}, 00:21:55.991 "ddgst": ${ddgst:-false} 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 } 00:21:55.991 EOF 00:21:55.991 )") 00:21:55.991 15:45:47 -- nvmf/common.sh@542 -- # cat 00:21:55.991 15:45:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:55.991 15:45:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:55.991 { 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme$subsystem", 00:21:55.991 "trtype": "$TEST_TRANSPORT", 00:21:55.991 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "$NVMF_PORT", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:55.991 "hdgst": ${hdgst:-false}, 00:21:55.991 "ddgst": ${ddgst:-false} 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 } 00:21:55.991 EOF 00:21:55.991 )") 00:21:55.991 15:45:47 -- nvmf/common.sh@542 -- # cat 00:21:55.991 15:45:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:55.991 15:45:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:55.991 { 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme$subsystem", 00:21:55.991 "trtype": "$TEST_TRANSPORT", 00:21:55.991 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "$NVMF_PORT", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:55.991 "hdgst": ${hdgst:-false}, 00:21:55.991 "ddgst": ${ddgst:-false} 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 } 00:21:55.991 EOF 00:21:55.991 )") 00:21:55.991 15:45:47 -- nvmf/common.sh@542 -- # cat 00:21:55.991 15:45:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:55.991 15:45:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:55.991 { 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme$subsystem", 00:21:55.991 "trtype": "$TEST_TRANSPORT", 00:21:55.991 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "$NVMF_PORT", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:55.991 "hdgst": ${hdgst:-false}, 00:21:55.991 "ddgst": ${ddgst:-false} 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 } 00:21:55.991 EOF 00:21:55.991 )") 00:21:55.991 15:45:47 -- nvmf/common.sh@542 -- # cat 00:21:55.991 15:45:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:55.991 15:45:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:55.991 { 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme$subsystem", 00:21:55.991 "trtype": "$TEST_TRANSPORT", 00:21:55.991 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "$NVMF_PORT", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:55.991 "hdgst": ${hdgst:-false}, 00:21:55.991 "ddgst": ${ddgst:-false} 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 } 00:21:55.991 EOF 00:21:55.991 )") 00:21:55.991 15:45:47 -- nvmf/common.sh@542 -- # cat 00:21:55.991 15:45:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:55.991 15:45:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:55.991 { 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme$subsystem", 00:21:55.991 "trtype": "$TEST_TRANSPORT", 00:21:55.991 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "$NVMF_PORT", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:55.991 "hdgst": ${hdgst:-false}, 00:21:55.991 "ddgst": ${ddgst:-false} 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 } 00:21:55.991 EOF 00:21:55.991 )") 00:21:55.991 15:45:47 -- nvmf/common.sh@542 -- # cat 00:21:55.991 15:45:47 -- nvmf/common.sh@544 -- # jq . 00:21:55.991 15:45:47 -- nvmf/common.sh@545 -- # IFS=, 00:21:55.991 15:45:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme1", 00:21:55.991 "trtype": "tcp", 00:21:55.991 "traddr": "10.0.0.2", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "4420", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:55.991 "hdgst": false, 00:21:55.991 "ddgst": false 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 },{ 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme2", 00:21:55.991 "trtype": "tcp", 00:21:55.991 "traddr": "10.0.0.2", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "4420", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:55.991 "hdgst": false, 00:21:55.991 "ddgst": false 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 },{ 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme3", 00:21:55.991 "trtype": "tcp", 00:21:55.991 "traddr": "10.0.0.2", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "4420", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:55.991 "hdgst": false, 00:21:55.991 "ddgst": false 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 },{ 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme4", 00:21:55.991 "trtype": "tcp", 00:21:55.991 "traddr": "10.0.0.2", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "4420", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:55.991 "hdgst": false, 00:21:55.991 "ddgst": false 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 },{ 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme5", 00:21:55.991 "trtype": "tcp", 00:21:55.991 "traddr": "10.0.0.2", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "4420", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:55.991 "hdgst": false, 00:21:55.991 "ddgst": false 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 },{ 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme6", 00:21:55.991 "trtype": "tcp", 00:21:55.991 "traddr": "10.0.0.2", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "4420", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:55.991 "hdgst": false, 00:21:55.991 "ddgst": false 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 },{ 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme7", 00:21:55.991 "trtype": "tcp", 00:21:55.991 "traddr": "10.0.0.2", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "4420", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:55.991 "hdgst": false, 00:21:55.991 "ddgst": false 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 },{ 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme8", 00:21:55.991 "trtype": "tcp", 00:21:55.991 "traddr": "10.0.0.2", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "4420", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:55.991 "hdgst": false, 00:21:55.991 "ddgst": false 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 },{ 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme9", 00:21:55.991 "trtype": "tcp", 00:21:55.991 "traddr": "10.0.0.2", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "4420", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:55.991 "hdgst": false, 00:21:55.991 "ddgst": false 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 },{ 00:21:55.991 "params": { 00:21:55.991 "name": "Nvme10", 00:21:55.991 "trtype": "tcp", 00:21:55.991 "traddr": "10.0.0.2", 00:21:55.991 "adrfam": "ipv4", 00:21:55.991 "trsvcid": "4420", 00:21:55.991 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:55.991 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:55.991 "hdgst": false, 00:21:55.991 "ddgst": false 00:21:55.991 }, 00:21:55.991 "method": "bdev_nvme_attach_controller" 00:21:55.991 }' 00:21:55.991 [2024-11-26 15:45:47.247641] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:55.992 [2024-11-26 15:45:47.247751] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:21:55.992 EAL: No free 2048 kB hugepages reported on node 1 00:21:55.992 [2024-11-26 15:45:47.309955] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:55.992 [2024-11-26 15:45:47.418027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:57.892 15:45:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:57.892 15:45:48 -- common/autotest_common.sh@862 -- # return 0 00:21:57.892 15:45:48 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:21:57.892 15:45:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.892 15:45:48 -- common/autotest_common.sh@10 -- # set +x 00:21:57.892 15:45:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.892 15:45:48 -- target/shutdown.sh@83 -- # kill -9 929728 00:21:57.892 15:45:48 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:21:57.892 15:45:48 -- target/shutdown.sh@87 -- # sleep 1 00:21:58.828 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 929728 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:21:58.828 15:45:49 -- target/shutdown.sh@88 -- # kill -0 929541 00:21:58.828 15:45:49 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:21:58.828 15:45:49 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:58.828 15:45:49 -- nvmf/common.sh@520 -- # config=() 00:21:58.828 15:45:49 -- nvmf/common.sh@520 -- # local subsystem config 00:21:58.828 15:45:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.828 15:45:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.828 { 00:21:58.828 "params": { 00:21:58.828 "name": "Nvme$subsystem", 00:21:58.828 "trtype": "$TEST_TRANSPORT", 00:21:58.828 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.828 "adrfam": "ipv4", 00:21:58.828 "trsvcid": "$NVMF_PORT", 00:21:58.828 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.828 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.828 "hdgst": ${hdgst:-false}, 00:21:58.828 "ddgst": ${ddgst:-false} 00:21:58.828 }, 00:21:58.828 "method": "bdev_nvme_attach_controller" 00:21:58.828 } 00:21:58.828 EOF 00:21:58.828 )") 00:21:58.828 15:45:49 -- nvmf/common.sh@542 -- # cat 00:21:58.828 15:45:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.828 15:45:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.828 { 00:21:58.828 "params": { 00:21:58.828 "name": "Nvme$subsystem", 00:21:58.828 "trtype": "$TEST_TRANSPORT", 00:21:58.828 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.828 "adrfam": "ipv4", 00:21:58.828 "trsvcid": "$NVMF_PORT", 00:21:58.828 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.828 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.828 "hdgst": ${hdgst:-false}, 00:21:58.828 "ddgst": ${ddgst:-false} 00:21:58.828 }, 00:21:58.828 "method": "bdev_nvme_attach_controller" 00:21:58.828 } 00:21:58.828 EOF 00:21:58.828 )") 00:21:58.828 15:45:49 -- nvmf/common.sh@542 -- # cat 00:21:58.828 15:45:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.828 15:45:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.828 { 00:21:58.828 "params": { 00:21:58.828 "name": "Nvme$subsystem", 00:21:58.828 "trtype": "$TEST_TRANSPORT", 00:21:58.828 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.828 "adrfam": "ipv4", 00:21:58.828 "trsvcid": "$NVMF_PORT", 00:21:58.828 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.828 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.828 "hdgst": ${hdgst:-false}, 00:21:58.828 "ddgst": ${ddgst:-false} 00:21:58.828 }, 00:21:58.828 "method": "bdev_nvme_attach_controller" 00:21:58.828 } 00:21:58.828 EOF 00:21:58.828 )") 00:21:58.828 15:45:50 -- nvmf/common.sh@542 -- # cat 00:21:58.828 15:45:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.828 15:45:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.828 { 00:21:58.828 "params": { 00:21:58.828 "name": "Nvme$subsystem", 00:21:58.828 "trtype": "$TEST_TRANSPORT", 00:21:58.828 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.828 "adrfam": "ipv4", 00:21:58.828 "trsvcid": "$NVMF_PORT", 00:21:58.828 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.828 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.828 "hdgst": ${hdgst:-false}, 00:21:58.828 "ddgst": ${ddgst:-false} 00:21:58.828 }, 00:21:58.828 "method": "bdev_nvme_attach_controller" 00:21:58.828 } 00:21:58.828 EOF 00:21:58.829 )") 00:21:58.829 15:45:50 -- nvmf/common.sh@542 -- # cat 00:21:58.829 15:45:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.829 15:45:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.829 { 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme$subsystem", 00:21:58.829 "trtype": "$TEST_TRANSPORT", 00:21:58.829 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "$NVMF_PORT", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.829 "hdgst": ${hdgst:-false}, 00:21:58.829 "ddgst": ${ddgst:-false} 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 } 00:21:58.829 EOF 00:21:58.829 )") 00:21:58.829 15:45:50 -- nvmf/common.sh@542 -- # cat 00:21:58.829 15:45:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.829 15:45:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.829 { 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme$subsystem", 00:21:58.829 "trtype": "$TEST_TRANSPORT", 00:21:58.829 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "$NVMF_PORT", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.829 "hdgst": ${hdgst:-false}, 00:21:58.829 "ddgst": ${ddgst:-false} 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 } 00:21:58.829 EOF 00:21:58.829 )") 00:21:58.829 15:45:50 -- nvmf/common.sh@542 -- # cat 00:21:58.829 15:45:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.829 15:45:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.829 { 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme$subsystem", 00:21:58.829 "trtype": "$TEST_TRANSPORT", 00:21:58.829 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "$NVMF_PORT", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.829 "hdgst": ${hdgst:-false}, 00:21:58.829 "ddgst": ${ddgst:-false} 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 } 00:21:58.829 EOF 00:21:58.829 )") 00:21:58.829 15:45:50 -- nvmf/common.sh@542 -- # cat 00:21:58.829 15:45:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.829 15:45:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.829 { 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme$subsystem", 00:21:58.829 "trtype": "$TEST_TRANSPORT", 00:21:58.829 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "$NVMF_PORT", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.829 "hdgst": ${hdgst:-false}, 00:21:58.829 "ddgst": ${ddgst:-false} 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 } 00:21:58.829 EOF 00:21:58.829 )") 00:21:58.829 15:45:50 -- nvmf/common.sh@542 -- # cat 00:21:58.829 15:45:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.829 15:45:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.829 { 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme$subsystem", 00:21:58.829 "trtype": "$TEST_TRANSPORT", 00:21:58.829 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "$NVMF_PORT", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.829 "hdgst": ${hdgst:-false}, 00:21:58.829 "ddgst": ${ddgst:-false} 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 } 00:21:58.829 EOF 00:21:58.829 )") 00:21:58.829 15:45:50 -- nvmf/common.sh@542 -- # cat 00:21:58.829 15:45:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.829 15:45:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.829 { 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme$subsystem", 00:21:58.829 "trtype": "$TEST_TRANSPORT", 00:21:58.829 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "$NVMF_PORT", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.829 "hdgst": ${hdgst:-false}, 00:21:58.829 "ddgst": ${ddgst:-false} 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 } 00:21:58.829 EOF 00:21:58.829 )") 00:21:58.829 15:45:50 -- nvmf/common.sh@542 -- # cat 00:21:58.829 15:45:50 -- nvmf/common.sh@544 -- # jq . 00:21:58.829 15:45:50 -- nvmf/common.sh@545 -- # IFS=, 00:21:58.829 15:45:50 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme1", 00:21:58.829 "trtype": "tcp", 00:21:58.829 "traddr": "10.0.0.2", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "4420", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:58.829 "hdgst": false, 00:21:58.829 "ddgst": false 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 },{ 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme2", 00:21:58.829 "trtype": "tcp", 00:21:58.829 "traddr": "10.0.0.2", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "4420", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:58.829 "hdgst": false, 00:21:58.829 "ddgst": false 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 },{ 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme3", 00:21:58.829 "trtype": "tcp", 00:21:58.829 "traddr": "10.0.0.2", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "4420", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:58.829 "hdgst": false, 00:21:58.829 "ddgst": false 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 },{ 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme4", 00:21:58.829 "trtype": "tcp", 00:21:58.829 "traddr": "10.0.0.2", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "4420", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:58.829 "hdgst": false, 00:21:58.829 "ddgst": false 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 },{ 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme5", 00:21:58.829 "trtype": "tcp", 00:21:58.829 "traddr": "10.0.0.2", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "4420", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:58.829 "hdgst": false, 00:21:58.829 "ddgst": false 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 },{ 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme6", 00:21:58.829 "trtype": "tcp", 00:21:58.829 "traddr": "10.0.0.2", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "4420", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:58.829 "hdgst": false, 00:21:58.829 "ddgst": false 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 },{ 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme7", 00:21:58.829 "trtype": "tcp", 00:21:58.829 "traddr": "10.0.0.2", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "4420", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:58.829 "hdgst": false, 00:21:58.829 "ddgst": false 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 },{ 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme8", 00:21:58.829 "trtype": "tcp", 00:21:58.829 "traddr": "10.0.0.2", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "4420", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:58.829 "hdgst": false, 00:21:58.829 "ddgst": false 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 },{ 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme9", 00:21:58.829 "trtype": "tcp", 00:21:58.829 "traddr": "10.0.0.2", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "4420", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:58.829 "hdgst": false, 00:21:58.829 "ddgst": false 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.829 },{ 00:21:58.829 "params": { 00:21:58.829 "name": "Nvme10", 00:21:58.829 "trtype": "tcp", 00:21:58.829 "traddr": "10.0.0.2", 00:21:58.829 "adrfam": "ipv4", 00:21:58.829 "trsvcid": "4420", 00:21:58.829 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:58.829 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:58.829 "hdgst": false, 00:21:58.829 "ddgst": false 00:21:58.829 }, 00:21:58.829 "method": "bdev_nvme_attach_controller" 00:21:58.830 }' 00:21:58.830 [2024-11-26 15:45:50.033354] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:58.830 [2024-11-26 15:45:50.033428] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid930140 ] 00:21:58.830 EAL: No free 2048 kB hugepages reported on node 1 00:21:58.830 [2024-11-26 15:45:50.098980] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:58.830 [2024-11-26 15:45:50.210997] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:00.738 Running I/O for 1 seconds... 00:22:01.677 00:22:01.677 Latency(us) 00:22:01.677 [2024-11-26T14:45:53.130Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:01.677 [2024-11-26T14:45:53.130Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:01.677 Verification LBA range: start 0x0 length 0x400 00:22:01.677 Nvme1n1 : 1.11 394.87 24.68 0.00 0.00 158694.88 20000.62 140586.86 00:22:01.677 [2024-11-26T14:45:53.130Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:01.677 Verification LBA range: start 0x0 length 0x400 00:22:01.677 Nvme2n1 : 1.09 365.36 22.84 0.00 0.00 170763.42 25826.04 158451.48 00:22:01.677 [2024-11-26T14:45:53.130Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:01.677 Verification LBA range: start 0x0 length 0x400 00:22:01.677 Nvme3n1 : 1.11 390.27 24.39 0.00 0.00 158660.54 21262.79 131266.18 00:22:01.677 [2024-11-26T14:45:53.130Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:01.677 Verification LBA range: start 0x0 length 0x400 00:22:01.677 Nvme4n1 : 1.12 388.41 24.28 0.00 0.00 158278.89 21845.33 123498.95 00:22:01.677 [2024-11-26T14:45:53.130Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:01.677 Verification LBA range: start 0x0 length 0x400 00:22:01.677 Nvme5n1 : 1.12 387.39 24.21 0.00 0.00 157873.53 18932.62 121168.78 00:22:01.677 [2024-11-26T14:45:53.130Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:01.678 Verification LBA range: start 0x0 length 0x400 00:22:01.678 Nvme6n1 : 1.10 362.74 22.67 0.00 0.00 166941.59 8543.95 139033.41 00:22:01.678 [2024-11-26T14:45:53.131Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:01.678 Verification LBA range: start 0x0 length 0x400 00:22:01.678 Nvme7n1 : 1.12 386.59 24.16 0.00 0.00 155982.95 19515.16 122722.23 00:22:01.678 [2024-11-26T14:45:53.131Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:01.678 Verification LBA range: start 0x0 length 0x400 00:22:01.678 Nvme8n1 : 1.12 386.17 24.14 0.00 0.00 155130.17 19029.71 122722.23 00:22:01.678 [2024-11-26T14:45:53.131Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:01.678 Verification LBA range: start 0x0 length 0x400 00:22:01.678 Nvme9n1 : 1.13 385.41 24.09 0.00 0.00 154422.12 18155.90 124275.67 00:22:01.678 [2024-11-26T14:45:53.131Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:01.678 Verification LBA range: start 0x0 length 0x400 00:22:01.678 Nvme10n1 : 1.12 356.90 22.31 0.00 0.00 164514.51 34758.35 145247.19 00:22:01.678 [2024-11-26T14:45:53.131Z] =================================================================================================================== 00:22:01.678 [2024-11-26T14:45:53.131Z] Total : 3804.12 237.76 0.00 0.00 159939.29 8543.95 158451.48 00:22:01.936 15:45:53 -- target/shutdown.sh@93 -- # stoptarget 00:22:01.936 15:45:53 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:01.936 15:45:53 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:01.936 15:45:53 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:01.936 15:45:53 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:01.936 15:45:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:01.936 15:45:53 -- nvmf/common.sh@116 -- # sync 00:22:01.936 15:45:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:01.936 15:45:53 -- nvmf/common.sh@119 -- # set +e 00:22:01.936 15:45:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:01.936 15:45:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:01.936 rmmod nvme_tcp 00:22:01.936 rmmod nvme_fabrics 00:22:01.936 rmmod nvme_keyring 00:22:01.936 15:45:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:01.936 15:45:53 -- nvmf/common.sh@123 -- # set -e 00:22:01.936 15:45:53 -- nvmf/common.sh@124 -- # return 0 00:22:01.936 15:45:53 -- nvmf/common.sh@477 -- # '[' -n 929541 ']' 00:22:01.936 15:45:53 -- nvmf/common.sh@478 -- # killprocess 929541 00:22:01.936 15:45:53 -- common/autotest_common.sh@936 -- # '[' -z 929541 ']' 00:22:01.936 15:45:53 -- common/autotest_common.sh@940 -- # kill -0 929541 00:22:01.936 15:45:53 -- common/autotest_common.sh@941 -- # uname 00:22:01.936 15:45:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:01.936 15:45:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 929541 00:22:01.936 15:45:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:01.936 15:45:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:01.936 15:45:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 929541' 00:22:01.936 killing process with pid 929541 00:22:01.936 15:45:53 -- common/autotest_common.sh@955 -- # kill 929541 00:22:01.936 15:45:53 -- common/autotest_common.sh@960 -- # wait 929541 00:22:02.503 15:45:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:02.503 15:45:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:02.503 15:45:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:02.503 15:45:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:02.503 15:45:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:02.503 15:45:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:02.503 15:45:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:02.503 15:45:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:05.037 15:45:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:05.037 00:22:05.037 real 0m12.359s 00:22:05.037 user 0m36.558s 00:22:05.037 sys 0m3.248s 00:22:05.037 15:45:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:05.037 15:45:55 -- common/autotest_common.sh@10 -- # set +x 00:22:05.037 ************************************ 00:22:05.037 END TEST nvmf_shutdown_tc1 00:22:05.037 ************************************ 00:22:05.037 15:45:55 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:05.037 15:45:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:05.037 15:45:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:05.037 15:45:55 -- common/autotest_common.sh@10 -- # set +x 00:22:05.037 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:22:05.037 ************************************ 00:22:05.037 START TEST nvmf_shutdown_tc2 00:22:05.037 ************************************ 00:22:05.037 15:45:55 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:05.037 15:45:55 -- target/shutdown.sh@98 -- # starttarget 00:22:05.037 15:45:55 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:05.037 15:45:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:05.037 15:45:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:05.037 15:45:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:05.037 15:45:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:05.037 15:45:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:05.037 15:45:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:05.038 15:45:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:05.038 15:45:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:05.038 15:45:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:05.038 15:45:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:05.038 15:45:55 -- common/autotest_common.sh@10 -- # set +x 00:22:05.038 15:45:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:05.038 15:45:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:05.038 15:45:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:05.038 15:45:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:05.038 15:45:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:05.038 15:45:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:05.038 15:45:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:05.038 15:45:55 -- nvmf/common.sh@294 -- # net_devs=() 00:22:05.038 15:45:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:05.038 15:45:55 -- nvmf/common.sh@295 -- # e810=() 00:22:05.038 15:45:55 -- nvmf/common.sh@295 -- # local -ga e810 00:22:05.038 15:45:55 -- nvmf/common.sh@296 -- # x722=() 00:22:05.038 15:45:55 -- nvmf/common.sh@296 -- # local -ga x722 00:22:05.038 15:45:55 -- nvmf/common.sh@297 -- # mlx=() 00:22:05.038 15:45:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:05.038 15:45:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:05.038 15:45:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:05.038 15:45:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:05.038 15:45:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:05.038 15:45:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:05.038 15:45:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:05.038 15:45:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:05.038 15:45:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:05.038 15:45:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:05.038 15:45:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:05.038 15:45:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:05.038 15:45:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:05.038 15:45:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:05.038 15:45:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:05.038 15:45:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:05.038 15:45:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:05.038 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:05.038 15:45:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:05.038 15:45:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:05.038 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:05.038 15:45:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:05.038 15:45:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:05.038 15:45:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:05.038 15:45:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:05.038 15:45:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:05.038 15:45:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:05.038 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:05.038 15:45:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:05.038 15:45:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:05.038 15:45:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:05.038 15:45:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:05.038 15:45:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:05.038 15:45:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:05.038 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:05.038 15:45:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:05.038 15:45:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:05.038 15:45:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:05.038 15:45:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:05.038 15:45:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:05.038 15:45:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:05.038 15:45:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:05.038 15:45:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:05.038 15:45:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:05.038 15:45:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:05.038 15:45:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:05.038 15:45:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:05.038 15:45:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:05.038 15:45:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:05.038 15:45:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:05.038 15:45:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:05.038 15:45:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:05.038 15:45:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:05.038 15:45:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:05.038 15:45:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:05.038 15:45:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:05.038 15:45:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:05.038 15:45:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:05.038 15:45:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:05.038 15:45:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:05.038 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:05.038 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.224 ms 00:22:05.038 00:22:05.038 --- 10.0.0.2 ping statistics --- 00:22:05.038 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:05.038 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:22:05.038 15:45:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:05.038 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:05.038 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:22:05.038 00:22:05.038 --- 10.0.0.1 ping statistics --- 00:22:05.038 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:05.038 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:22:05.038 15:45:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:05.038 15:45:56 -- nvmf/common.sh@410 -- # return 0 00:22:05.038 15:45:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:05.038 15:45:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:05.038 15:45:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:05.038 15:45:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:05.038 15:45:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:05.038 15:45:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:05.038 15:45:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:05.038 15:45:56 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:05.038 15:45:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:05.038 15:45:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:05.038 15:45:56 -- common/autotest_common.sh@10 -- # set +x 00:22:05.038 15:45:56 -- nvmf/common.sh@469 -- # nvmfpid=930890 00:22:05.038 15:45:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:05.038 15:45:56 -- nvmf/common.sh@470 -- # waitforlisten 930890 00:22:05.038 15:45:56 -- common/autotest_common.sh@829 -- # '[' -z 930890 ']' 00:22:05.038 15:45:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:05.038 15:45:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:05.038 15:45:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:05.038 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:05.038 15:45:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:05.038 15:45:56 -- common/autotest_common.sh@10 -- # set +x 00:22:05.038 [2024-11-26 15:45:56.139872] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:05.038 [2024-11-26 15:45:56.139954] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:05.038 EAL: No free 2048 kB hugepages reported on node 1 00:22:05.038 [2024-11-26 15:45:56.205594] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:05.038 [2024-11-26 15:45:56.315124] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:05.038 [2024-11-26 15:45:56.315296] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:05.038 [2024-11-26 15:45:56.315320] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:05.038 [2024-11-26 15:45:56.315338] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:05.038 [2024-11-26 15:45:56.315454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:05.038 [2024-11-26 15:45:56.315496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:05.038 [2024-11-26 15:45:56.315560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:05.038 [2024-11-26 15:45:56.315567] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:05.974 15:45:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:05.974 15:45:57 -- common/autotest_common.sh@862 -- # return 0 00:22:05.974 15:45:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:05.974 15:45:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:05.974 15:45:57 -- common/autotest_common.sh@10 -- # set +x 00:22:05.974 15:45:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:05.974 15:45:57 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:05.974 15:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:05.974 15:45:57 -- common/autotest_common.sh@10 -- # set +x 00:22:05.974 [2024-11-26 15:45:57.142313] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:05.974 15:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:05.974 15:45:57 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:05.974 15:45:57 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:05.974 15:45:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:05.974 15:45:57 -- common/autotest_common.sh@10 -- # set +x 00:22:05.974 15:45:57 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:05.974 15:45:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:05.974 15:45:57 -- target/shutdown.sh@28 -- # cat 00:22:05.974 15:45:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:05.974 15:45:57 -- target/shutdown.sh@28 -- # cat 00:22:05.974 15:45:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:05.974 15:45:57 -- target/shutdown.sh@28 -- # cat 00:22:05.974 15:45:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:05.974 15:45:57 -- target/shutdown.sh@28 -- # cat 00:22:05.974 15:45:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:05.974 15:45:57 -- target/shutdown.sh@28 -- # cat 00:22:05.974 15:45:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:05.974 15:45:57 -- target/shutdown.sh@28 -- # cat 00:22:05.974 15:45:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:05.974 15:45:57 -- target/shutdown.sh@28 -- # cat 00:22:05.974 15:45:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:05.974 15:45:57 -- target/shutdown.sh@28 -- # cat 00:22:05.974 15:45:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:05.974 15:45:57 -- target/shutdown.sh@28 -- # cat 00:22:05.974 15:45:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:05.974 15:45:57 -- target/shutdown.sh@28 -- # cat 00:22:05.974 15:45:57 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:05.974 15:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:05.974 15:45:57 -- common/autotest_common.sh@10 -- # set +x 00:22:05.974 Malloc1 00:22:05.974 [2024-11-26 15:45:57.226573] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:05.974 Malloc2 00:22:05.974 Malloc3 00:22:05.974 Malloc4 00:22:05.974 Malloc5 00:22:06.234 Malloc6 00:22:06.234 Malloc7 00:22:06.234 Malloc8 00:22:06.234 Malloc9 00:22:06.234 Malloc10 00:22:06.234 15:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:06.234 15:45:57 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:06.234 15:45:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:06.234 15:45:57 -- common/autotest_common.sh@10 -- # set +x 00:22:06.493 15:45:57 -- target/shutdown.sh@102 -- # perfpid=931196 00:22:06.493 15:45:57 -- target/shutdown.sh@103 -- # waitforlisten 931196 /var/tmp/bdevperf.sock 00:22:06.493 15:45:57 -- common/autotest_common.sh@829 -- # '[' -z 931196 ']' 00:22:06.493 15:45:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:06.493 15:45:57 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:06.493 15:45:57 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:06.493 15:45:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:06.493 15:45:57 -- nvmf/common.sh@520 -- # config=() 00:22:06.493 15:45:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:06.493 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:06.493 15:45:57 -- nvmf/common.sh@520 -- # local subsystem config 00:22:06.493 15:45:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:06.493 15:45:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:06.493 15:45:57 -- common/autotest_common.sh@10 -- # set +x 00:22:06.493 15:45:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:06.493 { 00:22:06.493 "params": { 00:22:06.493 "name": "Nvme$subsystem", 00:22:06.493 "trtype": "$TEST_TRANSPORT", 00:22:06.493 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:06.493 "adrfam": "ipv4", 00:22:06.493 "trsvcid": "$NVMF_PORT", 00:22:06.493 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:06.493 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:06.493 "hdgst": ${hdgst:-false}, 00:22:06.493 "ddgst": ${ddgst:-false} 00:22:06.493 }, 00:22:06.493 "method": "bdev_nvme_attach_controller" 00:22:06.493 } 00:22:06.493 EOF 00:22:06.493 )") 00:22:06.493 15:45:57 -- nvmf/common.sh@542 -- # cat 00:22:06.493 15:45:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:06.493 15:45:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:06.493 { 00:22:06.493 "params": { 00:22:06.493 "name": "Nvme$subsystem", 00:22:06.493 "trtype": "$TEST_TRANSPORT", 00:22:06.493 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:06.493 "adrfam": "ipv4", 00:22:06.493 "trsvcid": "$NVMF_PORT", 00:22:06.493 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:06.493 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:06.493 "hdgst": ${hdgst:-false}, 00:22:06.493 "ddgst": ${ddgst:-false} 00:22:06.493 }, 00:22:06.493 "method": "bdev_nvme_attach_controller" 00:22:06.493 } 00:22:06.493 EOF 00:22:06.493 )") 00:22:06.493 15:45:57 -- nvmf/common.sh@542 -- # cat 00:22:06.493 15:45:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:06.493 15:45:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:06.493 { 00:22:06.493 "params": { 00:22:06.493 "name": "Nvme$subsystem", 00:22:06.493 "trtype": "$TEST_TRANSPORT", 00:22:06.493 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:06.493 "adrfam": "ipv4", 00:22:06.493 "trsvcid": "$NVMF_PORT", 00:22:06.493 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:06.493 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:06.493 "hdgst": ${hdgst:-false}, 00:22:06.493 "ddgst": ${ddgst:-false} 00:22:06.493 }, 00:22:06.493 "method": "bdev_nvme_attach_controller" 00:22:06.493 } 00:22:06.493 EOF 00:22:06.493 )") 00:22:06.493 15:45:57 -- nvmf/common.sh@542 -- # cat 00:22:06.493 15:45:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:06.493 15:45:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:06.493 { 00:22:06.493 "params": { 00:22:06.493 "name": "Nvme$subsystem", 00:22:06.493 "trtype": "$TEST_TRANSPORT", 00:22:06.493 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:06.493 "adrfam": "ipv4", 00:22:06.493 "trsvcid": "$NVMF_PORT", 00:22:06.493 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:06.493 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:06.493 "hdgst": ${hdgst:-false}, 00:22:06.493 "ddgst": ${ddgst:-false} 00:22:06.493 }, 00:22:06.493 "method": "bdev_nvme_attach_controller" 00:22:06.493 } 00:22:06.493 EOF 00:22:06.493 )") 00:22:06.493 15:45:57 -- nvmf/common.sh@542 -- # cat 00:22:06.493 15:45:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:06.493 15:45:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:06.493 { 00:22:06.493 "params": { 00:22:06.493 "name": "Nvme$subsystem", 00:22:06.493 "trtype": "$TEST_TRANSPORT", 00:22:06.493 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:06.493 "adrfam": "ipv4", 00:22:06.493 "trsvcid": "$NVMF_PORT", 00:22:06.493 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:06.493 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:06.493 "hdgst": ${hdgst:-false}, 00:22:06.493 "ddgst": ${ddgst:-false} 00:22:06.493 }, 00:22:06.493 "method": "bdev_nvme_attach_controller" 00:22:06.493 } 00:22:06.493 EOF 00:22:06.493 )") 00:22:06.493 15:45:57 -- nvmf/common.sh@542 -- # cat 00:22:06.493 15:45:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:06.493 15:45:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:06.493 { 00:22:06.493 "params": { 00:22:06.493 "name": "Nvme$subsystem", 00:22:06.493 "trtype": "$TEST_TRANSPORT", 00:22:06.493 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:06.493 "adrfam": "ipv4", 00:22:06.493 "trsvcid": "$NVMF_PORT", 00:22:06.493 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:06.493 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:06.493 "hdgst": ${hdgst:-false}, 00:22:06.493 "ddgst": ${ddgst:-false} 00:22:06.493 }, 00:22:06.493 "method": "bdev_nvme_attach_controller" 00:22:06.493 } 00:22:06.493 EOF 00:22:06.493 )") 00:22:06.493 15:45:57 -- nvmf/common.sh@542 -- # cat 00:22:06.493 15:45:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:06.493 15:45:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:06.493 { 00:22:06.493 "params": { 00:22:06.493 "name": "Nvme$subsystem", 00:22:06.493 "trtype": "$TEST_TRANSPORT", 00:22:06.493 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:06.493 "adrfam": "ipv4", 00:22:06.493 "trsvcid": "$NVMF_PORT", 00:22:06.493 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:06.493 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:06.493 "hdgst": ${hdgst:-false}, 00:22:06.494 "ddgst": ${ddgst:-false} 00:22:06.494 }, 00:22:06.494 "method": "bdev_nvme_attach_controller" 00:22:06.494 } 00:22:06.494 EOF 00:22:06.494 )") 00:22:06.494 15:45:57 -- nvmf/common.sh@542 -- # cat 00:22:06.494 15:45:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:06.494 15:45:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:06.494 { 00:22:06.494 "params": { 00:22:06.494 "name": "Nvme$subsystem", 00:22:06.494 "trtype": "$TEST_TRANSPORT", 00:22:06.494 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:06.494 "adrfam": "ipv4", 00:22:06.494 "trsvcid": "$NVMF_PORT", 00:22:06.494 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:06.494 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:06.494 "hdgst": ${hdgst:-false}, 00:22:06.494 "ddgst": ${ddgst:-false} 00:22:06.494 }, 00:22:06.494 "method": "bdev_nvme_attach_controller" 00:22:06.494 } 00:22:06.494 EOF 00:22:06.494 )") 00:22:06.494 15:45:57 -- nvmf/common.sh@542 -- # cat 00:22:06.494 15:45:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:06.494 15:45:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:06.494 { 00:22:06.494 "params": { 00:22:06.494 "name": "Nvme$subsystem", 00:22:06.494 "trtype": "$TEST_TRANSPORT", 00:22:06.494 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:06.494 "adrfam": "ipv4", 00:22:06.494 "trsvcid": "$NVMF_PORT", 00:22:06.494 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:06.494 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:06.494 "hdgst": ${hdgst:-false}, 00:22:06.494 "ddgst": ${ddgst:-false} 00:22:06.494 }, 00:22:06.494 "method": "bdev_nvme_attach_controller" 00:22:06.494 } 00:22:06.494 EOF 00:22:06.494 )") 00:22:06.494 15:45:57 -- nvmf/common.sh@542 -- # cat 00:22:06.494 15:45:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:06.494 15:45:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:06.494 { 00:22:06.494 "params": { 00:22:06.494 "name": "Nvme$subsystem", 00:22:06.494 "trtype": "$TEST_TRANSPORT", 00:22:06.494 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:06.494 "adrfam": "ipv4", 00:22:06.494 "trsvcid": "$NVMF_PORT", 00:22:06.494 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:06.494 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:06.494 "hdgst": ${hdgst:-false}, 00:22:06.494 "ddgst": ${ddgst:-false} 00:22:06.494 }, 00:22:06.494 "method": "bdev_nvme_attach_controller" 00:22:06.494 } 00:22:06.494 EOF 00:22:06.494 )") 00:22:06.494 15:45:57 -- nvmf/common.sh@542 -- # cat 00:22:06.494 15:45:57 -- nvmf/common.sh@544 -- # jq . 00:22:06.494 15:45:57 -- nvmf/common.sh@545 -- # IFS=, 00:22:06.494 15:45:57 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:06.494 "params": { 00:22:06.494 "name": "Nvme1", 00:22:06.494 "trtype": "tcp", 00:22:06.494 "traddr": "10.0.0.2", 00:22:06.494 "adrfam": "ipv4", 00:22:06.494 "trsvcid": "4420", 00:22:06.494 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:06.494 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:06.494 "hdgst": false, 00:22:06.494 "ddgst": false 00:22:06.494 }, 00:22:06.494 "method": "bdev_nvme_attach_controller" 00:22:06.494 },{ 00:22:06.494 "params": { 00:22:06.494 "name": "Nvme2", 00:22:06.494 "trtype": "tcp", 00:22:06.494 "traddr": "10.0.0.2", 00:22:06.494 "adrfam": "ipv4", 00:22:06.494 "trsvcid": "4420", 00:22:06.494 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:06.494 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:06.494 "hdgst": false, 00:22:06.494 "ddgst": false 00:22:06.494 }, 00:22:06.494 "method": "bdev_nvme_attach_controller" 00:22:06.494 },{ 00:22:06.494 "params": { 00:22:06.494 "name": "Nvme3", 00:22:06.494 "trtype": "tcp", 00:22:06.494 "traddr": "10.0.0.2", 00:22:06.494 "adrfam": "ipv4", 00:22:06.494 "trsvcid": "4420", 00:22:06.494 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:06.494 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:06.494 "hdgst": false, 00:22:06.494 "ddgst": false 00:22:06.494 }, 00:22:06.494 "method": "bdev_nvme_attach_controller" 00:22:06.494 },{ 00:22:06.494 "params": { 00:22:06.494 "name": "Nvme4", 00:22:06.494 "trtype": "tcp", 00:22:06.494 "traddr": "10.0.0.2", 00:22:06.494 "adrfam": "ipv4", 00:22:06.494 "trsvcid": "4420", 00:22:06.494 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:06.494 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:06.494 "hdgst": false, 00:22:06.494 "ddgst": false 00:22:06.494 }, 00:22:06.494 "method": "bdev_nvme_attach_controller" 00:22:06.494 },{ 00:22:06.494 "params": { 00:22:06.494 "name": "Nvme5", 00:22:06.494 "trtype": "tcp", 00:22:06.494 "traddr": "10.0.0.2", 00:22:06.494 "adrfam": "ipv4", 00:22:06.494 "trsvcid": "4420", 00:22:06.494 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:06.494 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:06.494 "hdgst": false, 00:22:06.494 "ddgst": false 00:22:06.494 }, 00:22:06.494 "method": "bdev_nvme_attach_controller" 00:22:06.494 },{ 00:22:06.494 "params": { 00:22:06.494 "name": "Nvme6", 00:22:06.494 "trtype": "tcp", 00:22:06.494 "traddr": "10.0.0.2", 00:22:06.494 "adrfam": "ipv4", 00:22:06.494 "trsvcid": "4420", 00:22:06.494 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:06.494 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:06.494 "hdgst": false, 00:22:06.494 "ddgst": false 00:22:06.494 }, 00:22:06.494 "method": "bdev_nvme_attach_controller" 00:22:06.494 },{ 00:22:06.494 "params": { 00:22:06.494 "name": "Nvme7", 00:22:06.494 "trtype": "tcp", 00:22:06.494 "traddr": "10.0.0.2", 00:22:06.494 "adrfam": "ipv4", 00:22:06.494 "trsvcid": "4420", 00:22:06.494 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:06.494 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:06.494 "hdgst": false, 00:22:06.494 "ddgst": false 00:22:06.494 }, 00:22:06.494 "method": "bdev_nvme_attach_controller" 00:22:06.494 },{ 00:22:06.494 "params": { 00:22:06.494 "name": "Nvme8", 00:22:06.494 "trtype": "tcp", 00:22:06.494 "traddr": "10.0.0.2", 00:22:06.494 "adrfam": "ipv4", 00:22:06.494 "trsvcid": "4420", 00:22:06.494 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:06.494 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:06.494 "hdgst": false, 00:22:06.494 "ddgst": false 00:22:06.494 }, 00:22:06.494 "method": "bdev_nvme_attach_controller" 00:22:06.494 },{ 00:22:06.494 "params": { 00:22:06.494 "name": "Nvme9", 00:22:06.494 "trtype": "tcp", 00:22:06.494 "traddr": "10.0.0.2", 00:22:06.494 "adrfam": "ipv4", 00:22:06.494 "trsvcid": "4420", 00:22:06.494 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:06.494 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:06.494 "hdgst": false, 00:22:06.494 "ddgst": false 00:22:06.494 }, 00:22:06.494 "method": "bdev_nvme_attach_controller" 00:22:06.494 },{ 00:22:06.495 "params": { 00:22:06.495 "name": "Nvme10", 00:22:06.495 "trtype": "tcp", 00:22:06.495 "traddr": "10.0.0.2", 00:22:06.495 "adrfam": "ipv4", 00:22:06.495 "trsvcid": "4420", 00:22:06.495 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:06.495 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:06.495 "hdgst": false, 00:22:06.495 "ddgst": false 00:22:06.495 }, 00:22:06.495 "method": "bdev_nvme_attach_controller" 00:22:06.495 }' 00:22:06.495 [2024-11-26 15:45:57.740331] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:06.495 [2024-11-26 15:45:57.740402] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid931196 ] 00:22:06.495 EAL: No free 2048 kB hugepages reported on node 1 00:22:06.495 [2024-11-26 15:45:57.802445] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:06.495 [2024-11-26 15:45:57.910213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:08.397 Running I/O for 10 seconds... 00:22:08.397 15:45:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:08.397 15:45:59 -- common/autotest_common.sh@862 -- # return 0 00:22:08.397 15:45:59 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:08.397 15:45:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:08.397 15:45:59 -- common/autotest_common.sh@10 -- # set +x 00:22:08.397 15:45:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:08.397 15:45:59 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:08.397 15:45:59 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:08.397 15:45:59 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:08.397 15:45:59 -- target/shutdown.sh@57 -- # local ret=1 00:22:08.397 15:45:59 -- target/shutdown.sh@58 -- # local i 00:22:08.397 15:45:59 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:08.397 15:45:59 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:08.397 15:45:59 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:08.397 15:45:59 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:08.397 15:45:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:08.397 15:45:59 -- common/autotest_common.sh@10 -- # set +x 00:22:08.397 15:45:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:08.397 15:45:59 -- target/shutdown.sh@60 -- # read_io_count=42 00:22:08.397 15:45:59 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:22:08.397 15:45:59 -- target/shutdown.sh@67 -- # sleep 0.25 00:22:08.656 15:45:59 -- target/shutdown.sh@59 -- # (( i-- )) 00:22:08.656 15:45:59 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:08.656 15:45:59 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:08.656 15:45:59 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:08.656 15:45:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:08.656 15:45:59 -- common/autotest_common.sh@10 -- # set +x 00:22:08.656 15:45:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:08.656 15:45:59 -- target/shutdown.sh@60 -- # read_io_count=167 00:22:08.656 15:45:59 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:22:08.656 15:45:59 -- target/shutdown.sh@64 -- # ret=0 00:22:08.656 15:45:59 -- target/shutdown.sh@65 -- # break 00:22:08.656 15:45:59 -- target/shutdown.sh@69 -- # return 0 00:22:08.656 15:45:59 -- target/shutdown.sh@109 -- # killprocess 931196 00:22:08.656 15:45:59 -- common/autotest_common.sh@936 -- # '[' -z 931196 ']' 00:22:08.656 15:45:59 -- common/autotest_common.sh@940 -- # kill -0 931196 00:22:08.656 15:45:59 -- common/autotest_common.sh@941 -- # uname 00:22:08.656 15:45:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:08.656 15:45:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 931196 00:22:08.656 15:45:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:08.656 15:45:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:08.656 15:45:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 931196' 00:22:08.656 killing process with pid 931196 00:22:08.656 15:45:59 -- common/autotest_common.sh@955 -- # kill 931196 00:22:08.656 15:45:59 -- common/autotest_common.sh@960 -- # wait 931196 00:22:08.656 Received shutdown signal, test time was about 0.579919 seconds 00:22:08.656 00:22:08.656 Latency(us) 00:22:08.656 [2024-11-26T14:46:00.109Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:08.656 [2024-11-26T14:46:00.109Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.656 Verification LBA range: start 0x0 length 0x400 00:22:08.656 Nvme1n1 : 0.56 408.97 25.56 0.00 0.00 149999.51 26991.12 119615.34 00:22:08.656 [2024-11-26T14:46:00.109Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.656 Verification LBA range: start 0x0 length 0x400 00:22:08.656 Nvme2n1 : 0.57 397.64 24.85 0.00 0.00 151995.83 27767.85 128159.29 00:22:08.656 [2024-11-26T14:46:00.109Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.656 Verification LBA range: start 0x0 length 0x400 00:22:08.656 Nvme3n1 : 0.56 410.24 25.64 0.00 0.00 145207.17 26408.58 116508.44 00:22:08.656 [2024-11-26T14:46:00.109Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.656 Verification LBA range: start 0x0 length 0x400 00:22:08.656 Nvme4n1 : 0.56 406.74 25.42 0.00 0.00 144693.61 26214.40 115731.72 00:22:08.656 [2024-11-26T14:46:00.109Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.656 Verification LBA range: start 0x0 length 0x400 00:22:08.656 Nvme5n1 : 0.57 403.39 25.21 0.00 0.00 143985.02 25826.04 116508.44 00:22:08.656 [2024-11-26T14:46:00.109Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.656 Verification LBA range: start 0x0 length 0x400 00:22:08.656 Nvme6n1 : 0.57 400.60 25.04 0.00 0.00 142787.57 26991.12 121168.78 00:22:08.656 [2024-11-26T14:46:00.109Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.656 Verification LBA range: start 0x0 length 0x400 00:22:08.656 Nvme7n1 : 0.56 404.51 25.28 0.00 0.00 139333.20 26408.58 120392.06 00:22:08.656 [2024-11-26T14:46:00.109Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.656 Verification LBA range: start 0x0 length 0x400 00:22:08.656 Nvme8n1 : 0.57 398.63 24.91 0.00 0.00 139680.89 24758.04 117285.17 00:22:08.656 [2024-11-26T14:46:00.109Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.656 Verification LBA range: start 0x0 length 0x400 00:22:08.656 Nvme9n1 : 0.58 395.78 24.74 0.00 0.00 139503.53 22136.60 121168.78 00:22:08.656 [2024-11-26T14:46:00.109Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.656 Verification LBA range: start 0x0 length 0x400 00:22:08.656 Nvme10n1 : 0.58 393.71 24.61 0.00 0.00 140451.01 11311.03 124275.67 00:22:08.656 [2024-11-26T14:46:00.109Z] =================================================================================================================== 00:22:08.656 [2024-11-26T14:46:00.109Z] Total : 4020.20 251.26 0.00 0.00 143763.73 11311.03 128159.29 00:22:08.914 15:46:00 -- target/shutdown.sh@112 -- # sleep 1 00:22:10.290 15:46:01 -- target/shutdown.sh@113 -- # kill -0 930890 00:22:10.290 15:46:01 -- target/shutdown.sh@115 -- # stoptarget 00:22:10.291 15:46:01 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:10.291 15:46:01 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:10.291 15:46:01 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:10.291 15:46:01 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:10.291 15:46:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:10.291 15:46:01 -- nvmf/common.sh@116 -- # sync 00:22:10.291 15:46:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:10.291 15:46:01 -- nvmf/common.sh@119 -- # set +e 00:22:10.291 15:46:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:10.291 15:46:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:10.291 rmmod nvme_tcp 00:22:10.291 rmmod nvme_fabrics 00:22:10.291 rmmod nvme_keyring 00:22:10.291 15:46:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:10.291 15:46:01 -- nvmf/common.sh@123 -- # set -e 00:22:10.291 15:46:01 -- nvmf/common.sh@124 -- # return 0 00:22:10.291 15:46:01 -- nvmf/common.sh@477 -- # '[' -n 930890 ']' 00:22:10.291 15:46:01 -- nvmf/common.sh@478 -- # killprocess 930890 00:22:10.291 15:46:01 -- common/autotest_common.sh@936 -- # '[' -z 930890 ']' 00:22:10.291 15:46:01 -- common/autotest_common.sh@940 -- # kill -0 930890 00:22:10.291 15:46:01 -- common/autotest_common.sh@941 -- # uname 00:22:10.291 15:46:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:10.291 15:46:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 930890 00:22:10.291 15:46:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:10.291 15:46:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:10.291 15:46:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 930890' 00:22:10.291 killing process with pid 930890 00:22:10.291 15:46:01 -- common/autotest_common.sh@955 -- # kill 930890 00:22:10.291 15:46:01 -- common/autotest_common.sh@960 -- # wait 930890 00:22:10.549 15:46:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:10.549 15:46:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:10.549 15:46:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:10.549 15:46:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:10.549 15:46:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:10.549 15:46:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:10.549 15:46:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:10.549 15:46:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:13.085 15:46:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:13.085 00:22:13.085 real 0m8.057s 00:22:13.085 user 0m24.886s 00:22:13.085 sys 0m1.446s 00:22:13.085 15:46:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:13.085 15:46:03 -- common/autotest_common.sh@10 -- # set +x 00:22:13.085 ************************************ 00:22:13.085 END TEST nvmf_shutdown_tc2 00:22:13.085 ************************************ 00:22:13.085 15:46:04 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:13.085 15:46:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:13.085 15:46:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:13.085 15:46:04 -- common/autotest_common.sh@10 -- # set +x 00:22:13.085 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:22:13.085 ************************************ 00:22:13.085 START TEST nvmf_shutdown_tc3 00:22:13.085 ************************************ 00:22:13.085 15:46:04 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:13.085 15:46:04 -- target/shutdown.sh@120 -- # starttarget 00:22:13.085 15:46:04 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:13.085 15:46:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:13.085 15:46:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:13.085 15:46:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:13.085 15:46:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:13.085 15:46:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:13.085 15:46:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:13.085 15:46:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:13.085 15:46:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:13.085 15:46:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:13.085 15:46:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:13.085 15:46:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:13.085 15:46:04 -- common/autotest_common.sh@10 -- # set +x 00:22:13.085 15:46:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:13.085 15:46:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:13.085 15:46:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:13.085 15:46:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:13.085 15:46:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:13.085 15:46:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:13.085 15:46:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:13.085 15:46:04 -- nvmf/common.sh@294 -- # net_devs=() 00:22:13.085 15:46:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:13.085 15:46:04 -- nvmf/common.sh@295 -- # e810=() 00:22:13.085 15:46:04 -- nvmf/common.sh@295 -- # local -ga e810 00:22:13.085 15:46:04 -- nvmf/common.sh@296 -- # x722=() 00:22:13.085 15:46:04 -- nvmf/common.sh@296 -- # local -ga x722 00:22:13.085 15:46:04 -- nvmf/common.sh@297 -- # mlx=() 00:22:13.085 15:46:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:13.085 15:46:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:13.086 15:46:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:13.086 15:46:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:13.086 15:46:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:13.086 15:46:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:13.086 15:46:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:13.086 15:46:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:13.086 15:46:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:13.086 15:46:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:13.086 15:46:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:13.086 15:46:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:13.086 15:46:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:13.086 15:46:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:13.086 15:46:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:13.086 15:46:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:13.086 15:46:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:13.086 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:13.086 15:46:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:13.086 15:46:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:13.086 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:13.086 15:46:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:13.086 15:46:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:13.086 15:46:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:13.086 15:46:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:13.086 15:46:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:13.086 15:46:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:13.086 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:13.086 15:46:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:13.086 15:46:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:13.086 15:46:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:13.086 15:46:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:13.086 15:46:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:13.086 15:46:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:13.086 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:13.086 15:46:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:13.086 15:46:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:13.086 15:46:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:13.086 15:46:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:13.086 15:46:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:13.086 15:46:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:13.086 15:46:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:13.086 15:46:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:13.086 15:46:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:13.086 15:46:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:13.086 15:46:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:13.086 15:46:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:13.086 15:46:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:13.086 15:46:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:13.086 15:46:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:13.086 15:46:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:13.086 15:46:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:13.086 15:46:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:13.086 15:46:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:13.086 15:46:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:13.086 15:46:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:13.086 15:46:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:13.086 15:46:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:13.086 15:46:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:13.086 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:13.086 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.178 ms 00:22:13.086 00:22:13.086 --- 10.0.0.2 ping statistics --- 00:22:13.086 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:13.086 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:22:13.086 15:46:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:13.086 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:13.086 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:22:13.086 00:22:13.086 --- 10.0.0.1 ping statistics --- 00:22:13.086 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:13.086 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:22:13.086 15:46:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:13.086 15:46:04 -- nvmf/common.sh@410 -- # return 0 00:22:13.086 15:46:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:13.086 15:46:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:13.086 15:46:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:13.086 15:46:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:13.086 15:46:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:13.086 15:46:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:13.086 15:46:04 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:13.086 15:46:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:13.086 15:46:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:13.086 15:46:04 -- common/autotest_common.sh@10 -- # set +x 00:22:13.086 15:46:04 -- nvmf/common.sh@469 -- # nvmfpid=931968 00:22:13.086 15:46:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:13.086 15:46:04 -- nvmf/common.sh@470 -- # waitforlisten 931968 00:22:13.086 15:46:04 -- common/autotest_common.sh@829 -- # '[' -z 931968 ']' 00:22:13.086 15:46:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:13.086 15:46:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:13.086 15:46:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:13.086 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:13.086 15:46:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:13.086 15:46:04 -- common/autotest_common.sh@10 -- # set +x 00:22:13.086 [2024-11-26 15:46:04.243160] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:13.086 [2024-11-26 15:46:04.243236] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:13.086 EAL: No free 2048 kB hugepages reported on node 1 00:22:13.087 [2024-11-26 15:46:04.310869] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:13.087 [2024-11-26 15:46:04.428431] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:13.087 [2024-11-26 15:46:04.428595] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:13.087 [2024-11-26 15:46:04.428615] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:13.087 [2024-11-26 15:46:04.428629] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:13.087 [2024-11-26 15:46:04.428743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:13.087 [2024-11-26 15:46:04.428814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:13.087 [2024-11-26 15:46:04.428881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:13.087 [2024-11-26 15:46:04.428884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:14.022 15:46:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:14.022 15:46:05 -- common/autotest_common.sh@862 -- # return 0 00:22:14.022 15:46:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:14.022 15:46:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:14.022 15:46:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.022 15:46:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:14.022 15:46:05 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:14.022 15:46:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.022 15:46:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.022 [2024-11-26 15:46:05.224239] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:14.022 15:46:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.022 15:46:05 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:14.022 15:46:05 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:14.022 15:46:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:14.022 15:46:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.022 15:46:05 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:14.022 15:46:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:14.022 15:46:05 -- target/shutdown.sh@28 -- # cat 00:22:14.022 15:46:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:14.022 15:46:05 -- target/shutdown.sh@28 -- # cat 00:22:14.022 15:46:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:14.022 15:46:05 -- target/shutdown.sh@28 -- # cat 00:22:14.022 15:46:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:14.022 15:46:05 -- target/shutdown.sh@28 -- # cat 00:22:14.022 15:46:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:14.022 15:46:05 -- target/shutdown.sh@28 -- # cat 00:22:14.022 15:46:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:14.022 15:46:05 -- target/shutdown.sh@28 -- # cat 00:22:14.022 15:46:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:14.022 15:46:05 -- target/shutdown.sh@28 -- # cat 00:22:14.022 15:46:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:14.022 15:46:05 -- target/shutdown.sh@28 -- # cat 00:22:14.022 15:46:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:14.022 15:46:05 -- target/shutdown.sh@28 -- # cat 00:22:14.022 15:46:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:14.022 15:46:05 -- target/shutdown.sh@28 -- # cat 00:22:14.022 15:46:05 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:14.022 15:46:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.022 15:46:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.022 Malloc1 00:22:14.022 [2024-11-26 15:46:05.299564] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:14.022 Malloc2 00:22:14.022 Malloc3 00:22:14.022 Malloc4 00:22:14.022 Malloc5 00:22:14.280 Malloc6 00:22:14.280 Malloc7 00:22:14.280 Malloc8 00:22:14.280 Malloc9 00:22:14.280 Malloc10 00:22:14.540 15:46:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.540 15:46:05 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:14.540 15:46:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:14.540 15:46:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.540 15:46:05 -- target/shutdown.sh@124 -- # perfpid=932271 00:22:14.540 15:46:05 -- target/shutdown.sh@125 -- # waitforlisten 932271 /var/tmp/bdevperf.sock 00:22:14.540 15:46:05 -- common/autotest_common.sh@829 -- # '[' -z 932271 ']' 00:22:14.540 15:46:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:14.540 15:46:05 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:14.540 15:46:05 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:14.540 15:46:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:14.540 15:46:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:14.540 15:46:05 -- nvmf/common.sh@520 -- # config=() 00:22:14.540 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:14.540 15:46:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:14.540 15:46:05 -- nvmf/common.sh@520 -- # local subsystem config 00:22:14.540 15:46:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.540 15:46:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:14.540 15:46:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:14.540 { 00:22:14.540 "params": { 00:22:14.540 "name": "Nvme$subsystem", 00:22:14.540 "trtype": "$TEST_TRANSPORT", 00:22:14.540 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:14.540 "adrfam": "ipv4", 00:22:14.540 "trsvcid": "$NVMF_PORT", 00:22:14.540 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:14.540 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:14.540 "hdgst": ${hdgst:-false}, 00:22:14.540 "ddgst": ${ddgst:-false} 00:22:14.540 }, 00:22:14.540 "method": "bdev_nvme_attach_controller" 00:22:14.540 } 00:22:14.540 EOF 00:22:14.540 )") 00:22:14.540 15:46:05 -- nvmf/common.sh@542 -- # cat 00:22:14.540 15:46:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:14.540 15:46:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:14.540 { 00:22:14.540 "params": { 00:22:14.540 "name": "Nvme$subsystem", 00:22:14.540 "trtype": "$TEST_TRANSPORT", 00:22:14.540 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:14.540 "adrfam": "ipv4", 00:22:14.540 "trsvcid": "$NVMF_PORT", 00:22:14.540 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:14.540 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:14.540 "hdgst": ${hdgst:-false}, 00:22:14.540 "ddgst": ${ddgst:-false} 00:22:14.540 }, 00:22:14.540 "method": "bdev_nvme_attach_controller" 00:22:14.540 } 00:22:14.540 EOF 00:22:14.540 )") 00:22:14.540 15:46:05 -- nvmf/common.sh@542 -- # cat 00:22:14.540 15:46:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:14.540 15:46:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:14.540 { 00:22:14.540 "params": { 00:22:14.540 "name": "Nvme$subsystem", 00:22:14.540 "trtype": "$TEST_TRANSPORT", 00:22:14.540 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:14.540 "adrfam": "ipv4", 00:22:14.540 "trsvcid": "$NVMF_PORT", 00:22:14.540 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:14.540 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:14.540 "hdgst": ${hdgst:-false}, 00:22:14.540 "ddgst": ${ddgst:-false} 00:22:14.540 }, 00:22:14.540 "method": "bdev_nvme_attach_controller" 00:22:14.540 } 00:22:14.540 EOF 00:22:14.540 )") 00:22:14.540 15:46:05 -- nvmf/common.sh@542 -- # cat 00:22:14.540 15:46:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:14.540 15:46:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:14.540 { 00:22:14.540 "params": { 00:22:14.540 "name": "Nvme$subsystem", 00:22:14.540 "trtype": "$TEST_TRANSPORT", 00:22:14.540 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:14.540 "adrfam": "ipv4", 00:22:14.540 "trsvcid": "$NVMF_PORT", 00:22:14.540 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:14.540 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:14.540 "hdgst": ${hdgst:-false}, 00:22:14.540 "ddgst": ${ddgst:-false} 00:22:14.540 }, 00:22:14.540 "method": "bdev_nvme_attach_controller" 00:22:14.540 } 00:22:14.540 EOF 00:22:14.540 )") 00:22:14.540 15:46:05 -- nvmf/common.sh@542 -- # cat 00:22:14.540 15:46:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:14.540 15:46:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:14.540 { 00:22:14.540 "params": { 00:22:14.540 "name": "Nvme$subsystem", 00:22:14.540 "trtype": "$TEST_TRANSPORT", 00:22:14.540 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:14.540 "adrfam": "ipv4", 00:22:14.540 "trsvcid": "$NVMF_PORT", 00:22:14.540 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:14.540 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:14.540 "hdgst": ${hdgst:-false}, 00:22:14.540 "ddgst": ${ddgst:-false} 00:22:14.540 }, 00:22:14.540 "method": "bdev_nvme_attach_controller" 00:22:14.540 } 00:22:14.540 EOF 00:22:14.540 )") 00:22:14.540 15:46:05 -- nvmf/common.sh@542 -- # cat 00:22:14.540 15:46:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:14.540 15:46:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:14.541 { 00:22:14.541 "params": { 00:22:14.541 "name": "Nvme$subsystem", 00:22:14.541 "trtype": "$TEST_TRANSPORT", 00:22:14.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:14.541 "adrfam": "ipv4", 00:22:14.541 "trsvcid": "$NVMF_PORT", 00:22:14.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:14.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:14.541 "hdgst": ${hdgst:-false}, 00:22:14.541 "ddgst": ${ddgst:-false} 00:22:14.541 }, 00:22:14.541 "method": "bdev_nvme_attach_controller" 00:22:14.541 } 00:22:14.541 EOF 00:22:14.541 )") 00:22:14.541 15:46:05 -- nvmf/common.sh@542 -- # cat 00:22:14.541 15:46:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:14.541 15:46:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:14.541 { 00:22:14.541 "params": { 00:22:14.541 "name": "Nvme$subsystem", 00:22:14.541 "trtype": "$TEST_TRANSPORT", 00:22:14.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:14.541 "adrfam": "ipv4", 00:22:14.541 "trsvcid": "$NVMF_PORT", 00:22:14.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:14.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:14.541 "hdgst": ${hdgst:-false}, 00:22:14.541 "ddgst": ${ddgst:-false} 00:22:14.541 }, 00:22:14.541 "method": "bdev_nvme_attach_controller" 00:22:14.541 } 00:22:14.541 EOF 00:22:14.541 )") 00:22:14.541 15:46:05 -- nvmf/common.sh@542 -- # cat 00:22:14.541 15:46:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:14.541 15:46:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:14.541 { 00:22:14.541 "params": { 00:22:14.541 "name": "Nvme$subsystem", 00:22:14.541 "trtype": "$TEST_TRANSPORT", 00:22:14.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:14.541 "adrfam": "ipv4", 00:22:14.541 "trsvcid": "$NVMF_PORT", 00:22:14.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:14.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:14.541 "hdgst": ${hdgst:-false}, 00:22:14.541 "ddgst": ${ddgst:-false} 00:22:14.541 }, 00:22:14.541 "method": "bdev_nvme_attach_controller" 00:22:14.541 } 00:22:14.541 EOF 00:22:14.541 )") 00:22:14.541 15:46:05 -- nvmf/common.sh@542 -- # cat 00:22:14.541 15:46:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:14.541 15:46:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:14.541 { 00:22:14.541 "params": { 00:22:14.541 "name": "Nvme$subsystem", 00:22:14.541 "trtype": "$TEST_TRANSPORT", 00:22:14.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:14.541 "adrfam": "ipv4", 00:22:14.541 "trsvcid": "$NVMF_PORT", 00:22:14.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:14.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:14.541 "hdgst": ${hdgst:-false}, 00:22:14.541 "ddgst": ${ddgst:-false} 00:22:14.541 }, 00:22:14.541 "method": "bdev_nvme_attach_controller" 00:22:14.541 } 00:22:14.541 EOF 00:22:14.541 )") 00:22:14.541 15:46:05 -- nvmf/common.sh@542 -- # cat 00:22:14.541 15:46:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:14.541 15:46:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:14.541 { 00:22:14.541 "params": { 00:22:14.541 "name": "Nvme$subsystem", 00:22:14.541 "trtype": "$TEST_TRANSPORT", 00:22:14.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:14.541 "adrfam": "ipv4", 00:22:14.541 "trsvcid": "$NVMF_PORT", 00:22:14.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:14.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:14.541 "hdgst": ${hdgst:-false}, 00:22:14.541 "ddgst": ${ddgst:-false} 00:22:14.541 }, 00:22:14.541 "method": "bdev_nvme_attach_controller" 00:22:14.541 } 00:22:14.541 EOF 00:22:14.541 )") 00:22:14.541 15:46:05 -- nvmf/common.sh@542 -- # cat 00:22:14.541 15:46:05 -- nvmf/common.sh@544 -- # jq . 00:22:14.541 15:46:05 -- nvmf/common.sh@545 -- # IFS=, 00:22:14.541 15:46:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:14.541 "params": { 00:22:14.541 "name": "Nvme1", 00:22:14.541 "trtype": "tcp", 00:22:14.541 "traddr": "10.0.0.2", 00:22:14.541 "adrfam": "ipv4", 00:22:14.541 "trsvcid": "4420", 00:22:14.541 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:14.541 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:14.541 "hdgst": false, 00:22:14.541 "ddgst": false 00:22:14.541 }, 00:22:14.541 "method": "bdev_nvme_attach_controller" 00:22:14.541 },{ 00:22:14.541 "params": { 00:22:14.541 "name": "Nvme2", 00:22:14.541 "trtype": "tcp", 00:22:14.541 "traddr": "10.0.0.2", 00:22:14.541 "adrfam": "ipv4", 00:22:14.541 "trsvcid": "4420", 00:22:14.541 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:14.541 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:14.541 "hdgst": false, 00:22:14.541 "ddgst": false 00:22:14.541 }, 00:22:14.541 "method": "bdev_nvme_attach_controller" 00:22:14.541 },{ 00:22:14.541 "params": { 00:22:14.541 "name": "Nvme3", 00:22:14.541 "trtype": "tcp", 00:22:14.541 "traddr": "10.0.0.2", 00:22:14.541 "adrfam": "ipv4", 00:22:14.541 "trsvcid": "4420", 00:22:14.541 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:14.541 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:14.541 "hdgst": false, 00:22:14.541 "ddgst": false 00:22:14.541 }, 00:22:14.541 "method": "bdev_nvme_attach_controller" 00:22:14.541 },{ 00:22:14.541 "params": { 00:22:14.541 "name": "Nvme4", 00:22:14.541 "trtype": "tcp", 00:22:14.541 "traddr": "10.0.0.2", 00:22:14.541 "adrfam": "ipv4", 00:22:14.541 "trsvcid": "4420", 00:22:14.541 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:14.541 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:14.541 "hdgst": false, 00:22:14.541 "ddgst": false 00:22:14.541 }, 00:22:14.541 "method": "bdev_nvme_attach_controller" 00:22:14.541 },{ 00:22:14.541 "params": { 00:22:14.541 "name": "Nvme5", 00:22:14.541 "trtype": "tcp", 00:22:14.541 "traddr": "10.0.0.2", 00:22:14.541 "adrfam": "ipv4", 00:22:14.541 "trsvcid": "4420", 00:22:14.541 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:14.541 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:14.541 "hdgst": false, 00:22:14.541 "ddgst": false 00:22:14.541 }, 00:22:14.541 "method": "bdev_nvme_attach_controller" 00:22:14.541 },{ 00:22:14.541 "params": { 00:22:14.541 "name": "Nvme6", 00:22:14.541 "trtype": "tcp", 00:22:14.541 "traddr": "10.0.0.2", 00:22:14.541 "adrfam": "ipv4", 00:22:14.541 "trsvcid": "4420", 00:22:14.541 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:14.541 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:14.541 "hdgst": false, 00:22:14.541 "ddgst": false 00:22:14.541 }, 00:22:14.541 "method": "bdev_nvme_attach_controller" 00:22:14.541 },{ 00:22:14.541 "params": { 00:22:14.541 "name": "Nvme7", 00:22:14.541 "trtype": "tcp", 00:22:14.541 "traddr": "10.0.0.2", 00:22:14.541 "adrfam": "ipv4", 00:22:14.541 "trsvcid": "4420", 00:22:14.541 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:14.541 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:14.541 "hdgst": false, 00:22:14.541 "ddgst": false 00:22:14.541 }, 00:22:14.541 "method": "bdev_nvme_attach_controller" 00:22:14.541 },{ 00:22:14.541 "params": { 00:22:14.541 "name": "Nvme8", 00:22:14.541 "trtype": "tcp", 00:22:14.541 "traddr": "10.0.0.2", 00:22:14.542 "adrfam": "ipv4", 00:22:14.542 "trsvcid": "4420", 00:22:14.542 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:14.542 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:14.542 "hdgst": false, 00:22:14.542 "ddgst": false 00:22:14.542 }, 00:22:14.542 "method": "bdev_nvme_attach_controller" 00:22:14.542 },{ 00:22:14.542 "params": { 00:22:14.542 "name": "Nvme9", 00:22:14.542 "trtype": "tcp", 00:22:14.542 "traddr": "10.0.0.2", 00:22:14.542 "adrfam": "ipv4", 00:22:14.542 "trsvcid": "4420", 00:22:14.542 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:14.542 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:14.542 "hdgst": false, 00:22:14.542 "ddgst": false 00:22:14.542 }, 00:22:14.542 "method": "bdev_nvme_attach_controller" 00:22:14.542 },{ 00:22:14.542 "params": { 00:22:14.542 "name": "Nvme10", 00:22:14.542 "trtype": "tcp", 00:22:14.542 "traddr": "10.0.0.2", 00:22:14.542 "adrfam": "ipv4", 00:22:14.542 "trsvcid": "4420", 00:22:14.542 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:14.542 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:14.542 "hdgst": false, 00:22:14.542 "ddgst": false 00:22:14.542 }, 00:22:14.542 "method": "bdev_nvme_attach_controller" 00:22:14.542 }' 00:22:14.542 [2024-11-26 15:46:05.815564] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:14.542 [2024-11-26 15:46:05.815636] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid932271 ] 00:22:14.542 EAL: No free 2048 kB hugepages reported on node 1 00:22:14.542 [2024-11-26 15:46:05.877544] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:14.542 [2024-11-26 15:46:05.985390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:16.439 Running I/O for 10 seconds... 00:22:17.020 15:46:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:17.020 15:46:08 -- common/autotest_common.sh@862 -- # return 0 00:22:17.020 15:46:08 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:17.020 15:46:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.020 15:46:08 -- common/autotest_common.sh@10 -- # set +x 00:22:17.020 15:46:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.020 15:46:08 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:17.020 15:46:08 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:17.020 15:46:08 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:17.020 15:46:08 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:17.021 15:46:08 -- target/shutdown.sh@57 -- # local ret=1 00:22:17.021 15:46:08 -- target/shutdown.sh@58 -- # local i 00:22:17.021 15:46:08 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:17.021 15:46:08 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:17.021 15:46:08 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:17.021 15:46:08 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:17.021 15:46:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.021 15:46:08 -- common/autotest_common.sh@10 -- # set +x 00:22:17.021 15:46:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.021 15:46:08 -- target/shutdown.sh@60 -- # read_io_count=129 00:22:17.021 15:46:08 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:22:17.021 15:46:08 -- target/shutdown.sh@64 -- # ret=0 00:22:17.021 15:46:08 -- target/shutdown.sh@65 -- # break 00:22:17.021 15:46:08 -- target/shutdown.sh@69 -- # return 0 00:22:17.021 15:46:08 -- target/shutdown.sh@134 -- # killprocess 931968 00:22:17.021 15:46:08 -- common/autotest_common.sh@936 -- # '[' -z 931968 ']' 00:22:17.021 15:46:08 -- common/autotest_common.sh@940 -- # kill -0 931968 00:22:17.021 15:46:08 -- common/autotest_common.sh@941 -- # uname 00:22:17.021 15:46:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:17.021 15:46:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 931968 00:22:17.021 15:46:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:17.021 15:46:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:17.021 15:46:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 931968' 00:22:17.021 killing process with pid 931968 00:22:17.021 15:46:08 -- common/autotest_common.sh@955 -- # kill 931968 00:22:17.021 15:46:08 -- common/autotest_common.sh@960 -- # wait 931968 00:22:17.021 [2024-11-26 15:46:08.375754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.375884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.375911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.375932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.375952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.375981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.375999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.376970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.377008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.377027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.377049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.377068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.377088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.377109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.377128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.377149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.377170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.377189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.377210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f2e0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.378615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.378647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.378662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.378677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.378713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.021 [2024-11-26 15:46:08.378727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.378988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.379442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621cb0 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.380836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.380860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.380874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.380886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.380898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.380909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.380920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.380932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.380945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.380957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.380969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.380981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.380993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.381005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.381017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.381029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.381040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.381052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.381063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.381075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.381087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.381099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.381114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.381126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.381229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.381249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.022 [2024-11-26 15:46:08.381262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.381717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261f790 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.382949] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.023 [2024-11-26 15:46:08.382998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383016] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.023 [2024-11-26 15:46:08.383030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383043] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.023 [2024-11-26 15:46:08.383057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383077] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.023 [2024-11-26 15:46:08.383091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc13f70 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.383157] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.023 [2024-11-26 15:46:08.383178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383193] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.023 [2024-11-26 15:46:08.383206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383220] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.023 [2024-11-26 15:46:08.383233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383247] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.023 [2024-11-26 15:46:08.383266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc6c590 is same with the state(5) to be set 00:22:17.023 [2024-11-26 15:46:08.383439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.023 [2024-11-26 15:46:08.383463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.023 [2024-11-26 15:46:08.383510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.023 [2024-11-26 15:46:08.383547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.023 [2024-11-26 15:46:08.383577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.023 [2024-11-26 15:46:08.383606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.023 [2024-11-26 15:46:08.383637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.023 [2024-11-26 15:46:08.383665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.023 [2024-11-26 15:46:08.383710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.023 [2024-11-26 15:46:08.383740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.023 [2024-11-26 15:46:08.383776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.023 [2024-11-26 15:46:08.383806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.023 [2024-11-26 15:46:08.383840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.023 [2024-11-26 15:46:08.383869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.023 [2024-11-26 15:46:08.383885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.023 [2024-11-26 15:46:08.383898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.383913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.383927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.383942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.383955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.383971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.383991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.384941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.384967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.385003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.385036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.385063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.385091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.385116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.385146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.385170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.385199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.385224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.024 [2024-11-26 15:46:08.385253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.024 [2024-11-26 15:46:08.385279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.025 [2024-11-26 15:46:08.385307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.025 [2024-11-26 15:46:08.385333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.025 [2024-11-26 15:46:08.385361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.025 [2024-11-26 15:46:08.385385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.025 [2024-11-26 15:46:08.385412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.025 [2024-11-26 15:46:08.385436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.025 [2024-11-26 15:46:08.385464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.025 [2024-11-26 15:46:08.385488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.025 [2024-11-26 15:46:08.385514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.025 [2024-11-26 15:46:08.385531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.025 [2024-11-26 15:46:08.385547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.025 [2024-11-26 15:46:08.385560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.025 [2024-11-26 15:46:08.385575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.025 [2024-11-26 15:46:08.385588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.025 [2024-11-26 15:46:08.385603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.025 [2024-11-26 15:46:08.385621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.025 [2024-11-26 15:46:08.385636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.025 [2024-11-26 15:46:08.385650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.025 [2024-11-26 15:46:08.385664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.025 [2024-11-26 15:46:08.385677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.025 [2024-11-26 15:46:08.385803] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xc04550 was disconnected and freed. reset controller. 00:22:17.025 [2024-11-26 15:46:08.388808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.388845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.388860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.388872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.388884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.388896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.388909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.388921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.388933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.388945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.388957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.388978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.388990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.025 [2024-11-26 15:46:08.389430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389491] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:17.026 [2024-11-26 15:46:08.389516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdda600 (9): Bad file descriptor 00:22:17.026 [2024-11-26 15:46:08.389605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.389727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261fc40 is same with the state(5) to be set 00:22:17.026 [2024-11-26 15:46:08.390559] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:17.026 [2024-11-26 15:46:08.390656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.390682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.390713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.390730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.390746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.390759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.390775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.390788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.390804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.390823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.390846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.390872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.390899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.390916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.390942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.390968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.390990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.026 [2024-11-26 15:46:08.391720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.026 [2024-11-26 15:46:08.391735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.391748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.391763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.391777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.391791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.391805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.391820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.391833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.391848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.391865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.391892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.391918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.391940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.391963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.391993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with [2024-11-26 15:46:08.392472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:17.027 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with [2024-11-26 15:46:08.392491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:1the state(5) to be set 00:22:17.027 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 15:46:08.392514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with [2024-11-26 15:46:08.392620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28288 len:1the state(5) to be set 00:22:17.027 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with [2024-11-26 15:46:08.392635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:17.027 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 15:46:08.392723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.027 [2024-11-26 15:46:08.392765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.027 [2024-11-26 15:46:08.392774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.027 [2024-11-26 15:46:08.392777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.028 [2024-11-26 15:46:08.392790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with [2024-11-26 15:46:08.392803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28928 len:1the state(5) to be set 00:22:17.028 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.028 [2024-11-26 15:46:08.392817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.028 [2024-11-26 15:46:08.392829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.028 [2024-11-26 15:46:08.392841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.028 [2024-11-26 15:46:08.392854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe58260 is same w[2024-11-26 15:46:08.392866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with ith the state(5) to be set 00:22:17.028 the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392941] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe58260 was disconnected and fre[2024-11-26 15:46:08.392944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with ed. reset controller. 00:22:17.028 the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.392994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.393257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x26200d0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.394698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.394735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.394760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.394783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.394805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.394825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.394847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.394869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.394890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.394912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.394932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.394954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.395024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.395048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.395101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.395126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.395146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with [2024-11-26 15:46:08.395142] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsthe state(5) to be set 00:22:17.028 id:0 cdw10:00000000 cdw11:00000000 00:22:17.028 [2024-11-26 15:46:08.395175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-26 15:46:08.395174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.028 the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.395196] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.028 [2024-11-26 15:46:08.395196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.395210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.028 [2024-11-26 15:46:08.395218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.395225] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.028 [2024-11-26 15:46:08.395240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.395247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.028 [2024-11-26 15:46:08.395276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.395284] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.028 [2024-11-26 15:46:08.395299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with [2024-11-26 15:46:08.395303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:22:17.028 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.028 [2024-11-26 15:46:08.395320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc16cd0 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.395321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.395343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.395350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc13f70 (9): Bad file descriptor 00:22:17.028 [2024-11-26 15:46:08.395366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.028 [2024-11-26 15:46:08.395377] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc6c590 (9): Bad file descriptor 00:22:17.028 [2024-11-26 15:46:08.395390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with [2024-11-26 15:46:08.395432] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsthe state(5) to be set 00:22:17.029 id:0 cdw10:00000000 cdw11:00000000 00:22:17.029 [2024-11-26 15:46:08.395460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.029 [2024-11-26 15:46:08.395482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with [2024-11-26 15:46:08.395488] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsthe state(5) to be set 00:22:17.029 id:0 cdw10:00000000 cdw11:00000000 00:22:17.029 [2024-11-26 15:46:08.395505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.029 [2024-11-26 15:46:08.395506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395518] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.029 [2024-11-26 15:46:08.395531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-26 15:46:08.395527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.029 the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395548] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.029 [2024-11-26 15:46:08.395553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.029 [2024-11-26 15:46:08.395575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with [2024-11-26 15:46:08.395580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc361b0 is same wthe state(5) to be set 00:22:17.029 ith the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.395980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.396003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.396023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.396045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.396066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.396086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.396108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.396129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.396166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.396192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.396212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.396233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620580 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.397390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:17.029 [2024-11-26 15:46:08.399088] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:17.029 [2024-11-26 15:46:08.399518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:12[2024-11-26 15:46:08.399623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.029 the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.029 [2024-11-26 15:46:08.399648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.029 [2024-11-26 15:46:08.399681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.029 [2024-11-26 15:46:08.399681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:12[2024-11-26 15:46:08.399709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.029 the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with [2024-11-26 15:46:08.399724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:17.029 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.029 [2024-11-26 15:46:08.399738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.029 [2024-11-26 15:46:08.399751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 15:46:08.399764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.029 the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.029 [2024-11-26 15:46:08.399782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.399791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.399797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.399803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.399812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.399815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.399826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.399828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.399841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.399842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.399853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.399856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.399866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.399872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.399878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.399886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.399891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.399902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128[2024-11-26 15:46:08.399903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.399917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with [2024-11-26 15:46:08.399917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:17.030 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.399932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with [2024-11-26 15:46:08.399937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128the state(5) to be set 00:22:17.030 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.399957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with [2024-11-26 15:46:08.399957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:17.030 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.399974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.399977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.399987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.399991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.400000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.400012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.400024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:12[2024-11-26 15:46:08.400037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with [2024-11-26 15:46:08.400051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:17.030 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.400065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.400077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.400090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.400102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.400115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with [2024-11-26 15:46:08.400128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:12the state(5) to be set 00:22:17.030 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.400145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with [2024-11-26 15:46:08.400146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:17.030 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.400159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.400171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.400184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.400196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.400208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.400233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.400245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.400257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.400269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21376 len:12[2024-11-26 15:46:08.400281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with [2024-11-26 15:46:08.400296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:17.030 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.400310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.400325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.400353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.030 [2024-11-26 15:46:08.400364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.030 [2024-11-26 15:46:08.400376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.030 [2024-11-26 15:46:08.400388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620a30 is same with the state(5) to be set 00:22:17.031 [2024-11-26 15:46:08.400389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.400966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.400981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.031 [2024-11-26 15:46:08.401515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.031 [2024-11-26 15:46:08.401530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.032 [2024-11-26 15:46:08.401543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.032 [2024-11-26 15:46:08.401558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.032 [2024-11-26 15:46:08.401571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.032 [2024-11-26 15:46:08.401585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xda16f0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401656] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xda16f0 was disconnected and freed. reset controller. 00:22:17.032 [2024-11-26 15:46:08.401785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.401989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.402571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620ee0 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.403258] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:17.032 [2024-11-26 15:46:08.403527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:17.032 [2024-11-26 15:46:08.403570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc16cd0 (9): Bad file descriptor 00:22:17.032 [2024-11-26 15:46:08.403683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.403720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.403745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.403767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.403961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.403981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.403994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.404006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.404019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.404030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.404042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.404054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.404066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.404077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.032 [2024-11-26 15:46:08.404089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404749] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:17.033 [2024-11-26 15:46:08.404762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.404931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.405050] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405109] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405140] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405167] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdc9c70 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.405241] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405277] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405304] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405331] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdb50a0 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.405408] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405443] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405469] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405496] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdc4a60 is same with the state(5) to be set 00:22:17.033 [2024-11-26 15:46:08.405563] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc361b0 (9): Bad file descriptor 00:22:17.033 [2024-11-26 15:46:08.405610] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405645] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405681] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405719] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.033 [2024-11-26 15:46:08.405732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.033 [2024-11-26 15:46:08.405744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdca150 is same with the state(5) to be set 00:22:17.034 [2024-11-26 15:46:08.405874] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:17.034 [2024-11-26 15:46:08.406287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.406949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.406975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.034 [2024-11-26 15:46:08.407428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.034 [2024-11-26 15:46:08.407442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.407455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.407469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.407482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.407496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.407508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.407522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.407535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.407550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.407562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.407580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.407593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.407607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.407625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.407639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.407652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.407682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.407704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.407719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.407748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.407765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.421797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.421827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.421841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621370 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.422970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.423006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.423026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.423047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.423066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.423085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.423106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.423125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.423145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2621820 is same with the state(5) to be set 00:22:17.035 [2024-11-26 15:46:08.427824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.427867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.427884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.427900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.427914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.427931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.427945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.427960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.427975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.427990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.428004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.428019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.428033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.428054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.428068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.428084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.428098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.428113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.428127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.428142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.428156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.428172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.428186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.428201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.428215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.428230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.428244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.428259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.428272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.428287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.428299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.035 [2024-11-26 15:46:08.428315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.035 [2024-11-26 15:46:08.428328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.428342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.428356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.428370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.428385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.428399] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe6a580 is same with the state(5) to be set 00:22:17.036 [2024-11-26 15:46:08.430030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:17.036 [2024-11-26 15:46:08.430173] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:17.036 [2024-11-26 15:46:08.430195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.430210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc13f70 is same with the state(5) to be set 00:22:17.036 [2024-11-26 15:46:08.430246] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:17.036 [2024-11-26 15:46:08.430265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.430278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdda600 is same with the state(5) to be set 00:22:17.036 [2024-11-26 15:46:08.430299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc13f70 (9): Bad file descriptor 00:22:17.036 [2024-11-26 15:46:08.430348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdda600 (9): Bad file descriptor 00:22:17.036 [2024-11-26 15:46:08.430374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc16cd0 (9): Bad file descriptor 00:22:17.036 [2024-11-26 15:46:08.430399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdc9c70 (9): Bad file descriptor 00:22:17.036 [2024-11-26 15:46:08.430433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdb50a0 (9): Bad file descriptor 00:22:17.036 [2024-11-26 15:46:08.430462] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdc4a60 (9): Bad file descriptor 00:22:17.036 [2024-11-26 15:46:08.430502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdca150 (9): Bad file descriptor 00:22:17.036 [2024-11-26 15:46:08.430554] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.036 [2024-11-26 15:46:08.430574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.430589] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.036 [2024-11-26 15:46:08.430603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.430617] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.036 [2024-11-26 15:46:08.430630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.430644] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:17.036 [2024-11-26 15:46:08.430657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.430669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc61490 is same with the state(5) to be set 00:22:17.036 [2024-11-26 15:46:08.431104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.036 [2024-11-26 15:46:08.431226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.036 [2024-11-26 15:46:08.431251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc6c590 with addr=10.0.0.2, port=4420 00:22:17.036 [2024-11-26 15:46:08.431267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc6c590 is same with the state(5) to be set 00:22:17.036 [2024-11-26 15:46:08.431327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.431975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.431988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.432004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.432017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.036 [2024-11-26 15:46:08.432032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.036 [2024-11-26 15:46:08.432045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.432984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.432998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.433013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.433026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.433041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.433055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.433070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.433092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.433107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.433121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.433136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.433151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.433166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.433179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.433194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.037 [2024-11-26 15:46:08.433207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.037 [2024-11-26 15:46:08.433227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.433241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.433255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xda01a0 is same with the state(5) to be set 00:22:17.038 [2024-11-26 15:46:08.434886] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:17.038 [2024-11-26 15:46:08.434937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc6c590 (9): Bad file descriptor 00:22:17.038 [2024-11-26 15:46:08.434959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:17.038 [2024-11-26 15:46:08.434973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:17.038 [2024-11-26 15:46:08.434990] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:17.038 [2024-11-26 15:46:08.435011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:17.038 [2024-11-26 15:46:08.435025] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:17.038 [2024-11-26 15:46:08.435038] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:17.038 [2024-11-26 15:46:08.435056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:17.038 [2024-11-26 15:46:08.435069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:17.038 [2024-11-26 15:46:08.435082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:17.038 [2024-11-26 15:46:08.435290] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.038 [2024-11-26 15:46:08.435314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.038 [2024-11-26 15:46:08.435327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.038 [2024-11-26 15:46:08.435456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.038 [2024-11-26 15:46:08.435564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.038 [2024-11-26 15:46:08.435590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc361b0 with addr=10.0.0.2, port=4420 00:22:17.038 [2024-11-26 15:46:08.435608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc361b0 is same with the state(5) to be set 00:22:17.038 [2024-11-26 15:46:08.435623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:17.038 [2024-11-26 15:46:08.435635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:17.038 [2024-11-26 15:46:08.435647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:17.038 [2024-11-26 15:46:08.436086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.038 [2024-11-26 15:46:08.436113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc361b0 (9): Bad file descriptor 00:22:17.038 [2024-11-26 15:46:08.436192] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:17.038 [2024-11-26 15:46:08.436270] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:17.038 [2024-11-26 15:46:08.436295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:17.038 [2024-11-26 15:46:08.436311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:17.038 [2024-11-26 15:46:08.436330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:17.038 [2024-11-26 15:46:08.436420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.038 [2024-11-26 15:46:08.440103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc61490 (9): Bad file descriptor 00:22:17.038 [2024-11-26 15:46:08.440267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.038 [2024-11-26 15:46:08.440880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.038 [2024-11-26 15:46:08.440896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.440909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.440924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.440937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.440953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.440966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.440981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.440995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.441977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.441990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.442005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.442019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.039 [2024-11-26 15:46:08.442035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.039 [2024-11-26 15:46:08.442048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.442063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.442076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.442091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.442108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.442124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.442137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.442152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.442166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.442180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe63950 is same with the state(5) to be set 00:22:17.040 [2024-11-26 15:46:08.443419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.443984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.443997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.444012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.444026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.444041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.444055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.444070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.444084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.444104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.444118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.444134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.444148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.444163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.444176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.444191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.444205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.444220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.444235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.444250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.444264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.444279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.444293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.444307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.444320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.444335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.444349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.444364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.040 [2024-11-26 15:46:08.444377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.040 [2024-11-26 15:46:08.444392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.444980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.444995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.445008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.445023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.445037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.445052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.445066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.445081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.445094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.445109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.445123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.445138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.445152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.445167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.445180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.445196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.445213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.445229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.445242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.445257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.445271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.445286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.445300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.445314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.445327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.445341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe64e00 is same with the state(5) to be set 00:22:17.041 [2024-11-26 15:46:08.446559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.041 [2024-11-26 15:46:08.446581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.041 [2024-11-26 15:46:08.446601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.446616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.446632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.446646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.446661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.446674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.446696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.446712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.446727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.446740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.446755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.446768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.446784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.446797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.446817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.446831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.446846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.446860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.446876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.446889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.446904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.446918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.446933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.446946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.446962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.446975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.446991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.042 [2024-11-26 15:46:08.447751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.042 [2024-11-26 15:46:08.447766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.447780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.447796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.447809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.447824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.447837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.447853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.447866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.447881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.447895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.447910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.447927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.447944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.447958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.447973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.447986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.448466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.448480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe663e0 is same with the state(5) to be set 00:22:17.043 [2024-11-26 15:46:08.449666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.449694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.449717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.449733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.449749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.449764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.449779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.449793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.449808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.449822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.449837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.449850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.449870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.449884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.449899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.449913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.449928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.449942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.449957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.449970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.043 [2024-11-26 15:46:08.449985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.043 [2024-11-26 15:46:08.449998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.450972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.450986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.451001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.451014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.451029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.451043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.451058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.451072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.451087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.451100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.451116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.451131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.044 [2024-11-26 15:46:08.451146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.044 [2024-11-26 15:46:08.451160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.045 [2024-11-26 15:46:08.451175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.045 [2024-11-26 15:46:08.451189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.045 [2024-11-26 15:46:08.451204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.045 [2024-11-26 15:46:08.451217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.045 [2024-11-26 15:46:08.451232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.045 [2024-11-26 15:46:08.451246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.045 [2024-11-26 15:46:08.451261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.045 [2024-11-26 15:46:08.451275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.045 [2024-11-26 15:46:08.451291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.045 [2024-11-26 15:46:08.451304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.045 [2024-11-26 15:46:08.451323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.045 [2024-11-26 15:46:08.451338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.045 [2024-11-26 15:46:08.451353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.045 [2024-11-26 15:46:08.451367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.045 [2024-11-26 15:46:08.451382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.045 [2024-11-26 15:46:08.451396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.045 [2024-11-26 15:46:08.451411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.045 [2024-11-26 15:46:08.451424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.306 [2024-11-26 15:46:08.460475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.306 [2024-11-26 15:46:08.460531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.306 [2024-11-26 15:46:08.460548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.306 [2024-11-26 15:46:08.460563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.306 [2024-11-26 15:46:08.460579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.306 [2024-11-26 15:46:08.460593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.306 [2024-11-26 15:46:08.460610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.306 [2024-11-26 15:46:08.460624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.306 [2024-11-26 15:46:08.460639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe679c0 is same with the state(5) to be set 00:22:17.306 [2024-11-26 15:46:08.461945] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:17.306 [2024-11-26 15:46:08.461979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:17.306 [2024-11-26 15:46:08.462000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:17.306 [2024-11-26 15:46:08.462029] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:17.306 [2024-11-26 15:46:08.462050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:17.306 [2024-11-26 15:46:08.462176] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:17.306 [2024-11-26 15:46:08.462204] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:17.306 [2024-11-26 15:46:08.462233] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:17.306 [2024-11-26 15:46:08.462329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:17.306 [2024-11-26 15:46:08.462354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:17.306 [2024-11-26 15:46:08.462386] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:17.306 [2024-11-26 15:46:08.462638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.306 [2024-11-26 15:46:08.462767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.306 [2024-11-26 15:46:08.462793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc13f70 with addr=10.0.0.2, port=4420 00:22:17.306 [2024-11-26 15:46:08.462812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc13f70 is same with the state(5) to be set 00:22:17.306 [2024-11-26 15:46:08.462937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.306 [2024-11-26 15:46:08.463044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.306 [2024-11-26 15:46:08.463068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdda600 with addr=10.0.0.2, port=4420 00:22:17.306 [2024-11-26 15:46:08.463084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdda600 is same with the state(5) to be set 00:22:17.306 [2024-11-26 15:46:08.463181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.306 [2024-11-26 15:46:08.463291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.306 [2024-11-26 15:46:08.463315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc16cd0 with addr=10.0.0.2, port=4420 00:22:17.306 [2024-11-26 15:46:08.463330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc16cd0 is same with the state(5) to be set 00:22:17.306 [2024-11-26 15:46:08.463432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.306 [2024-11-26 15:46:08.463543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.307 [2024-11-26 15:46:08.463567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdca150 with addr=10.0.0.2, port=4420 00:22:17.307 [2024-11-26 15:46:08.463582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdca150 is same with the state(5) to be set 00:22:17.307 [2024-11-26 15:46:08.463670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.307 [2024-11-26 15:46:08.463875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.307 [2024-11-26 15:46:08.463900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdb50a0 with addr=10.0.0.2, port=4420 00:22:17.307 [2024-11-26 15:46:08.463915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdb50a0 is same with the state(5) to be set 00:22:17.307 [2024-11-26 15:46:08.465037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:17.307 [2024-11-26 15:46:08.465823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:17.307 [2024-11-26 15:46:08.465837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe68fa0 is same with the state(5) to be set 00:22:17.308 [2024-11-26 15:46:08.467371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:17.308 task offset: 24320 on job bdev=Nvme2n1 fails 00:22:17.308 00:22:17.308 Latency(us) 00:22:17.308 [2024-11-26T14:46:08.761Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme1n1 ended in about 0.54 seconds with error 00:22:17.308 Verification LBA range: start 0x0 length 0x400 00:22:17.308 Nvme1n1 : 0.54 302.30 18.89 117.97 0.00 150951.68 69905.07 128159.29 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme2n1 ended in about 0.53 seconds with error 00:22:17.308 Verification LBA range: start 0x0 length 0x400 00:22:17.308 Nvme2n1 : 0.53 306.98 19.19 119.80 0.00 146487.86 24078.41 159228.21 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme3n1 ended in about 0.58 seconds with error 00:22:17.308 Verification LBA range: start 0x0 length 0x400 00:22:17.308 Nvme3n1 : 0.58 282.75 17.67 110.34 0.00 157272.77 69516.71 154567.87 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme4n1 ended in about 0.55 seconds with error 00:22:17.308 Verification LBA range: start 0x0 length 0x400 00:22:17.308 Nvme4n1 : 0.55 298.78 18.67 116.60 0.00 146199.36 60972.75 125052.40 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme5n1 ended in about 0.59 seconds with error 00:22:17.308 Verification LBA range: start 0x0 length 0x400 00:22:17.308 Nvme5n1 : 0.59 278.47 17.40 108.67 0.00 155218.55 93595.12 123498.95 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme6n1 ended in about 0.59 seconds with error 00:22:17.308 Verification LBA range: start 0x0 length 0x400 00:22:17.308 Nvme6n1 : 0.59 277.00 17.31 108.10 0.00 154014.28 73788.68 135926.52 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme7n1 ended in about 0.60 seconds with error 00:22:17.308 Verification LBA range: start 0x0 length 0x400 00:22:17.308 Nvme7n1 : 0.60 275.54 17.22 107.53 0.00 152854.31 92818.39 122722.23 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme8n1 ended in about 0.61 seconds with error 00:22:17.308 Verification LBA range: start 0x0 length 0x400 00:22:17.308 Nvme8n1 : 0.61 270.01 16.88 105.37 0.00 154234.02 80002.47 128936.01 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme9n1 ended in about 0.61 seconds with error 00:22:17.308 Verification LBA range: start 0x0 length 0x400 00:22:17.308 Nvme9n1 : 0.61 267.81 16.74 42.46 0.00 170106.42 71070.15 132819.63 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:17.308 [2024-11-26T14:46:08.761Z] Job: Nvme10n1 ended in about 0.58 seconds with error 00:22:17.308 Verification LBA range: start 0x0 length 0x400 00:22:17.308 Nvme10n1 : 0.58 219.06 13.69 111.27 0.00 169256.11 113401.55 137479.96 00:22:17.308 [2024-11-26T14:46:08.761Z] =================================================================================================================== 00:22:17.308 [2024-11-26T14:46:08.761Z] Total : 2778.70 173.67 1048.10 0.00 155176.03 24078.41 159228.21 00:22:17.308 [2024-11-26 15:46:08.495463] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:17.308 [2024-11-26 15:46:08.495555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:17.308 [2024-11-26 15:46:08.495870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.308 [2024-11-26 15:46:08.496028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.308 [2024-11-26 15:46:08.496055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdc4a60 with addr=10.0.0.2, port=4420 00:22:17.308 [2024-11-26 15:46:08.496076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdc4a60 is same with the state(5) to be set 00:22:17.308 [2024-11-26 15:46:08.496170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.308 [2024-11-26 15:46:08.496268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.308 [2024-11-26 15:46:08.496293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdc9c70 with addr=10.0.0.2, port=4420 00:22:17.308 [2024-11-26 15:46:08.496310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdc9c70 is same with the state(5) to be set 00:22:17.308 [2024-11-26 15:46:08.496423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.308 [2024-11-26 15:46:08.496534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.308 [2024-11-26 15:46:08.496560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc6c590 with addr=10.0.0.2, port=4420 00:22:17.308 [2024-11-26 15:46:08.496590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc6c590 is same with the state(5) to be set 00:22:17.308 [2024-11-26 15:46:08.496617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc13f70 (9): Bad file descriptor 00:22:17.308 [2024-11-26 15:46:08.496640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdda600 (9): Bad file descriptor 00:22:17.308 [2024-11-26 15:46:08.496658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc16cd0 (9): Bad file descriptor 00:22:17.308 [2024-11-26 15:46:08.496676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdca150 (9): Bad file descriptor 00:22:17.308 [2024-11-26 15:46:08.496700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdb50a0 (9): Bad file descriptor 00:22:17.308 [2024-11-26 15:46:08.496993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.308 [2024-11-26 15:46:08.497099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.308 [2024-11-26 15:46:08.497125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc361b0 with addr=10.0.0.2, port=4420 00:22:17.308 [2024-11-26 15:46:08.497140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc361b0 is same with the state(5) to be set 00:22:17.308 [2024-11-26 15:46:08.497244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.308 [2024-11-26 15:46:08.497350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:17.308 [2024-11-26 15:46:08.497375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc61490 with addr=10.0.0.2, port=4420 00:22:17.308 [2024-11-26 15:46:08.497389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc61490 is same with the state(5) to be set 00:22:17.308 [2024-11-26 15:46:08.497407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdc4a60 (9): Bad file descriptor 00:22:17.309 [2024-11-26 15:46:08.497426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdc9c70 (9): Bad file descriptor 00:22:17.309 [2024-11-26 15:46:08.497443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc6c590 (9): Bad file descriptor 00:22:17.309 [2024-11-26 15:46:08.497459] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:17.309 [2024-11-26 15:46:08.497471] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:17.309 [2024-11-26 15:46:08.497488] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:17.309 [2024-11-26 15:46:08.497508] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:17.309 [2024-11-26 15:46:08.497522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:17.309 [2024-11-26 15:46:08.497535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:17.309 [2024-11-26 15:46:08.497551] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:17.309 [2024-11-26 15:46:08.497564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:17.309 [2024-11-26 15:46:08.497576] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:17.309 [2024-11-26 15:46:08.497592] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:17.309 [2024-11-26 15:46:08.497605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:17.309 [2024-11-26 15:46:08.497617] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:17.309 [2024-11-26 15:46:08.497639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:17.309 [2024-11-26 15:46:08.497653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:17.309 [2024-11-26 15:46:08.497666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:17.309 [2024-11-26 15:46:08.497712] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:17.309 [2024-11-26 15:46:08.497738] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:17.309 [2024-11-26 15:46:08.497757] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:17.309 [2024-11-26 15:46:08.497774] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:17.309 [2024-11-26 15:46:08.497792] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:17.309 [2024-11-26 15:46:08.497811] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:17.309 [2024-11-26 15:46:08.497829] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:17.309 [2024-11-26 15:46:08.497846] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:17.309 [2024-11-26 15:46:08.498208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.309 [2024-11-26 15:46:08.498230] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.309 [2024-11-26 15:46:08.498243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.309 [2024-11-26 15:46:08.498254] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.309 [2024-11-26 15:46:08.498266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.309 [2024-11-26 15:46:08.498283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc361b0 (9): Bad file descriptor 00:22:17.309 [2024-11-26 15:46:08.498302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc61490 (9): Bad file descriptor 00:22:17.309 [2024-11-26 15:46:08.498317] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:17.309 [2024-11-26 15:46:08.498329] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:17.309 [2024-11-26 15:46:08.498342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:17.309 [2024-11-26 15:46:08.498359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:17.309 [2024-11-26 15:46:08.498373] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:17.309 [2024-11-26 15:46:08.498385] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:17.309 [2024-11-26 15:46:08.498402] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:17.309 [2024-11-26 15:46:08.498416] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:17.309 [2024-11-26 15:46:08.498430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:17.309 [2024-11-26 15:46:08.498482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.309 [2024-11-26 15:46:08.498501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.309 [2024-11-26 15:46:08.498513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.309 [2024-11-26 15:46:08.498525] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:17.309 [2024-11-26 15:46:08.498543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:17.309 [2024-11-26 15:46:08.498556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:17.309 [2024-11-26 15:46:08.498572] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:17.309 [2024-11-26 15:46:08.498586] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:17.309 [2024-11-26 15:46:08.498598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:17.309 [2024-11-26 15:46:08.498648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.309 [2024-11-26 15:46:08.498667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:17.609 15:46:08 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:17.609 15:46:08 -- target/shutdown.sh@138 -- # sleep 1 00:22:18.569 15:46:09 -- target/shutdown.sh@141 -- # kill -9 932271 00:22:18.569 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (932271) - No such process 00:22:18.569 15:46:09 -- target/shutdown.sh@141 -- # true 00:22:18.569 15:46:09 -- target/shutdown.sh@143 -- # stoptarget 00:22:18.569 15:46:09 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:18.569 15:46:09 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:18.569 15:46:09 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:18.569 15:46:09 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:18.569 15:46:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:18.569 15:46:09 -- nvmf/common.sh@116 -- # sync 00:22:18.569 15:46:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:18.569 15:46:09 -- nvmf/common.sh@119 -- # set +e 00:22:18.569 15:46:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:18.569 15:46:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:18.569 rmmod nvme_tcp 00:22:18.569 rmmod nvme_fabrics 00:22:18.569 rmmod nvme_keyring 00:22:18.830 15:46:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:18.830 15:46:10 -- nvmf/common.sh@123 -- # set -e 00:22:18.830 15:46:10 -- nvmf/common.sh@124 -- # return 0 00:22:18.830 15:46:10 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:18.830 15:46:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:18.830 15:46:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:18.830 15:46:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:18.830 15:46:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:18.830 15:46:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:18.830 15:46:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:18.830 15:46:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:18.830 15:46:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:20.738 15:46:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:20.738 00:22:20.738 real 0m8.061s 00:22:20.738 user 0m20.837s 00:22:20.738 sys 0m1.474s 00:22:20.738 15:46:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:20.738 15:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:20.738 ************************************ 00:22:20.738 END TEST nvmf_shutdown_tc3 00:22:20.738 ************************************ 00:22:20.738 15:46:12 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:20.738 00:22:20.738 real 0m28.717s 00:22:20.738 user 1m22.413s 00:22:20.738 sys 0m6.297s 00:22:20.738 15:46:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:20.738 15:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:20.738 ************************************ 00:22:20.738 END TEST nvmf_shutdown 00:22:20.738 ************************************ 00:22:20.738 15:46:12 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:20.738 15:46:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:20.738 15:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:20.738 15:46:12 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:20.738 15:46:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:20.738 15:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:20.738 15:46:12 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:20.738 15:46:12 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:20.738 15:46:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:20.738 15:46:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:20.738 15:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:20.738 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:22:20.738 ************************************ 00:22:20.738 START TEST nvmf_multicontroller 00:22:20.738 ************************************ 00:22:20.738 15:46:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:20.738 * Looking for test storage... 00:22:20.738 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:20.738 15:46:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:20.738 15:46:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:20.738 15:46:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:20.998 15:46:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:20.998 15:46:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:20.998 15:46:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:20.998 15:46:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:20.998 15:46:12 -- scripts/common.sh@335 -- # IFS=.-: 00:22:20.998 15:46:12 -- scripts/common.sh@335 -- # read -ra ver1 00:22:20.998 15:46:12 -- scripts/common.sh@336 -- # IFS=.-: 00:22:20.998 15:46:12 -- scripts/common.sh@336 -- # read -ra ver2 00:22:20.998 15:46:12 -- scripts/common.sh@337 -- # local 'op=<' 00:22:20.998 15:46:12 -- scripts/common.sh@339 -- # ver1_l=2 00:22:20.998 15:46:12 -- scripts/common.sh@340 -- # ver2_l=1 00:22:20.998 15:46:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:20.998 15:46:12 -- scripts/common.sh@343 -- # case "$op" in 00:22:20.998 15:46:12 -- scripts/common.sh@344 -- # : 1 00:22:20.998 15:46:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:20.998 15:46:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:20.998 15:46:12 -- scripts/common.sh@364 -- # decimal 1 00:22:20.998 15:46:12 -- scripts/common.sh@352 -- # local d=1 00:22:20.998 15:46:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:20.998 15:46:12 -- scripts/common.sh@354 -- # echo 1 00:22:20.998 15:46:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:20.998 15:46:12 -- scripts/common.sh@365 -- # decimal 2 00:22:20.998 15:46:12 -- scripts/common.sh@352 -- # local d=2 00:22:20.998 15:46:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:20.998 15:46:12 -- scripts/common.sh@354 -- # echo 2 00:22:20.998 15:46:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:20.998 15:46:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:20.998 15:46:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:20.998 15:46:12 -- scripts/common.sh@367 -- # return 0 00:22:20.998 15:46:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:20.998 15:46:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:20.998 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:20.998 --rc genhtml_branch_coverage=1 00:22:20.998 --rc genhtml_function_coverage=1 00:22:20.998 --rc genhtml_legend=1 00:22:20.998 --rc geninfo_all_blocks=1 00:22:20.998 --rc geninfo_unexecuted_blocks=1 00:22:20.998 00:22:20.998 ' 00:22:20.998 15:46:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:20.998 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:20.998 --rc genhtml_branch_coverage=1 00:22:20.998 --rc genhtml_function_coverage=1 00:22:20.998 --rc genhtml_legend=1 00:22:20.998 --rc geninfo_all_blocks=1 00:22:20.998 --rc geninfo_unexecuted_blocks=1 00:22:20.998 00:22:20.998 ' 00:22:20.998 15:46:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:20.998 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:20.998 --rc genhtml_branch_coverage=1 00:22:20.998 --rc genhtml_function_coverage=1 00:22:20.998 --rc genhtml_legend=1 00:22:20.998 --rc geninfo_all_blocks=1 00:22:20.998 --rc geninfo_unexecuted_blocks=1 00:22:20.998 00:22:20.998 ' 00:22:20.998 15:46:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:20.998 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:20.998 --rc genhtml_branch_coverage=1 00:22:20.998 --rc genhtml_function_coverage=1 00:22:20.998 --rc genhtml_legend=1 00:22:20.998 --rc geninfo_all_blocks=1 00:22:20.998 --rc geninfo_unexecuted_blocks=1 00:22:20.998 00:22:20.998 ' 00:22:20.998 15:46:12 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:20.998 15:46:12 -- nvmf/common.sh@7 -- # uname -s 00:22:20.998 15:46:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:20.998 15:46:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:20.998 15:46:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:20.998 15:46:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:20.998 15:46:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:20.998 15:46:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:20.998 15:46:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:20.998 15:46:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:20.998 15:46:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:20.998 15:46:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:20.998 15:46:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:20.998 15:46:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:20.998 15:46:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:20.998 15:46:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:20.998 15:46:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:20.998 15:46:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:20.998 15:46:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:20.998 15:46:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:20.998 15:46:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:20.998 15:46:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:20.998 15:46:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:20.999 15:46:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:20.999 15:46:12 -- paths/export.sh@5 -- # export PATH 00:22:20.999 15:46:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:20.999 15:46:12 -- nvmf/common.sh@46 -- # : 0 00:22:20.999 15:46:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:20.999 15:46:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:20.999 15:46:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:20.999 15:46:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:20.999 15:46:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:20.999 15:46:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:20.999 15:46:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:20.999 15:46:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:20.999 15:46:12 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:20.999 15:46:12 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:20.999 15:46:12 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:20.999 15:46:12 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:20.999 15:46:12 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:20.999 15:46:12 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:20.999 15:46:12 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:20.999 15:46:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:20.999 15:46:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:20.999 15:46:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:20.999 15:46:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:20.999 15:46:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:20.999 15:46:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:20.999 15:46:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:20.999 15:46:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:20.999 15:46:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:20.999 15:46:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:20.999 15:46:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:20.999 15:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:22.906 15:46:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:22.906 15:46:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:22.906 15:46:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:22.906 15:46:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:22.906 15:46:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:22.906 15:46:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:22.906 15:46:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:22.906 15:46:14 -- nvmf/common.sh@294 -- # net_devs=() 00:22:22.906 15:46:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:22.906 15:46:14 -- nvmf/common.sh@295 -- # e810=() 00:22:22.906 15:46:14 -- nvmf/common.sh@295 -- # local -ga e810 00:22:22.906 15:46:14 -- nvmf/common.sh@296 -- # x722=() 00:22:22.906 15:46:14 -- nvmf/common.sh@296 -- # local -ga x722 00:22:22.906 15:46:14 -- nvmf/common.sh@297 -- # mlx=() 00:22:22.906 15:46:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:22.906 15:46:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:22.906 15:46:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:22.906 15:46:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:22.906 15:46:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:22.906 15:46:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:22.906 15:46:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:22.906 15:46:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:22.906 15:46:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:22.906 15:46:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:22.906 15:46:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:22.906 15:46:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:22.906 15:46:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:22.906 15:46:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:22.906 15:46:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:22.906 15:46:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:22.906 15:46:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:22.907 15:46:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:22.907 15:46:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:22.907 15:46:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:22.907 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:22.907 15:46:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:22.907 15:46:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:22.907 15:46:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:22.907 15:46:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:22.907 15:46:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:22.907 15:46:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:22.907 15:46:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:22.907 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:22.907 15:46:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:22.907 15:46:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:22.907 15:46:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:22.907 15:46:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:22.907 15:46:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:22.907 15:46:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:22.907 15:46:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:22.907 15:46:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:22.907 15:46:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:22.907 15:46:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:22.907 15:46:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:22.907 15:46:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:22.907 15:46:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:22.907 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:22.907 15:46:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:22.907 15:46:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:22.907 15:46:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:22.907 15:46:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:22.907 15:46:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:22.907 15:46:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:22.907 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:22.907 15:46:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:22.907 15:46:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:22.907 15:46:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:22.907 15:46:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:22.907 15:46:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:22.907 15:46:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:22.907 15:46:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:22.907 15:46:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:22.907 15:46:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:22.907 15:46:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:22.907 15:46:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:22.907 15:46:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:22.907 15:46:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:22.907 15:46:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:22.907 15:46:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:22.907 15:46:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:22.907 15:46:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:22.907 15:46:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:23.167 15:46:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:23.167 15:46:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:23.167 15:46:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:23.167 15:46:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:23.167 15:46:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:23.167 15:46:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:23.167 15:46:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:23.167 15:46:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:23.167 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:23.167 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:22:23.167 00:22:23.167 --- 10.0.0.2 ping statistics --- 00:22:23.167 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:23.167 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:22:23.167 15:46:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:23.167 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:23.167 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:22:23.167 00:22:23.167 --- 10.0.0.1 ping statistics --- 00:22:23.167 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:23.167 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:22:23.167 15:46:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:23.167 15:46:14 -- nvmf/common.sh@410 -- # return 0 00:22:23.167 15:46:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:23.167 15:46:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:23.167 15:46:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:23.167 15:46:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:23.167 15:46:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:23.167 15:46:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:23.167 15:46:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:23.425 15:46:14 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:23.425 15:46:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:23.425 15:46:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:23.425 15:46:14 -- common/autotest_common.sh@10 -- # set +x 00:22:23.425 15:46:14 -- nvmf/common.sh@469 -- # nvmfpid=934725 00:22:23.425 15:46:14 -- nvmf/common.sh@470 -- # waitforlisten 934725 00:22:23.425 15:46:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:23.425 15:46:14 -- common/autotest_common.sh@829 -- # '[' -z 934725 ']' 00:22:23.425 15:46:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:23.425 15:46:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:23.425 15:46:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:23.425 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:23.425 15:46:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:23.425 15:46:14 -- common/autotest_common.sh@10 -- # set +x 00:22:23.425 [2024-11-26 15:46:14.677179] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:23.426 [2024-11-26 15:46:14.677263] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:23.426 EAL: No free 2048 kB hugepages reported on node 1 00:22:23.426 [2024-11-26 15:46:14.743780] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:23.426 [2024-11-26 15:46:14.857459] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:23.426 [2024-11-26 15:46:14.857627] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:23.426 [2024-11-26 15:46:14.857647] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:23.426 [2024-11-26 15:46:14.857662] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:23.426 [2024-11-26 15:46:14.857768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:23.426 [2024-11-26 15:46:14.857924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:23.426 [2024-11-26 15:46:14.857927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:24.360 15:46:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:24.360 15:46:15 -- common/autotest_common.sh@862 -- # return 0 00:22:24.360 15:46:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:24.360 15:46:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:24.360 15:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:24.360 15:46:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:24.360 15:46:15 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:24.360 15:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.360 15:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:24.360 [2024-11-26 15:46:15.657843] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:24.361 15:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.361 15:46:15 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:24.361 15:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.361 15:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:24.361 Malloc0 00:22:24.361 15:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.361 15:46:15 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:24.361 15:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.361 15:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:24.361 15:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.361 15:46:15 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:24.361 15:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.361 15:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:24.361 15:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.361 15:46:15 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:24.361 15:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.361 15:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:24.361 [2024-11-26 15:46:15.713877] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:24.361 15:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.361 15:46:15 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:24.361 15:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.361 15:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:24.361 [2024-11-26 15:46:15.721735] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:24.361 15:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.361 15:46:15 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:24.361 15:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.361 15:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:24.361 Malloc1 00:22:24.361 15:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.361 15:46:15 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:24.361 15:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.361 15:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:24.361 15:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.361 15:46:15 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:24.361 15:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.361 15:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:24.361 15:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.361 15:46:15 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:24.361 15:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.361 15:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:24.361 15:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.361 15:46:15 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:24.361 15:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:24.361 15:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:24.361 15:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:24.361 15:46:15 -- host/multicontroller.sh@44 -- # bdevperf_pid=934917 00:22:24.361 15:46:15 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:24.361 15:46:15 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:24.361 15:46:15 -- host/multicontroller.sh@47 -- # waitforlisten 934917 /var/tmp/bdevperf.sock 00:22:24.361 15:46:15 -- common/autotest_common.sh@829 -- # '[' -z 934917 ']' 00:22:24.361 15:46:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:24.361 15:46:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:24.361 15:46:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:24.361 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:24.361 15:46:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:24.361 15:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:25.741 15:46:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:25.741 15:46:16 -- common/autotest_common.sh@862 -- # return 0 00:22:25.741 15:46:16 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:25.741 15:46:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.741 15:46:16 -- common/autotest_common.sh@10 -- # set +x 00:22:25.741 NVMe0n1 00:22:25.741 15:46:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.741 15:46:17 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:25.741 15:46:17 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:22:25.741 15:46:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.741 15:46:17 -- common/autotest_common.sh@10 -- # set +x 00:22:25.741 15:46:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.741 1 00:22:25.741 15:46:17 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:25.741 15:46:17 -- common/autotest_common.sh@650 -- # local es=0 00:22:25.741 15:46:17 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:25.741 15:46:17 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:25.741 15:46:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:25.741 15:46:17 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:25.741 15:46:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:25.741 15:46:17 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:25.741 15:46:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.741 15:46:17 -- common/autotest_common.sh@10 -- # set +x 00:22:25.741 request: 00:22:25.741 { 00:22:25.741 "name": "NVMe0", 00:22:25.741 "trtype": "tcp", 00:22:25.741 "traddr": "10.0.0.2", 00:22:25.741 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:22:25.741 "hostaddr": "10.0.0.2", 00:22:25.741 "hostsvcid": "60000", 00:22:25.741 "adrfam": "ipv4", 00:22:25.741 "trsvcid": "4420", 00:22:25.741 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:25.741 "method": "bdev_nvme_attach_controller", 00:22:25.741 "req_id": 1 00:22:25.741 } 00:22:25.741 Got JSON-RPC error response 00:22:25.741 response: 00:22:25.741 { 00:22:25.741 "code": -114, 00:22:25.741 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:25.741 } 00:22:25.741 15:46:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:25.741 15:46:17 -- common/autotest_common.sh@653 -- # es=1 00:22:25.741 15:46:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:25.741 15:46:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:25.741 15:46:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:25.741 15:46:17 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:25.741 15:46:17 -- common/autotest_common.sh@650 -- # local es=0 00:22:25.741 15:46:17 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:25.741 15:46:17 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:25.741 15:46:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:25.741 15:46:17 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:25.741 15:46:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:25.741 15:46:17 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:25.741 15:46:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.741 15:46:17 -- common/autotest_common.sh@10 -- # set +x 00:22:25.741 request: 00:22:25.741 { 00:22:25.741 "name": "NVMe0", 00:22:25.741 "trtype": "tcp", 00:22:25.741 "traddr": "10.0.0.2", 00:22:25.741 "hostaddr": "10.0.0.2", 00:22:25.742 "hostsvcid": "60000", 00:22:25.742 "adrfam": "ipv4", 00:22:25.742 "trsvcid": "4420", 00:22:25.742 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:25.742 "method": "bdev_nvme_attach_controller", 00:22:25.742 "req_id": 1 00:22:25.742 } 00:22:25.742 Got JSON-RPC error response 00:22:25.742 response: 00:22:25.742 { 00:22:25.742 "code": -114, 00:22:25.742 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:25.742 } 00:22:25.742 15:46:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:25.742 15:46:17 -- common/autotest_common.sh@653 -- # es=1 00:22:25.742 15:46:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:25.742 15:46:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:25.742 15:46:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:25.742 15:46:17 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:25.742 15:46:17 -- common/autotest_common.sh@650 -- # local es=0 00:22:25.742 15:46:17 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:25.742 15:46:17 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:25.742 15:46:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:25.742 15:46:17 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:25.742 15:46:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:25.742 15:46:17 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:25.742 15:46:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.742 15:46:17 -- common/autotest_common.sh@10 -- # set +x 00:22:25.742 request: 00:22:25.742 { 00:22:25.742 "name": "NVMe0", 00:22:25.742 "trtype": "tcp", 00:22:25.742 "traddr": "10.0.0.2", 00:22:25.742 "hostaddr": "10.0.0.2", 00:22:25.742 "hostsvcid": "60000", 00:22:25.742 "adrfam": "ipv4", 00:22:25.742 "trsvcid": "4420", 00:22:25.742 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:25.742 "multipath": "disable", 00:22:25.742 "method": "bdev_nvme_attach_controller", 00:22:25.742 "req_id": 1 00:22:25.742 } 00:22:25.742 Got JSON-RPC error response 00:22:25.742 response: 00:22:25.742 { 00:22:25.742 "code": -114, 00:22:25.742 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:22:25.742 } 00:22:25.742 15:46:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:25.742 15:46:17 -- common/autotest_common.sh@653 -- # es=1 00:22:25.742 15:46:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:25.742 15:46:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:25.742 15:46:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:25.742 15:46:17 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:25.742 15:46:17 -- common/autotest_common.sh@650 -- # local es=0 00:22:25.742 15:46:17 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:25.742 15:46:17 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:25.742 15:46:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:25.742 15:46:17 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:25.742 15:46:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:25.742 15:46:17 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:25.742 15:46:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.742 15:46:17 -- common/autotest_common.sh@10 -- # set +x 00:22:25.742 request: 00:22:25.742 { 00:22:25.742 "name": "NVMe0", 00:22:25.742 "trtype": "tcp", 00:22:25.742 "traddr": "10.0.0.2", 00:22:25.742 "hostaddr": "10.0.0.2", 00:22:25.742 "hostsvcid": "60000", 00:22:25.742 "adrfam": "ipv4", 00:22:25.742 "trsvcid": "4420", 00:22:25.742 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:25.742 "multipath": "failover", 00:22:25.742 "method": "bdev_nvme_attach_controller", 00:22:25.742 "req_id": 1 00:22:25.742 } 00:22:25.742 Got JSON-RPC error response 00:22:25.742 response: 00:22:25.742 { 00:22:25.742 "code": -114, 00:22:25.742 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:25.742 } 00:22:25.742 15:46:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:25.742 15:46:17 -- common/autotest_common.sh@653 -- # es=1 00:22:25.742 15:46:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:25.742 15:46:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:25.742 15:46:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:25.742 15:46:17 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:25.742 15:46:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.742 15:46:17 -- common/autotest_common.sh@10 -- # set +x 00:22:26.002 00:22:26.002 15:46:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.002 15:46:17 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:26.002 15:46:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.002 15:46:17 -- common/autotest_common.sh@10 -- # set +x 00:22:26.002 15:46:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.002 15:46:17 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:26.002 15:46:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.002 15:46:17 -- common/autotest_common.sh@10 -- # set +x 00:22:26.002 00:22:26.002 15:46:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.002 15:46:17 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:26.002 15:46:17 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:22:26.002 15:46:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.002 15:46:17 -- common/autotest_common.sh@10 -- # set +x 00:22:26.263 15:46:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.263 15:46:17 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:22:26.263 15:46:17 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:27.201 0 00:22:27.201 15:46:18 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:22:27.201 15:46:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.201 15:46:18 -- common/autotest_common.sh@10 -- # set +x 00:22:27.201 15:46:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.201 15:46:18 -- host/multicontroller.sh@100 -- # killprocess 934917 00:22:27.201 15:46:18 -- common/autotest_common.sh@936 -- # '[' -z 934917 ']' 00:22:27.201 15:46:18 -- common/autotest_common.sh@940 -- # kill -0 934917 00:22:27.201 15:46:18 -- common/autotest_common.sh@941 -- # uname 00:22:27.201 15:46:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:27.201 15:46:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 934917 00:22:27.201 15:46:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:27.201 15:46:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:27.201 15:46:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 934917' 00:22:27.201 killing process with pid 934917 00:22:27.201 15:46:18 -- common/autotest_common.sh@955 -- # kill 934917 00:22:27.201 15:46:18 -- common/autotest_common.sh@960 -- # wait 934917 00:22:27.459 15:46:18 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:27.459 15:46:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.459 15:46:18 -- common/autotest_common.sh@10 -- # set +x 00:22:27.459 15:46:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.459 15:46:18 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:27.459 15:46:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.459 15:46:18 -- common/autotest_common.sh@10 -- # set +x 00:22:27.459 15:46:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.459 15:46:18 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:22:27.459 15:46:18 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:27.459 15:46:18 -- common/autotest_common.sh@1607 -- # read -r file 00:22:27.459 15:46:18 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:22:27.459 15:46:18 -- common/autotest_common.sh@1606 -- # sort -u 00:22:27.459 15:46:18 -- common/autotest_common.sh@1608 -- # cat 00:22:27.459 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:27.459 [2024-11-26 15:46:15.821851] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:27.459 [2024-11-26 15:46:15.821935] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid934917 ] 00:22:27.459 EAL: No free 2048 kB hugepages reported on node 1 00:22:27.459 [2024-11-26 15:46:15.879845] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:27.459 [2024-11-26 15:46:15.986474] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:27.459 [2024-11-26 15:46:17.434848] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name b17bfba3-afd6-46b6-a704-a258e01b010d already exists 00:22:27.459 [2024-11-26 15:46:17.434891] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:b17bfba3-afd6-46b6-a704-a258e01b010d alias for bdev NVMe1n1 00:22:27.459 [2024-11-26 15:46:17.434909] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:22:27.459 Running I/O for 1 seconds... 00:22:27.459 00:22:27.459 Latency(us) 00:22:27.459 [2024-11-26T14:46:18.912Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:27.459 [2024-11-26T14:46:18.912Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:22:27.459 NVMe0n1 : 1.00 19310.19 75.43 0.00 0.00 6618.45 2487.94 11602.30 00:22:27.459 [2024-11-26T14:46:18.912Z] =================================================================================================================== 00:22:27.459 [2024-11-26T14:46:18.912Z] Total : 19310.19 75.43 0.00 0.00 6618.45 2487.94 11602.30 00:22:27.459 Received shutdown signal, test time was about 1.000000 seconds 00:22:27.459 00:22:27.459 Latency(us) 00:22:27.459 [2024-11-26T14:46:18.912Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:27.459 [2024-11-26T14:46:18.912Z] =================================================================================================================== 00:22:27.459 [2024-11-26T14:46:18.912Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:27.459 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:27.459 15:46:18 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:27.459 15:46:18 -- common/autotest_common.sh@1607 -- # read -r file 00:22:27.459 15:46:18 -- host/multicontroller.sh@108 -- # nvmftestfini 00:22:27.459 15:46:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:27.459 15:46:18 -- nvmf/common.sh@116 -- # sync 00:22:27.459 15:46:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:27.459 15:46:18 -- nvmf/common.sh@119 -- # set +e 00:22:27.459 15:46:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:27.459 15:46:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:27.459 rmmod nvme_tcp 00:22:27.718 rmmod nvme_fabrics 00:22:27.718 rmmod nvme_keyring 00:22:27.718 15:46:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:27.718 15:46:18 -- nvmf/common.sh@123 -- # set -e 00:22:27.718 15:46:18 -- nvmf/common.sh@124 -- # return 0 00:22:27.718 15:46:18 -- nvmf/common.sh@477 -- # '[' -n 934725 ']' 00:22:27.718 15:46:18 -- nvmf/common.sh@478 -- # killprocess 934725 00:22:27.718 15:46:18 -- common/autotest_common.sh@936 -- # '[' -z 934725 ']' 00:22:27.718 15:46:18 -- common/autotest_common.sh@940 -- # kill -0 934725 00:22:27.718 15:46:18 -- common/autotest_common.sh@941 -- # uname 00:22:27.718 15:46:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:27.718 15:46:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 934725 00:22:27.718 15:46:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:27.718 15:46:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:27.718 15:46:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 934725' 00:22:27.718 killing process with pid 934725 00:22:27.718 15:46:18 -- common/autotest_common.sh@955 -- # kill 934725 00:22:27.718 15:46:18 -- common/autotest_common.sh@960 -- # wait 934725 00:22:27.975 15:46:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:27.975 15:46:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:27.975 15:46:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:27.975 15:46:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:27.975 15:46:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:27.975 15:46:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:27.975 15:46:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:27.975 15:46:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:30.514 15:46:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:30.515 00:22:30.515 real 0m9.211s 00:22:30.515 user 0m17.346s 00:22:30.515 sys 0m2.471s 00:22:30.515 15:46:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:30.515 15:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:30.515 ************************************ 00:22:30.515 END TEST nvmf_multicontroller 00:22:30.515 ************************************ 00:22:30.515 15:46:21 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:30.515 15:46:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:30.515 15:46:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:30.515 15:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:30.515 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:22:30.515 ************************************ 00:22:30.515 START TEST nvmf_aer 00:22:30.515 ************************************ 00:22:30.515 15:46:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:30.515 * Looking for test storage... 00:22:30.515 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:30.515 15:46:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:30.515 15:46:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:30.515 15:46:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:30.515 15:46:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:30.515 15:46:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:30.515 15:46:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:30.515 15:46:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:30.515 15:46:21 -- scripts/common.sh@335 -- # IFS=.-: 00:22:30.515 15:46:21 -- scripts/common.sh@335 -- # read -ra ver1 00:22:30.515 15:46:21 -- scripts/common.sh@336 -- # IFS=.-: 00:22:30.515 15:46:21 -- scripts/common.sh@336 -- # read -ra ver2 00:22:30.515 15:46:21 -- scripts/common.sh@337 -- # local 'op=<' 00:22:30.515 15:46:21 -- scripts/common.sh@339 -- # ver1_l=2 00:22:30.515 15:46:21 -- scripts/common.sh@340 -- # ver2_l=1 00:22:30.515 15:46:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:30.515 15:46:21 -- scripts/common.sh@343 -- # case "$op" in 00:22:30.515 15:46:21 -- scripts/common.sh@344 -- # : 1 00:22:30.515 15:46:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:30.515 15:46:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:30.515 15:46:21 -- scripts/common.sh@364 -- # decimal 1 00:22:30.515 15:46:21 -- scripts/common.sh@352 -- # local d=1 00:22:30.515 15:46:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:30.515 15:46:21 -- scripts/common.sh@354 -- # echo 1 00:22:30.515 15:46:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:30.515 15:46:21 -- scripts/common.sh@365 -- # decimal 2 00:22:30.515 15:46:21 -- scripts/common.sh@352 -- # local d=2 00:22:30.515 15:46:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:30.515 15:46:21 -- scripts/common.sh@354 -- # echo 2 00:22:30.515 15:46:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:30.515 15:46:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:30.515 15:46:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:30.515 15:46:21 -- scripts/common.sh@367 -- # return 0 00:22:30.515 15:46:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:30.515 15:46:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:30.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:30.515 --rc genhtml_branch_coverage=1 00:22:30.515 --rc genhtml_function_coverage=1 00:22:30.515 --rc genhtml_legend=1 00:22:30.515 --rc geninfo_all_blocks=1 00:22:30.515 --rc geninfo_unexecuted_blocks=1 00:22:30.515 00:22:30.515 ' 00:22:30.515 15:46:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:30.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:30.515 --rc genhtml_branch_coverage=1 00:22:30.515 --rc genhtml_function_coverage=1 00:22:30.515 --rc genhtml_legend=1 00:22:30.515 --rc geninfo_all_blocks=1 00:22:30.515 --rc geninfo_unexecuted_blocks=1 00:22:30.515 00:22:30.515 ' 00:22:30.515 15:46:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:30.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:30.515 --rc genhtml_branch_coverage=1 00:22:30.515 --rc genhtml_function_coverage=1 00:22:30.515 --rc genhtml_legend=1 00:22:30.515 --rc geninfo_all_blocks=1 00:22:30.515 --rc geninfo_unexecuted_blocks=1 00:22:30.515 00:22:30.515 ' 00:22:30.515 15:46:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:30.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:30.515 --rc genhtml_branch_coverage=1 00:22:30.515 --rc genhtml_function_coverage=1 00:22:30.515 --rc genhtml_legend=1 00:22:30.515 --rc geninfo_all_blocks=1 00:22:30.515 --rc geninfo_unexecuted_blocks=1 00:22:30.515 00:22:30.515 ' 00:22:30.515 15:46:21 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:30.515 15:46:21 -- nvmf/common.sh@7 -- # uname -s 00:22:30.515 15:46:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:30.515 15:46:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:30.515 15:46:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:30.515 15:46:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:30.515 15:46:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:30.515 15:46:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:30.515 15:46:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:30.515 15:46:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:30.515 15:46:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:30.515 15:46:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:30.515 15:46:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:30.515 15:46:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:30.515 15:46:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:30.515 15:46:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:30.515 15:46:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:30.515 15:46:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:30.515 15:46:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:30.515 15:46:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:30.515 15:46:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:30.515 15:46:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:30.515 15:46:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:30.515 15:46:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:30.515 15:46:21 -- paths/export.sh@5 -- # export PATH 00:22:30.515 15:46:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:30.515 15:46:21 -- nvmf/common.sh@46 -- # : 0 00:22:30.515 15:46:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:30.515 15:46:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:30.515 15:46:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:30.515 15:46:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:30.515 15:46:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:30.515 15:46:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:30.515 15:46:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:30.515 15:46:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:30.515 15:46:21 -- host/aer.sh@11 -- # nvmftestinit 00:22:30.515 15:46:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:30.515 15:46:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:30.515 15:46:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:30.515 15:46:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:30.515 15:46:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:30.515 15:46:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:30.515 15:46:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:30.515 15:46:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:30.515 15:46:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:30.515 15:46:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:30.515 15:46:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:30.515 15:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:32.419 15:46:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:32.419 15:46:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:32.419 15:46:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:32.419 15:46:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:32.419 15:46:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:32.420 15:46:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:32.420 15:46:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:32.420 15:46:23 -- nvmf/common.sh@294 -- # net_devs=() 00:22:32.420 15:46:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:32.420 15:46:23 -- nvmf/common.sh@295 -- # e810=() 00:22:32.420 15:46:23 -- nvmf/common.sh@295 -- # local -ga e810 00:22:32.420 15:46:23 -- nvmf/common.sh@296 -- # x722=() 00:22:32.420 15:46:23 -- nvmf/common.sh@296 -- # local -ga x722 00:22:32.420 15:46:23 -- nvmf/common.sh@297 -- # mlx=() 00:22:32.420 15:46:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:32.420 15:46:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:32.420 15:46:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:32.420 15:46:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:32.420 15:46:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:32.420 15:46:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:32.420 15:46:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:32.420 15:46:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:32.420 15:46:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:32.420 15:46:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:32.420 15:46:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:32.420 15:46:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:32.420 15:46:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:32.420 15:46:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:32.420 15:46:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:32.420 15:46:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:32.420 15:46:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:32.420 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:32.420 15:46:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:32.420 15:46:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:32.420 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:32.420 15:46:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:32.420 15:46:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:32.420 15:46:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:32.420 15:46:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:32.420 15:46:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:32.420 15:46:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:32.420 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:32.420 15:46:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:32.420 15:46:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:32.420 15:46:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:32.420 15:46:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:32.420 15:46:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:32.420 15:46:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:32.420 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:32.420 15:46:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:32.420 15:46:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:32.420 15:46:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:32.420 15:46:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:32.420 15:46:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:32.420 15:46:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:32.420 15:46:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:32.420 15:46:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:32.420 15:46:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:32.420 15:46:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:32.420 15:46:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:32.420 15:46:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:32.420 15:46:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:32.420 15:46:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:32.420 15:46:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:32.420 15:46:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:32.420 15:46:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:32.420 15:46:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:32.420 15:46:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:32.420 15:46:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:32.420 15:46:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:32.420 15:46:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:32.420 15:46:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:32.420 15:46:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:32.420 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:32.420 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:22:32.420 00:22:32.420 --- 10.0.0.2 ping statistics --- 00:22:32.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:32.420 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:22:32.420 15:46:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:32.420 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:32.420 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:22:32.420 00:22:32.420 --- 10.0.0.1 ping statistics --- 00:22:32.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:32.420 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:22:32.420 15:46:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:32.420 15:46:23 -- nvmf/common.sh@410 -- # return 0 00:22:32.420 15:46:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:32.420 15:46:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:32.420 15:46:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:32.420 15:46:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:32.420 15:46:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:32.420 15:46:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:32.420 15:46:23 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:22:32.420 15:46:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:32.420 15:46:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:32.420 15:46:23 -- common/autotest_common.sh@10 -- # set +x 00:22:32.420 15:46:23 -- nvmf/common.sh@469 -- # nvmfpid=937180 00:22:32.420 15:46:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:32.420 15:46:23 -- nvmf/common.sh@470 -- # waitforlisten 937180 00:22:32.420 15:46:23 -- common/autotest_common.sh@829 -- # '[' -z 937180 ']' 00:22:32.420 15:46:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:32.420 15:46:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:32.420 15:46:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:32.420 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:32.420 15:46:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:32.420 15:46:23 -- common/autotest_common.sh@10 -- # set +x 00:22:32.420 [2024-11-26 15:46:23.691916] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:32.420 [2024-11-26 15:46:23.692013] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:32.420 EAL: No free 2048 kB hugepages reported on node 1 00:22:32.420 [2024-11-26 15:46:23.762281] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:32.681 [2024-11-26 15:46:23.877661] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:32.681 [2024-11-26 15:46:23.877807] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:32.681 [2024-11-26 15:46:23.877824] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:32.681 [2024-11-26 15:46:23.877836] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:32.681 [2024-11-26 15:46:23.877890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:32.681 [2024-11-26 15:46:23.877917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:32.681 [2024-11-26 15:46:23.877979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:32.681 [2024-11-26 15:46:23.877982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:33.620 15:46:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:33.620 15:46:24 -- common/autotest_common.sh@862 -- # return 0 00:22:33.621 15:46:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:33.621 15:46:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:33.621 15:46:24 -- common/autotest_common.sh@10 -- # set +x 00:22:33.621 15:46:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:33.621 15:46:24 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:33.621 15:46:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.621 15:46:24 -- common/autotest_common.sh@10 -- # set +x 00:22:33.621 [2024-11-26 15:46:24.760514] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:33.621 15:46:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.621 15:46:24 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:22:33.621 15:46:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.621 15:46:24 -- common/autotest_common.sh@10 -- # set +x 00:22:33.621 Malloc0 00:22:33.621 15:46:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.621 15:46:24 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:22:33.621 15:46:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.621 15:46:24 -- common/autotest_common.sh@10 -- # set +x 00:22:33.621 15:46:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.621 15:46:24 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:33.621 15:46:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.621 15:46:24 -- common/autotest_common.sh@10 -- # set +x 00:22:33.621 15:46:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.621 15:46:24 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:33.621 15:46:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.621 15:46:24 -- common/autotest_common.sh@10 -- # set +x 00:22:33.621 [2024-11-26 15:46:24.812106] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:33.621 15:46:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.621 15:46:24 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:22:33.621 15:46:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.621 15:46:24 -- common/autotest_common.sh@10 -- # set +x 00:22:33.621 [2024-11-26 15:46:24.819784] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:33.621 [ 00:22:33.621 { 00:22:33.621 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:33.621 "subtype": "Discovery", 00:22:33.621 "listen_addresses": [], 00:22:33.621 "allow_any_host": true, 00:22:33.621 "hosts": [] 00:22:33.621 }, 00:22:33.621 { 00:22:33.621 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:33.621 "subtype": "NVMe", 00:22:33.621 "listen_addresses": [ 00:22:33.621 { 00:22:33.621 "transport": "TCP", 00:22:33.621 "trtype": "TCP", 00:22:33.621 "adrfam": "IPv4", 00:22:33.621 "traddr": "10.0.0.2", 00:22:33.621 "trsvcid": "4420" 00:22:33.621 } 00:22:33.621 ], 00:22:33.621 "allow_any_host": true, 00:22:33.621 "hosts": [], 00:22:33.621 "serial_number": "SPDK00000000000001", 00:22:33.621 "model_number": "SPDK bdev Controller", 00:22:33.621 "max_namespaces": 2, 00:22:33.621 "min_cntlid": 1, 00:22:33.621 "max_cntlid": 65519, 00:22:33.621 "namespaces": [ 00:22:33.621 { 00:22:33.621 "nsid": 1, 00:22:33.621 "bdev_name": "Malloc0", 00:22:33.621 "name": "Malloc0", 00:22:33.621 "nguid": "80A0D38EB9874F989F3D60187BFCD207", 00:22:33.621 "uuid": "80a0d38e-b987-4f98-9f3d-60187bfcd207" 00:22:33.621 } 00:22:33.621 ] 00:22:33.621 } 00:22:33.621 ] 00:22:33.621 15:46:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.621 15:46:24 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:22:33.621 15:46:24 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:22:33.621 15:46:24 -- host/aer.sh@33 -- # aerpid=937395 00:22:33.621 15:46:24 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:22:33.621 15:46:24 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:22:33.621 15:46:24 -- common/autotest_common.sh@1254 -- # local i=0 00:22:33.621 15:46:24 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:33.621 15:46:24 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:22:33.621 15:46:24 -- common/autotest_common.sh@1257 -- # i=1 00:22:33.621 15:46:24 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:33.621 EAL: No free 2048 kB hugepages reported on node 1 00:22:33.621 15:46:24 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:33.621 15:46:24 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:22:33.621 15:46:24 -- common/autotest_common.sh@1257 -- # i=2 00:22:33.621 15:46:24 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:33.621 15:46:25 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:33.621 15:46:25 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:33.621 15:46:25 -- common/autotest_common.sh@1265 -- # return 0 00:22:33.621 15:46:25 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:22:33.621 15:46:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.621 15:46:25 -- common/autotest_common.sh@10 -- # set +x 00:22:33.881 Malloc1 00:22:33.881 15:46:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.882 15:46:25 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:22:33.882 15:46:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.882 15:46:25 -- common/autotest_common.sh@10 -- # set +x 00:22:33.882 15:46:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.882 15:46:25 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:22:33.882 15:46:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.882 15:46:25 -- common/autotest_common.sh@10 -- # set +x 00:22:33.882 Asynchronous Event Request test 00:22:33.882 Attaching to 10.0.0.2 00:22:33.882 Attached to 10.0.0.2 00:22:33.882 Registering asynchronous event callbacks... 00:22:33.882 Starting namespace attribute notice tests for all controllers... 00:22:33.882 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:22:33.882 aer_cb - Changed Namespace 00:22:33.882 Cleaning up... 00:22:33.882 [ 00:22:33.882 { 00:22:33.882 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:33.882 "subtype": "Discovery", 00:22:33.882 "listen_addresses": [], 00:22:33.882 "allow_any_host": true, 00:22:33.882 "hosts": [] 00:22:33.882 }, 00:22:33.882 { 00:22:33.882 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:33.882 "subtype": "NVMe", 00:22:33.882 "listen_addresses": [ 00:22:33.882 { 00:22:33.882 "transport": "TCP", 00:22:33.882 "trtype": "TCP", 00:22:33.882 "adrfam": "IPv4", 00:22:33.882 "traddr": "10.0.0.2", 00:22:33.882 "trsvcid": "4420" 00:22:33.882 } 00:22:33.882 ], 00:22:33.882 "allow_any_host": true, 00:22:33.882 "hosts": [], 00:22:33.882 "serial_number": "SPDK00000000000001", 00:22:33.882 "model_number": "SPDK bdev Controller", 00:22:33.882 "max_namespaces": 2, 00:22:33.882 "min_cntlid": 1, 00:22:33.882 "max_cntlid": 65519, 00:22:33.882 "namespaces": [ 00:22:33.882 { 00:22:33.882 "nsid": 1, 00:22:33.882 "bdev_name": "Malloc0", 00:22:33.882 "name": "Malloc0", 00:22:33.882 "nguid": "80A0D38EB9874F989F3D60187BFCD207", 00:22:33.882 "uuid": "80a0d38e-b987-4f98-9f3d-60187bfcd207" 00:22:33.882 }, 00:22:33.882 { 00:22:33.882 "nsid": 2, 00:22:33.882 "bdev_name": "Malloc1", 00:22:33.882 "name": "Malloc1", 00:22:33.882 "nguid": "F3118F6D9CCF4C2C8FAA2A1BA9AD2E6B", 00:22:33.882 "uuid": "f3118f6d-9ccf-4c2c-8faa-2a1ba9ad2e6b" 00:22:33.882 } 00:22:33.882 ] 00:22:33.882 } 00:22:33.882 ] 00:22:33.882 15:46:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.882 15:46:25 -- host/aer.sh@43 -- # wait 937395 00:22:33.882 15:46:25 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:22:33.882 15:46:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.882 15:46:25 -- common/autotest_common.sh@10 -- # set +x 00:22:33.882 15:46:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.882 15:46:25 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:22:33.882 15:46:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.882 15:46:25 -- common/autotest_common.sh@10 -- # set +x 00:22:33.882 15:46:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.882 15:46:25 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:33.882 15:46:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.882 15:46:25 -- common/autotest_common.sh@10 -- # set +x 00:22:33.882 15:46:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.882 15:46:25 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:22:33.882 15:46:25 -- host/aer.sh@51 -- # nvmftestfini 00:22:33.882 15:46:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:33.882 15:46:25 -- nvmf/common.sh@116 -- # sync 00:22:33.882 15:46:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:33.882 15:46:25 -- nvmf/common.sh@119 -- # set +e 00:22:33.882 15:46:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:33.882 15:46:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:33.882 rmmod nvme_tcp 00:22:33.882 rmmod nvme_fabrics 00:22:33.882 rmmod nvme_keyring 00:22:33.882 15:46:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:33.882 15:46:25 -- nvmf/common.sh@123 -- # set -e 00:22:33.882 15:46:25 -- nvmf/common.sh@124 -- # return 0 00:22:33.882 15:46:25 -- nvmf/common.sh@477 -- # '[' -n 937180 ']' 00:22:33.882 15:46:25 -- nvmf/common.sh@478 -- # killprocess 937180 00:22:33.882 15:46:25 -- common/autotest_common.sh@936 -- # '[' -z 937180 ']' 00:22:33.882 15:46:25 -- common/autotest_common.sh@940 -- # kill -0 937180 00:22:33.882 15:46:25 -- common/autotest_common.sh@941 -- # uname 00:22:33.882 15:46:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:33.882 15:46:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 937180 00:22:33.882 15:46:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:33.882 15:46:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:33.882 15:46:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 937180' 00:22:33.882 killing process with pid 937180 00:22:33.882 15:46:25 -- common/autotest_common.sh@955 -- # kill 937180 00:22:33.882 [2024-11-26 15:46:25.291982] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:33.882 15:46:25 -- common/autotest_common.sh@960 -- # wait 937180 00:22:34.141 15:46:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:34.141 15:46:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:34.141 15:46:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:34.141 15:46:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:34.141 15:46:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:34.141 15:46:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:34.141 15:46:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:34.141 15:46:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:36.674 15:46:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:36.674 00:22:36.674 real 0m6.231s 00:22:36.674 user 0m7.630s 00:22:36.674 sys 0m1.935s 00:22:36.674 15:46:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:36.674 15:46:27 -- common/autotest_common.sh@10 -- # set +x 00:22:36.674 ************************************ 00:22:36.674 END TEST nvmf_aer 00:22:36.674 ************************************ 00:22:36.674 15:46:27 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:22:36.674 15:46:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:36.674 15:46:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:36.674 15:46:27 -- common/autotest_common.sh@10 -- # set +x 00:22:36.674 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:22:36.674 ************************************ 00:22:36.674 START TEST nvmf_async_init 00:22:36.674 ************************************ 00:22:36.674 15:46:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:22:36.674 * Looking for test storage... 00:22:36.675 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:36.675 15:46:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:36.675 15:46:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:36.675 15:46:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:36.675 15:46:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:36.675 15:46:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:36.675 15:46:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:36.675 15:46:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:36.675 15:46:27 -- scripts/common.sh@335 -- # IFS=.-: 00:22:36.675 15:46:27 -- scripts/common.sh@335 -- # read -ra ver1 00:22:36.675 15:46:27 -- scripts/common.sh@336 -- # IFS=.-: 00:22:36.675 15:46:27 -- scripts/common.sh@336 -- # read -ra ver2 00:22:36.675 15:46:27 -- scripts/common.sh@337 -- # local 'op=<' 00:22:36.675 15:46:27 -- scripts/common.sh@339 -- # ver1_l=2 00:22:36.675 15:46:27 -- scripts/common.sh@340 -- # ver2_l=1 00:22:36.675 15:46:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:36.675 15:46:27 -- scripts/common.sh@343 -- # case "$op" in 00:22:36.675 15:46:27 -- scripts/common.sh@344 -- # : 1 00:22:36.675 15:46:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:36.675 15:46:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:36.675 15:46:27 -- scripts/common.sh@364 -- # decimal 1 00:22:36.675 15:46:27 -- scripts/common.sh@352 -- # local d=1 00:22:36.675 15:46:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:36.675 15:46:27 -- scripts/common.sh@354 -- # echo 1 00:22:36.675 15:46:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:36.675 15:46:27 -- scripts/common.sh@365 -- # decimal 2 00:22:36.675 15:46:27 -- scripts/common.sh@352 -- # local d=2 00:22:36.675 15:46:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:36.675 15:46:27 -- scripts/common.sh@354 -- # echo 2 00:22:36.675 15:46:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:36.675 15:46:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:36.675 15:46:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:36.675 15:46:27 -- scripts/common.sh@367 -- # return 0 00:22:36.675 15:46:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:36.675 15:46:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:36.675 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:36.675 --rc genhtml_branch_coverage=1 00:22:36.675 --rc genhtml_function_coverage=1 00:22:36.675 --rc genhtml_legend=1 00:22:36.675 --rc geninfo_all_blocks=1 00:22:36.675 --rc geninfo_unexecuted_blocks=1 00:22:36.675 00:22:36.675 ' 00:22:36.675 15:46:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:36.675 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:36.675 --rc genhtml_branch_coverage=1 00:22:36.675 --rc genhtml_function_coverage=1 00:22:36.675 --rc genhtml_legend=1 00:22:36.675 --rc geninfo_all_blocks=1 00:22:36.675 --rc geninfo_unexecuted_blocks=1 00:22:36.675 00:22:36.675 ' 00:22:36.675 15:46:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:36.675 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:36.675 --rc genhtml_branch_coverage=1 00:22:36.675 --rc genhtml_function_coverage=1 00:22:36.675 --rc genhtml_legend=1 00:22:36.675 --rc geninfo_all_blocks=1 00:22:36.675 --rc geninfo_unexecuted_blocks=1 00:22:36.675 00:22:36.675 ' 00:22:36.675 15:46:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:36.675 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:36.675 --rc genhtml_branch_coverage=1 00:22:36.675 --rc genhtml_function_coverage=1 00:22:36.675 --rc genhtml_legend=1 00:22:36.675 --rc geninfo_all_blocks=1 00:22:36.675 --rc geninfo_unexecuted_blocks=1 00:22:36.675 00:22:36.675 ' 00:22:36.675 15:46:27 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:36.675 15:46:27 -- nvmf/common.sh@7 -- # uname -s 00:22:36.675 15:46:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:36.675 15:46:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:36.675 15:46:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:36.675 15:46:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:36.675 15:46:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:36.675 15:46:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:36.675 15:46:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:36.675 15:46:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:36.675 15:46:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:36.675 15:46:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:36.675 15:46:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:36.675 15:46:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:36.675 15:46:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:36.675 15:46:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:36.675 15:46:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:36.675 15:46:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:36.675 15:46:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:36.675 15:46:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:36.675 15:46:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:36.675 15:46:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:36.675 15:46:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:36.675 15:46:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:36.675 15:46:27 -- paths/export.sh@5 -- # export PATH 00:22:36.675 15:46:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:36.675 15:46:27 -- nvmf/common.sh@46 -- # : 0 00:22:36.675 15:46:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:36.675 15:46:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:36.675 15:46:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:36.675 15:46:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:36.675 15:46:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:36.675 15:46:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:36.675 15:46:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:36.675 15:46:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:36.675 15:46:27 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:22:36.675 15:46:27 -- host/async_init.sh@14 -- # null_block_size=512 00:22:36.675 15:46:27 -- host/async_init.sh@15 -- # null_bdev=null0 00:22:36.675 15:46:27 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:22:36.675 15:46:27 -- host/async_init.sh@20 -- # uuidgen 00:22:36.675 15:46:27 -- host/async_init.sh@20 -- # tr -d - 00:22:36.675 15:46:27 -- host/async_init.sh@20 -- # nguid=381ebc62172b444d9e8b73c821875d6a 00:22:36.675 15:46:27 -- host/async_init.sh@22 -- # nvmftestinit 00:22:36.675 15:46:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:36.675 15:46:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:36.675 15:46:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:36.675 15:46:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:36.675 15:46:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:36.675 15:46:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:36.675 15:46:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:36.675 15:46:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:36.675 15:46:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:36.675 15:46:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:36.675 15:46:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:36.675 15:46:27 -- common/autotest_common.sh@10 -- # set +x 00:22:38.577 15:46:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:38.577 15:46:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:38.577 15:46:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:38.577 15:46:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:38.577 15:46:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:38.577 15:46:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:38.577 15:46:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:38.577 15:46:29 -- nvmf/common.sh@294 -- # net_devs=() 00:22:38.577 15:46:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:38.577 15:46:29 -- nvmf/common.sh@295 -- # e810=() 00:22:38.577 15:46:29 -- nvmf/common.sh@295 -- # local -ga e810 00:22:38.577 15:46:29 -- nvmf/common.sh@296 -- # x722=() 00:22:38.577 15:46:29 -- nvmf/common.sh@296 -- # local -ga x722 00:22:38.577 15:46:29 -- nvmf/common.sh@297 -- # mlx=() 00:22:38.577 15:46:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:38.577 15:46:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:38.577 15:46:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:38.577 15:46:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:38.577 15:46:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:38.577 15:46:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:38.577 15:46:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:38.577 15:46:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:38.577 15:46:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:38.578 15:46:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:38.578 15:46:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:38.578 15:46:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:38.578 15:46:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:38.578 15:46:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:38.578 15:46:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:38.578 15:46:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:38.578 15:46:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:38.578 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:38.578 15:46:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:38.578 15:46:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:38.578 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:38.578 15:46:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:38.578 15:46:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:38.578 15:46:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:38.578 15:46:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:38.578 15:46:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:38.578 15:46:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:38.578 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:38.578 15:46:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:38.578 15:46:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:38.578 15:46:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:38.578 15:46:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:38.578 15:46:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:38.578 15:46:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:38.578 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:38.578 15:46:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:38.578 15:46:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:38.578 15:46:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:38.578 15:46:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:38.578 15:46:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:38.578 15:46:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:38.578 15:46:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:38.578 15:46:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:38.578 15:46:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:38.578 15:46:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:38.578 15:46:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:38.578 15:46:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:38.578 15:46:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:38.578 15:46:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:38.578 15:46:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:38.578 15:46:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:38.578 15:46:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:38.578 15:46:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:38.578 15:46:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:38.578 15:46:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:38.578 15:46:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:38.578 15:46:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:38.578 15:46:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:38.578 15:46:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:38.578 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:38.578 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.168 ms 00:22:38.578 00:22:38.578 --- 10.0.0.2 ping statistics --- 00:22:38.578 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:38.578 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:22:38.578 15:46:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:38.578 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:38.578 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:22:38.578 00:22:38.578 --- 10.0.0.1 ping statistics --- 00:22:38.578 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:38.578 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:22:38.578 15:46:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:38.578 15:46:29 -- nvmf/common.sh@410 -- # return 0 00:22:38.578 15:46:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:38.578 15:46:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:38.578 15:46:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:38.578 15:46:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:38.578 15:46:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:38.578 15:46:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:38.578 15:46:29 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:22:38.578 15:46:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:38.578 15:46:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:38.578 15:46:29 -- common/autotest_common.sh@10 -- # set +x 00:22:38.578 15:46:29 -- nvmf/common.sh@469 -- # nvmfpid=939328 00:22:38.578 15:46:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:22:38.578 15:46:29 -- nvmf/common.sh@470 -- # waitforlisten 939328 00:22:38.578 15:46:29 -- common/autotest_common.sh@829 -- # '[' -z 939328 ']' 00:22:38.578 15:46:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:38.578 15:46:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:38.578 15:46:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:38.578 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:38.578 15:46:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:38.578 15:46:29 -- common/autotest_common.sh@10 -- # set +x 00:22:38.578 [2024-11-26 15:46:29.909194] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:38.578 [2024-11-26 15:46:29.909262] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:38.578 EAL: No free 2048 kB hugepages reported on node 1 00:22:38.578 [2024-11-26 15:46:29.974248] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:38.837 [2024-11-26 15:46:30.091966] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:38.837 [2024-11-26 15:46:30.092128] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:38.837 [2024-11-26 15:46:30.092152] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:38.837 [2024-11-26 15:46:30.092173] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:38.837 [2024-11-26 15:46:30.092211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:39.771 15:46:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:39.771 15:46:30 -- common/autotest_common.sh@862 -- # return 0 00:22:39.771 15:46:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:39.771 15:46:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:39.771 15:46:30 -- common/autotest_common.sh@10 -- # set +x 00:22:39.771 15:46:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:39.771 15:46:30 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:22:39.771 15:46:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.771 15:46:30 -- common/autotest_common.sh@10 -- # set +x 00:22:39.771 [2024-11-26 15:46:30.958318] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:39.771 15:46:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.771 15:46:30 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:22:39.771 15:46:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.771 15:46:30 -- common/autotest_common.sh@10 -- # set +x 00:22:39.771 null0 00:22:39.771 15:46:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.771 15:46:30 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:22:39.771 15:46:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.771 15:46:30 -- common/autotest_common.sh@10 -- # set +x 00:22:39.771 15:46:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.771 15:46:30 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:22:39.771 15:46:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.771 15:46:30 -- common/autotest_common.sh@10 -- # set +x 00:22:39.771 15:46:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.771 15:46:30 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 381ebc62172b444d9e8b73c821875d6a 00:22:39.771 15:46:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.771 15:46:30 -- common/autotest_common.sh@10 -- # set +x 00:22:39.771 15:46:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.771 15:46:30 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:22:39.771 15:46:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.771 15:46:30 -- common/autotest_common.sh@10 -- # set +x 00:22:39.771 [2024-11-26 15:46:30.998563] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:39.771 15:46:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.771 15:46:31 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:22:39.771 15:46:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.771 15:46:31 -- common/autotest_common.sh@10 -- # set +x 00:22:40.029 nvme0n1 00:22:40.029 15:46:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.029 15:46:31 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:40.029 15:46:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.029 15:46:31 -- common/autotest_common.sh@10 -- # set +x 00:22:40.029 [ 00:22:40.029 { 00:22:40.029 "name": "nvme0n1", 00:22:40.029 "aliases": [ 00:22:40.029 "381ebc62-172b-444d-9e8b-73c821875d6a" 00:22:40.029 ], 00:22:40.029 "product_name": "NVMe disk", 00:22:40.029 "block_size": 512, 00:22:40.029 "num_blocks": 2097152, 00:22:40.029 "uuid": "381ebc62-172b-444d-9e8b-73c821875d6a", 00:22:40.029 "assigned_rate_limits": { 00:22:40.029 "rw_ios_per_sec": 0, 00:22:40.029 "rw_mbytes_per_sec": 0, 00:22:40.029 "r_mbytes_per_sec": 0, 00:22:40.029 "w_mbytes_per_sec": 0 00:22:40.029 }, 00:22:40.029 "claimed": false, 00:22:40.029 "zoned": false, 00:22:40.029 "supported_io_types": { 00:22:40.029 "read": true, 00:22:40.029 "write": true, 00:22:40.029 "unmap": false, 00:22:40.029 "write_zeroes": true, 00:22:40.029 "flush": true, 00:22:40.029 "reset": true, 00:22:40.029 "compare": true, 00:22:40.029 "compare_and_write": true, 00:22:40.029 "abort": true, 00:22:40.029 "nvme_admin": true, 00:22:40.029 "nvme_io": true 00:22:40.029 }, 00:22:40.029 "driver_specific": { 00:22:40.029 "nvme": [ 00:22:40.029 { 00:22:40.029 "trid": { 00:22:40.029 "trtype": "TCP", 00:22:40.029 "adrfam": "IPv4", 00:22:40.029 "traddr": "10.0.0.2", 00:22:40.029 "trsvcid": "4420", 00:22:40.029 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:40.029 }, 00:22:40.029 "ctrlr_data": { 00:22:40.029 "cntlid": 1, 00:22:40.029 "vendor_id": "0x8086", 00:22:40.029 "model_number": "SPDK bdev Controller", 00:22:40.029 "serial_number": "00000000000000000000", 00:22:40.029 "firmware_revision": "24.01.1", 00:22:40.029 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:40.029 "oacs": { 00:22:40.029 "security": 0, 00:22:40.029 "format": 0, 00:22:40.029 "firmware": 0, 00:22:40.029 "ns_manage": 0 00:22:40.029 }, 00:22:40.029 "multi_ctrlr": true, 00:22:40.029 "ana_reporting": false 00:22:40.029 }, 00:22:40.029 "vs": { 00:22:40.029 "nvme_version": "1.3" 00:22:40.029 }, 00:22:40.029 "ns_data": { 00:22:40.029 "id": 1, 00:22:40.029 "can_share": true 00:22:40.029 } 00:22:40.029 } 00:22:40.029 ], 00:22:40.029 "mp_policy": "active_passive" 00:22:40.029 } 00:22:40.029 } 00:22:40.029 ] 00:22:40.029 15:46:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.029 15:46:31 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:22:40.029 15:46:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.029 15:46:31 -- common/autotest_common.sh@10 -- # set +x 00:22:40.029 [2024-11-26 15:46:31.247234] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:22:40.029 [2024-11-26 15:46:31.247320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcfcba0 (9): Bad file descriptor 00:22:40.029 [2024-11-26 15:46:31.379852] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:40.029 15:46:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.029 15:46:31 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:40.029 15:46:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.029 15:46:31 -- common/autotest_common.sh@10 -- # set +x 00:22:40.029 [ 00:22:40.029 { 00:22:40.029 "name": "nvme0n1", 00:22:40.029 "aliases": [ 00:22:40.029 "381ebc62-172b-444d-9e8b-73c821875d6a" 00:22:40.029 ], 00:22:40.029 "product_name": "NVMe disk", 00:22:40.029 "block_size": 512, 00:22:40.029 "num_blocks": 2097152, 00:22:40.029 "uuid": "381ebc62-172b-444d-9e8b-73c821875d6a", 00:22:40.029 "assigned_rate_limits": { 00:22:40.029 "rw_ios_per_sec": 0, 00:22:40.029 "rw_mbytes_per_sec": 0, 00:22:40.029 "r_mbytes_per_sec": 0, 00:22:40.029 "w_mbytes_per_sec": 0 00:22:40.029 }, 00:22:40.029 "claimed": false, 00:22:40.029 "zoned": false, 00:22:40.030 "supported_io_types": { 00:22:40.030 "read": true, 00:22:40.030 "write": true, 00:22:40.030 "unmap": false, 00:22:40.030 "write_zeroes": true, 00:22:40.030 "flush": true, 00:22:40.030 "reset": true, 00:22:40.030 "compare": true, 00:22:40.030 "compare_and_write": true, 00:22:40.030 "abort": true, 00:22:40.030 "nvme_admin": true, 00:22:40.030 "nvme_io": true 00:22:40.030 }, 00:22:40.030 "driver_specific": { 00:22:40.030 "nvme": [ 00:22:40.030 { 00:22:40.030 "trid": { 00:22:40.030 "trtype": "TCP", 00:22:40.030 "adrfam": "IPv4", 00:22:40.030 "traddr": "10.0.0.2", 00:22:40.030 "trsvcid": "4420", 00:22:40.030 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:40.030 }, 00:22:40.030 "ctrlr_data": { 00:22:40.030 "cntlid": 2, 00:22:40.030 "vendor_id": "0x8086", 00:22:40.030 "model_number": "SPDK bdev Controller", 00:22:40.030 "serial_number": "00000000000000000000", 00:22:40.030 "firmware_revision": "24.01.1", 00:22:40.030 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:40.030 "oacs": { 00:22:40.030 "security": 0, 00:22:40.030 "format": 0, 00:22:40.030 "firmware": 0, 00:22:40.030 "ns_manage": 0 00:22:40.030 }, 00:22:40.030 "multi_ctrlr": true, 00:22:40.030 "ana_reporting": false 00:22:40.030 }, 00:22:40.030 "vs": { 00:22:40.030 "nvme_version": "1.3" 00:22:40.030 }, 00:22:40.030 "ns_data": { 00:22:40.030 "id": 1, 00:22:40.030 "can_share": true 00:22:40.030 } 00:22:40.030 } 00:22:40.030 ], 00:22:40.030 "mp_policy": "active_passive" 00:22:40.030 } 00:22:40.030 } 00:22:40.030 ] 00:22:40.030 15:46:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.030 15:46:31 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:40.030 15:46:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.030 15:46:31 -- common/autotest_common.sh@10 -- # set +x 00:22:40.030 15:46:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.030 15:46:31 -- host/async_init.sh@53 -- # mktemp 00:22:40.030 15:46:31 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.3K3S1UtMSf 00:22:40.030 15:46:31 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:22:40.030 15:46:31 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.3K3S1UtMSf 00:22:40.030 15:46:31 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:22:40.030 15:46:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.030 15:46:31 -- common/autotest_common.sh@10 -- # set +x 00:22:40.030 15:46:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.030 15:46:31 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:22:40.030 15:46:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.030 15:46:31 -- common/autotest_common.sh@10 -- # set +x 00:22:40.030 [2024-11-26 15:46:31.427829] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:22:40.030 [2024-11-26 15:46:31.427950] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:40.030 15:46:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.030 15:46:31 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.3K3S1UtMSf 00:22:40.030 15:46:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.030 15:46:31 -- common/autotest_common.sh@10 -- # set +x 00:22:40.030 15:46:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.030 15:46:31 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.3K3S1UtMSf 00:22:40.030 15:46:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.030 15:46:31 -- common/autotest_common.sh@10 -- # set +x 00:22:40.030 [2024-11-26 15:46:31.443859] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:22:40.288 nvme0n1 00:22:40.288 15:46:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.288 15:46:31 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:40.288 15:46:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.288 15:46:31 -- common/autotest_common.sh@10 -- # set +x 00:22:40.288 [ 00:22:40.288 { 00:22:40.288 "name": "nvme0n1", 00:22:40.288 "aliases": [ 00:22:40.288 "381ebc62-172b-444d-9e8b-73c821875d6a" 00:22:40.288 ], 00:22:40.288 "product_name": "NVMe disk", 00:22:40.288 "block_size": 512, 00:22:40.288 "num_blocks": 2097152, 00:22:40.288 "uuid": "381ebc62-172b-444d-9e8b-73c821875d6a", 00:22:40.288 "assigned_rate_limits": { 00:22:40.288 "rw_ios_per_sec": 0, 00:22:40.288 "rw_mbytes_per_sec": 0, 00:22:40.288 "r_mbytes_per_sec": 0, 00:22:40.288 "w_mbytes_per_sec": 0 00:22:40.288 }, 00:22:40.288 "claimed": false, 00:22:40.288 "zoned": false, 00:22:40.288 "supported_io_types": { 00:22:40.288 "read": true, 00:22:40.288 "write": true, 00:22:40.288 "unmap": false, 00:22:40.288 "write_zeroes": true, 00:22:40.288 "flush": true, 00:22:40.288 "reset": true, 00:22:40.288 "compare": true, 00:22:40.288 "compare_and_write": true, 00:22:40.288 "abort": true, 00:22:40.288 "nvme_admin": true, 00:22:40.288 "nvme_io": true 00:22:40.288 }, 00:22:40.288 "driver_specific": { 00:22:40.288 "nvme": [ 00:22:40.288 { 00:22:40.288 "trid": { 00:22:40.288 "trtype": "TCP", 00:22:40.288 "adrfam": "IPv4", 00:22:40.288 "traddr": "10.0.0.2", 00:22:40.288 "trsvcid": "4421", 00:22:40.288 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:40.288 }, 00:22:40.288 "ctrlr_data": { 00:22:40.288 "cntlid": 3, 00:22:40.288 "vendor_id": "0x8086", 00:22:40.288 "model_number": "SPDK bdev Controller", 00:22:40.289 "serial_number": "00000000000000000000", 00:22:40.289 "firmware_revision": "24.01.1", 00:22:40.289 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:40.289 "oacs": { 00:22:40.289 "security": 0, 00:22:40.289 "format": 0, 00:22:40.289 "firmware": 0, 00:22:40.289 "ns_manage": 0 00:22:40.289 }, 00:22:40.289 "multi_ctrlr": true, 00:22:40.289 "ana_reporting": false 00:22:40.289 }, 00:22:40.289 "vs": { 00:22:40.289 "nvme_version": "1.3" 00:22:40.289 }, 00:22:40.289 "ns_data": { 00:22:40.289 "id": 1, 00:22:40.289 "can_share": true 00:22:40.289 } 00:22:40.289 } 00:22:40.289 ], 00:22:40.289 "mp_policy": "active_passive" 00:22:40.289 } 00:22:40.289 } 00:22:40.289 ] 00:22:40.289 15:46:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.289 15:46:31 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:40.289 15:46:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.289 15:46:31 -- common/autotest_common.sh@10 -- # set +x 00:22:40.289 15:46:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.289 15:46:31 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.3K3S1UtMSf 00:22:40.289 15:46:31 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:22:40.289 15:46:31 -- host/async_init.sh@78 -- # nvmftestfini 00:22:40.289 15:46:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:40.289 15:46:31 -- nvmf/common.sh@116 -- # sync 00:22:40.289 15:46:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:40.289 15:46:31 -- nvmf/common.sh@119 -- # set +e 00:22:40.289 15:46:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:40.289 15:46:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:40.289 rmmod nvme_tcp 00:22:40.289 rmmod nvme_fabrics 00:22:40.289 rmmod nvme_keyring 00:22:40.289 15:46:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:40.289 15:46:31 -- nvmf/common.sh@123 -- # set -e 00:22:40.289 15:46:31 -- nvmf/common.sh@124 -- # return 0 00:22:40.289 15:46:31 -- nvmf/common.sh@477 -- # '[' -n 939328 ']' 00:22:40.289 15:46:31 -- nvmf/common.sh@478 -- # killprocess 939328 00:22:40.289 15:46:31 -- common/autotest_common.sh@936 -- # '[' -z 939328 ']' 00:22:40.289 15:46:31 -- common/autotest_common.sh@940 -- # kill -0 939328 00:22:40.289 15:46:31 -- common/autotest_common.sh@941 -- # uname 00:22:40.289 15:46:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:40.289 15:46:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 939328 00:22:40.289 15:46:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:40.289 15:46:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:40.289 15:46:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 939328' 00:22:40.289 killing process with pid 939328 00:22:40.289 15:46:31 -- common/autotest_common.sh@955 -- # kill 939328 00:22:40.289 15:46:31 -- common/autotest_common.sh@960 -- # wait 939328 00:22:40.548 15:46:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:40.548 15:46:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:40.548 15:46:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:40.548 15:46:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:40.548 15:46:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:40.549 15:46:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:40.549 15:46:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:40.549 15:46:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:43.087 15:46:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:43.087 00:22:43.087 real 0m6.313s 00:22:43.087 user 0m3.156s 00:22:43.087 sys 0m1.835s 00:22:43.087 15:46:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:43.087 15:46:33 -- common/autotest_common.sh@10 -- # set +x 00:22:43.087 ************************************ 00:22:43.087 END TEST nvmf_async_init 00:22:43.087 ************************************ 00:22:43.087 15:46:33 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:22:43.087 15:46:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:43.087 15:46:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:43.087 15:46:33 -- common/autotest_common.sh@10 -- # set +x 00:22:43.087 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:22:43.087 ************************************ 00:22:43.087 START TEST dma 00:22:43.087 ************************************ 00:22:43.087 15:46:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:22:43.087 * Looking for test storage... 00:22:43.087 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:43.087 15:46:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:43.087 15:46:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:43.087 15:46:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:43.087 15:46:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:43.087 15:46:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:43.087 15:46:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:43.087 15:46:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:43.087 15:46:34 -- scripts/common.sh@335 -- # IFS=.-: 00:22:43.087 15:46:34 -- scripts/common.sh@335 -- # read -ra ver1 00:22:43.087 15:46:34 -- scripts/common.sh@336 -- # IFS=.-: 00:22:43.087 15:46:34 -- scripts/common.sh@336 -- # read -ra ver2 00:22:43.087 15:46:34 -- scripts/common.sh@337 -- # local 'op=<' 00:22:43.087 15:46:34 -- scripts/common.sh@339 -- # ver1_l=2 00:22:43.087 15:46:34 -- scripts/common.sh@340 -- # ver2_l=1 00:22:43.087 15:46:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:43.087 15:46:34 -- scripts/common.sh@343 -- # case "$op" in 00:22:43.087 15:46:34 -- scripts/common.sh@344 -- # : 1 00:22:43.087 15:46:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:43.087 15:46:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:43.087 15:46:34 -- scripts/common.sh@364 -- # decimal 1 00:22:43.087 15:46:34 -- scripts/common.sh@352 -- # local d=1 00:22:43.087 15:46:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:43.087 15:46:34 -- scripts/common.sh@354 -- # echo 1 00:22:43.088 15:46:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:43.088 15:46:34 -- scripts/common.sh@365 -- # decimal 2 00:22:43.088 15:46:34 -- scripts/common.sh@352 -- # local d=2 00:22:43.088 15:46:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:43.088 15:46:34 -- scripts/common.sh@354 -- # echo 2 00:22:43.088 15:46:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:43.088 15:46:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:43.088 15:46:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:43.088 15:46:34 -- scripts/common.sh@367 -- # return 0 00:22:43.088 15:46:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:43.088 15:46:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:43.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:43.088 --rc genhtml_branch_coverage=1 00:22:43.088 --rc genhtml_function_coverage=1 00:22:43.088 --rc genhtml_legend=1 00:22:43.088 --rc geninfo_all_blocks=1 00:22:43.088 --rc geninfo_unexecuted_blocks=1 00:22:43.088 00:22:43.088 ' 00:22:43.088 15:46:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:43.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:43.088 --rc genhtml_branch_coverage=1 00:22:43.088 --rc genhtml_function_coverage=1 00:22:43.088 --rc genhtml_legend=1 00:22:43.088 --rc geninfo_all_blocks=1 00:22:43.088 --rc geninfo_unexecuted_blocks=1 00:22:43.088 00:22:43.088 ' 00:22:43.088 15:46:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:43.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:43.088 --rc genhtml_branch_coverage=1 00:22:43.088 --rc genhtml_function_coverage=1 00:22:43.088 --rc genhtml_legend=1 00:22:43.088 --rc geninfo_all_blocks=1 00:22:43.088 --rc geninfo_unexecuted_blocks=1 00:22:43.088 00:22:43.088 ' 00:22:43.088 15:46:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:43.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:43.088 --rc genhtml_branch_coverage=1 00:22:43.088 --rc genhtml_function_coverage=1 00:22:43.088 --rc genhtml_legend=1 00:22:43.088 --rc geninfo_all_blocks=1 00:22:43.088 --rc geninfo_unexecuted_blocks=1 00:22:43.088 00:22:43.088 ' 00:22:43.088 15:46:34 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:43.088 15:46:34 -- nvmf/common.sh@7 -- # uname -s 00:22:43.088 15:46:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:43.088 15:46:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:43.088 15:46:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:43.088 15:46:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:43.088 15:46:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:43.088 15:46:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:43.088 15:46:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:43.088 15:46:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:43.088 15:46:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:43.088 15:46:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:43.088 15:46:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:43.088 15:46:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:43.088 15:46:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:43.088 15:46:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:43.088 15:46:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:43.088 15:46:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:43.088 15:46:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:43.088 15:46:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:43.088 15:46:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:43.088 15:46:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:43.088 15:46:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:43.088 15:46:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:43.088 15:46:34 -- paths/export.sh@5 -- # export PATH 00:22:43.088 15:46:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:43.088 15:46:34 -- nvmf/common.sh@46 -- # : 0 00:22:43.088 15:46:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:43.088 15:46:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:43.088 15:46:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:43.088 15:46:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:43.088 15:46:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:43.088 15:46:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:43.088 15:46:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:43.088 15:46:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:43.088 15:46:34 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:22:43.088 15:46:34 -- host/dma.sh@13 -- # exit 0 00:22:43.088 00:22:43.088 real 0m0.164s 00:22:43.088 user 0m0.120s 00:22:43.088 sys 0m0.053s 00:22:43.088 15:46:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:43.088 15:46:34 -- common/autotest_common.sh@10 -- # set +x 00:22:43.088 ************************************ 00:22:43.088 END TEST dma 00:22:43.088 ************************************ 00:22:43.088 15:46:34 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:22:43.088 15:46:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:43.088 15:46:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:43.088 15:46:34 -- common/autotest_common.sh@10 -- # set +x 00:22:43.088 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:22:43.088 ************************************ 00:22:43.088 START TEST nvmf_identify 00:22:43.088 ************************************ 00:22:43.088 15:46:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:22:43.088 * Looking for test storage... 00:22:43.088 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:43.088 15:46:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:43.088 15:46:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:43.088 15:46:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:43.088 15:46:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:43.088 15:46:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:43.088 15:46:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:43.088 15:46:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:43.088 15:46:34 -- scripts/common.sh@335 -- # IFS=.-: 00:22:43.088 15:46:34 -- scripts/common.sh@335 -- # read -ra ver1 00:22:43.088 15:46:34 -- scripts/common.sh@336 -- # IFS=.-: 00:22:43.088 15:46:34 -- scripts/common.sh@336 -- # read -ra ver2 00:22:43.089 15:46:34 -- scripts/common.sh@337 -- # local 'op=<' 00:22:43.089 15:46:34 -- scripts/common.sh@339 -- # ver1_l=2 00:22:43.089 15:46:34 -- scripts/common.sh@340 -- # ver2_l=1 00:22:43.089 15:46:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:43.089 15:46:34 -- scripts/common.sh@343 -- # case "$op" in 00:22:43.089 15:46:34 -- scripts/common.sh@344 -- # : 1 00:22:43.089 15:46:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:43.089 15:46:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:43.089 15:46:34 -- scripts/common.sh@364 -- # decimal 1 00:22:43.089 15:46:34 -- scripts/common.sh@352 -- # local d=1 00:22:43.089 15:46:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:43.089 15:46:34 -- scripts/common.sh@354 -- # echo 1 00:22:43.089 15:46:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:43.089 15:46:34 -- scripts/common.sh@365 -- # decimal 2 00:22:43.089 15:46:34 -- scripts/common.sh@352 -- # local d=2 00:22:43.089 15:46:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:43.089 15:46:34 -- scripts/common.sh@354 -- # echo 2 00:22:43.089 15:46:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:43.089 15:46:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:43.089 15:46:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:43.089 15:46:34 -- scripts/common.sh@367 -- # return 0 00:22:43.089 15:46:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:43.089 15:46:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:43.089 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:43.089 --rc genhtml_branch_coverage=1 00:22:43.089 --rc genhtml_function_coverage=1 00:22:43.089 --rc genhtml_legend=1 00:22:43.089 --rc geninfo_all_blocks=1 00:22:43.089 --rc geninfo_unexecuted_blocks=1 00:22:43.089 00:22:43.089 ' 00:22:43.089 15:46:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:43.089 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:43.089 --rc genhtml_branch_coverage=1 00:22:43.089 --rc genhtml_function_coverage=1 00:22:43.089 --rc genhtml_legend=1 00:22:43.089 --rc geninfo_all_blocks=1 00:22:43.089 --rc geninfo_unexecuted_blocks=1 00:22:43.089 00:22:43.089 ' 00:22:43.089 15:46:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:43.089 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:43.089 --rc genhtml_branch_coverage=1 00:22:43.089 --rc genhtml_function_coverage=1 00:22:43.089 --rc genhtml_legend=1 00:22:43.089 --rc geninfo_all_blocks=1 00:22:43.089 --rc geninfo_unexecuted_blocks=1 00:22:43.089 00:22:43.089 ' 00:22:43.089 15:46:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:43.089 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:43.089 --rc genhtml_branch_coverage=1 00:22:43.089 --rc genhtml_function_coverage=1 00:22:43.089 --rc genhtml_legend=1 00:22:43.089 --rc geninfo_all_blocks=1 00:22:43.089 --rc geninfo_unexecuted_blocks=1 00:22:43.089 00:22:43.089 ' 00:22:43.089 15:46:34 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:43.089 15:46:34 -- nvmf/common.sh@7 -- # uname -s 00:22:43.089 15:46:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:43.089 15:46:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:43.089 15:46:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:43.089 15:46:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:43.089 15:46:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:43.089 15:46:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:43.089 15:46:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:43.089 15:46:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:43.089 15:46:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:43.089 15:46:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:43.089 15:46:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:43.089 15:46:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:43.089 15:46:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:43.089 15:46:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:43.089 15:46:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:43.089 15:46:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:43.089 15:46:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:43.089 15:46:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:43.089 15:46:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:43.089 15:46:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:43.089 15:46:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:43.089 15:46:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:43.089 15:46:34 -- paths/export.sh@5 -- # export PATH 00:22:43.089 15:46:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:43.089 15:46:34 -- nvmf/common.sh@46 -- # : 0 00:22:43.089 15:46:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:43.089 15:46:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:43.089 15:46:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:43.089 15:46:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:43.089 15:46:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:43.089 15:46:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:43.089 15:46:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:43.089 15:46:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:43.089 15:46:34 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:43.089 15:46:34 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:43.089 15:46:34 -- host/identify.sh@14 -- # nvmftestinit 00:22:43.089 15:46:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:43.089 15:46:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:43.089 15:46:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:43.089 15:46:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:43.089 15:46:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:43.089 15:46:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:43.089 15:46:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:43.089 15:46:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:43.089 15:46:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:43.089 15:46:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:43.089 15:46:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:43.089 15:46:34 -- common/autotest_common.sh@10 -- # set +x 00:22:44.994 15:46:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:44.994 15:46:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:44.994 15:46:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:44.994 15:46:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:44.994 15:46:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:44.994 15:46:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:44.994 15:46:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:44.994 15:46:36 -- nvmf/common.sh@294 -- # net_devs=() 00:22:44.994 15:46:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:44.994 15:46:36 -- nvmf/common.sh@295 -- # e810=() 00:22:44.994 15:46:36 -- nvmf/common.sh@295 -- # local -ga e810 00:22:44.994 15:46:36 -- nvmf/common.sh@296 -- # x722=() 00:22:44.994 15:46:36 -- nvmf/common.sh@296 -- # local -ga x722 00:22:44.994 15:46:36 -- nvmf/common.sh@297 -- # mlx=() 00:22:44.994 15:46:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:44.994 15:46:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:44.994 15:46:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:44.994 15:46:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:44.994 15:46:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:44.994 15:46:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:44.994 15:46:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:44.994 15:46:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:44.994 15:46:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:44.994 15:46:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:44.994 15:46:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:44.994 15:46:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:44.994 15:46:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:44.994 15:46:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:44.994 15:46:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:44.994 15:46:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:44.994 15:46:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:44.994 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:44.994 15:46:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:44.994 15:46:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:44.994 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:44.994 15:46:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:44.994 15:46:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:44.994 15:46:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:44.994 15:46:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:44.994 15:46:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:44.994 15:46:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:44.994 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:44.994 15:46:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:44.994 15:46:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:44.994 15:46:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:44.994 15:46:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:44.994 15:46:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:44.994 15:46:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:44.994 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:44.994 15:46:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:44.994 15:46:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:44.994 15:46:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:44.994 15:46:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:44.994 15:46:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:44.994 15:46:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:44.994 15:46:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:44.994 15:46:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:44.994 15:46:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:44.994 15:46:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:44.994 15:46:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:44.994 15:46:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:44.994 15:46:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:44.994 15:46:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:44.994 15:46:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:44.994 15:46:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:44.994 15:46:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:44.994 15:46:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:44.994 15:46:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:44.994 15:46:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:44.994 15:46:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:44.994 15:46:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:44.994 15:46:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:44.994 15:46:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:44.994 15:46:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:44.994 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:44.994 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:22:44.994 00:22:44.994 --- 10.0.0.2 ping statistics --- 00:22:44.994 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:44.994 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:22:44.994 15:46:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:44.994 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:44.994 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:22:44.994 00:22:44.994 --- 10.0.0.1 ping statistics --- 00:22:44.994 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:44.994 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:22:44.994 15:46:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:44.994 15:46:36 -- nvmf/common.sh@410 -- # return 0 00:22:44.995 15:46:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:44.995 15:46:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:44.995 15:46:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:44.995 15:46:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:44.995 15:46:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:44.995 15:46:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:44.995 15:46:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:44.995 15:46:36 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:22:44.995 15:46:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:44.995 15:46:36 -- common/autotest_common.sh@10 -- # set +x 00:22:44.995 15:46:36 -- host/identify.sh@19 -- # nvmfpid=941577 00:22:44.995 15:46:36 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:44.995 15:46:36 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:44.995 15:46:36 -- host/identify.sh@23 -- # waitforlisten 941577 00:22:44.995 15:46:36 -- common/autotest_common.sh@829 -- # '[' -z 941577 ']' 00:22:44.995 15:46:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:44.995 15:46:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:44.995 15:46:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:44.995 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:44.995 15:46:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:44.995 15:46:36 -- common/autotest_common.sh@10 -- # set +x 00:22:45.253 [2024-11-26 15:46:36.446636] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:45.253 [2024-11-26 15:46:36.446737] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:45.253 EAL: No free 2048 kB hugepages reported on node 1 00:22:45.253 [2024-11-26 15:46:36.510702] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:45.253 [2024-11-26 15:46:36.622025] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:45.253 [2024-11-26 15:46:36.622176] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:45.253 [2024-11-26 15:46:36.622195] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:45.253 [2024-11-26 15:46:36.622209] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:45.253 [2024-11-26 15:46:36.622279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:45.253 [2024-11-26 15:46:36.622345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:45.253 [2024-11-26 15:46:36.622434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:45.253 [2024-11-26 15:46:36.622437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:46.189 15:46:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:46.189 15:46:37 -- common/autotest_common.sh@862 -- # return 0 00:22:46.189 15:46:37 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:46.189 15:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.189 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:22:46.189 [2024-11-26 15:46:37.442261] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:46.189 15:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.189 15:46:37 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:22:46.189 15:46:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:46.189 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:22:46.189 15:46:37 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:46.189 15:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.189 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:22:46.189 Malloc0 00:22:46.189 15:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.189 15:46:37 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:46.189 15:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.189 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:22:46.189 15:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.189 15:46:37 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:22:46.189 15:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.189 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:22:46.189 15:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.189 15:46:37 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:46.189 15:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.189 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:22:46.189 [2024-11-26 15:46:37.519569] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:46.189 15:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.189 15:46:37 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:22:46.189 15:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.189 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:22:46.189 15:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.189 15:46:37 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:22:46.189 15:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.189 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:22:46.189 [2024-11-26 15:46:37.535295] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:46.189 [ 00:22:46.189 { 00:22:46.189 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:46.189 "subtype": "Discovery", 00:22:46.189 "listen_addresses": [ 00:22:46.189 { 00:22:46.189 "transport": "TCP", 00:22:46.189 "trtype": "TCP", 00:22:46.189 "adrfam": "IPv4", 00:22:46.189 "traddr": "10.0.0.2", 00:22:46.189 "trsvcid": "4420" 00:22:46.189 } 00:22:46.189 ], 00:22:46.189 "allow_any_host": true, 00:22:46.189 "hosts": [] 00:22:46.189 }, 00:22:46.189 { 00:22:46.189 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:46.189 "subtype": "NVMe", 00:22:46.189 "listen_addresses": [ 00:22:46.189 { 00:22:46.189 "transport": "TCP", 00:22:46.189 "trtype": "TCP", 00:22:46.189 "adrfam": "IPv4", 00:22:46.189 "traddr": "10.0.0.2", 00:22:46.189 "trsvcid": "4420" 00:22:46.189 } 00:22:46.189 ], 00:22:46.189 "allow_any_host": true, 00:22:46.189 "hosts": [], 00:22:46.189 "serial_number": "SPDK00000000000001", 00:22:46.189 "model_number": "SPDK bdev Controller", 00:22:46.189 "max_namespaces": 32, 00:22:46.189 "min_cntlid": 1, 00:22:46.189 "max_cntlid": 65519, 00:22:46.189 "namespaces": [ 00:22:46.189 { 00:22:46.189 "nsid": 1, 00:22:46.189 "bdev_name": "Malloc0", 00:22:46.189 "name": "Malloc0", 00:22:46.189 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:22:46.189 "eui64": "ABCDEF0123456789", 00:22:46.189 "uuid": "422819f0-2c2c-4c68-9520-e527bd9660c1" 00:22:46.189 } 00:22:46.189 ] 00:22:46.189 } 00:22:46.189 ] 00:22:46.189 15:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.189 15:46:37 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:22:46.189 [2024-11-26 15:46:37.560811] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:46.189 [2024-11-26 15:46:37.560853] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid941727 ] 00:22:46.189 EAL: No free 2048 kB hugepages reported on node 1 00:22:46.189 [2024-11-26 15:46:37.594269] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:22:46.189 [2024-11-26 15:46:37.594329] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:22:46.189 [2024-11-26 15:46:37.594340] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:22:46.189 [2024-11-26 15:46:37.594357] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:22:46.189 [2024-11-26 15:46:37.594369] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:22:46.189 [2024-11-26 15:46:37.597752] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:22:46.189 [2024-11-26 15:46:37.597815] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xc8ae10 0 00:22:46.189 [2024-11-26 15:46:37.605699] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:22:46.189 [2024-11-26 15:46:37.605722] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:22:46.189 [2024-11-26 15:46:37.605731] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:22:46.189 [2024-11-26 15:46:37.605737] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:22:46.189 [2024-11-26 15:46:37.605789] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.189 [2024-11-26 15:46:37.605802] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.189 [2024-11-26 15:46:37.605810] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc8ae10) 00:22:46.189 [2024-11-26 15:46:37.605829] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:46.189 [2024-11-26 15:46:37.605857] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0ab30, cid 0, qid 0 00:22:46.189 [2024-11-26 15:46:37.613704] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.189 [2024-11-26 15:46:37.613721] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.189 [2024-11-26 15:46:37.613744] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.189 [2024-11-26 15:46:37.613751] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0ab30) on tqpair=0xc8ae10 00:22:46.189 [2024-11-26 15:46:37.613772] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:46.189 [2024-11-26 15:46:37.613783] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:22:46.189 [2024-11-26 15:46:37.613793] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:22:46.189 [2024-11-26 15:46:37.613814] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.189 [2024-11-26 15:46:37.613822] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.189 [2024-11-26 15:46:37.613829] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc8ae10) 00:22:46.189 [2024-11-26 15:46:37.613840] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.189 [2024-11-26 15:46:37.613864] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0ab30, cid 0, qid 0 00:22:46.189 [2024-11-26 15:46:37.614011] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.189 [2024-11-26 15:46:37.614026] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.189 [2024-11-26 15:46:37.614033] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.189 [2024-11-26 15:46:37.614040] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0ab30) on tqpair=0xc8ae10 00:22:46.189 [2024-11-26 15:46:37.614060] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:22:46.189 [2024-11-26 15:46:37.614072] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:22:46.189 [2024-11-26 15:46:37.614091] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.189 [2024-11-26 15:46:37.614099] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.614105] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc8ae10) 00:22:46.190 [2024-11-26 15:46:37.614116] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.190 [2024-11-26 15:46:37.614137] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0ab30, cid 0, qid 0 00:22:46.190 [2024-11-26 15:46:37.614287] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.190 [2024-11-26 15:46:37.614302] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.190 [2024-11-26 15:46:37.614309] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.614315] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0ab30) on tqpair=0xc8ae10 00:22:46.190 [2024-11-26 15:46:37.614324] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:22:46.190 [2024-11-26 15:46:37.614338] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:22:46.190 [2024-11-26 15:46:37.614350] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.614357] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.614363] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc8ae10) 00:22:46.190 [2024-11-26 15:46:37.614373] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.190 [2024-11-26 15:46:37.614394] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0ab30, cid 0, qid 0 00:22:46.190 [2024-11-26 15:46:37.614544] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.190 [2024-11-26 15:46:37.614559] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.190 [2024-11-26 15:46:37.614565] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.614572] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0ab30) on tqpair=0xc8ae10 00:22:46.190 [2024-11-26 15:46:37.614581] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:46.190 [2024-11-26 15:46:37.614597] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.614605] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.614612] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc8ae10) 00:22:46.190 [2024-11-26 15:46:37.614622] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.190 [2024-11-26 15:46:37.614643] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0ab30, cid 0, qid 0 00:22:46.190 [2024-11-26 15:46:37.614803] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.190 [2024-11-26 15:46:37.614817] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.190 [2024-11-26 15:46:37.614823] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.614830] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0ab30) on tqpair=0xc8ae10 00:22:46.190 [2024-11-26 15:46:37.614838] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:22:46.190 [2024-11-26 15:46:37.614847] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:22:46.190 [2024-11-26 15:46:37.614859] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:46.190 [2024-11-26 15:46:37.614973] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:22:46.190 [2024-11-26 15:46:37.614990] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:46.190 [2024-11-26 15:46:37.615019] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.615027] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.615033] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc8ae10) 00:22:46.190 [2024-11-26 15:46:37.615042] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.190 [2024-11-26 15:46:37.615063] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0ab30, cid 0, qid 0 00:22:46.190 [2024-11-26 15:46:37.615207] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.190 [2024-11-26 15:46:37.615223] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.190 [2024-11-26 15:46:37.615230] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.615236] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0ab30) on tqpair=0xc8ae10 00:22:46.190 [2024-11-26 15:46:37.615244] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:46.190 [2024-11-26 15:46:37.615260] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.615269] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.615275] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc8ae10) 00:22:46.190 [2024-11-26 15:46:37.615285] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.190 [2024-11-26 15:46:37.615306] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0ab30, cid 0, qid 0 00:22:46.190 [2024-11-26 15:46:37.615426] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.190 [2024-11-26 15:46:37.615441] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.190 [2024-11-26 15:46:37.615448] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.615455] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0ab30) on tqpair=0xc8ae10 00:22:46.190 [2024-11-26 15:46:37.615463] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:46.190 [2024-11-26 15:46:37.615471] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:22:46.190 [2024-11-26 15:46:37.615484] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:22:46.190 [2024-11-26 15:46:37.615499] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:22:46.190 [2024-11-26 15:46:37.615515] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.615522] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.615528] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc8ae10) 00:22:46.190 [2024-11-26 15:46:37.615539] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.190 [2024-11-26 15:46:37.615560] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0ab30, cid 0, qid 0 00:22:46.190 [2024-11-26 15:46:37.615737] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:46.190 [2024-11-26 15:46:37.615754] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:46.190 [2024-11-26 15:46:37.615761] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.615771] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc8ae10): datao=0, datal=4096, cccid=0 00:22:46.190 [2024-11-26 15:46:37.615781] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xd0ab30) on tqpair(0xc8ae10): expected_datao=0, payload_size=4096 00:22:46.190 [2024-11-26 15:46:37.615794] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.615803] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.615852] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.190 [2024-11-26 15:46:37.615864] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.190 [2024-11-26 15:46:37.615870] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.615877] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0ab30) on tqpair=0xc8ae10 00:22:46.190 [2024-11-26 15:46:37.615889] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:22:46.190 [2024-11-26 15:46:37.615898] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:22:46.190 [2024-11-26 15:46:37.615906] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:22:46.190 [2024-11-26 15:46:37.615915] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:22:46.190 [2024-11-26 15:46:37.615922] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:22:46.190 [2024-11-26 15:46:37.615930] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:22:46.190 [2024-11-26 15:46:37.615949] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:22:46.190 [2024-11-26 15:46:37.615963] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.615970] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.615976] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc8ae10) 00:22:46.190 [2024-11-26 15:46:37.615987] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:46.190 [2024-11-26 15:46:37.616026] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0ab30, cid 0, qid 0 00:22:46.190 [2024-11-26 15:46:37.616227] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.190 [2024-11-26 15:46:37.616243] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.190 [2024-11-26 15:46:37.616249] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.616255] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0ab30) on tqpair=0xc8ae10 00:22:46.190 [2024-11-26 15:46:37.616269] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.616276] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.616282] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc8ae10) 00:22:46.190 [2024-11-26 15:46:37.616292] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:46.190 [2024-11-26 15:46:37.616302] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.616309] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.616315] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xc8ae10) 00:22:46.190 [2024-11-26 15:46:37.616323] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:46.190 [2024-11-26 15:46:37.616333] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.190 [2024-11-26 15:46:37.616340] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.616350] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xc8ae10) 00:22:46.191 [2024-11-26 15:46:37.616359] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:46.191 [2024-11-26 15:46:37.616369] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.616376] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.616382] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.191 [2024-11-26 15:46:37.616406] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:46.191 [2024-11-26 15:46:37.616415] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:22:46.191 [2024-11-26 15:46:37.616434] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:46.191 [2024-11-26 15:46:37.616446] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.616468] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.616474] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc8ae10) 00:22:46.191 [2024-11-26 15:46:37.616484] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.191 [2024-11-26 15:46:37.616505] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0ab30, cid 0, qid 0 00:22:46.191 [2024-11-26 15:46:37.616530] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0ac90, cid 1, qid 0 00:22:46.191 [2024-11-26 15:46:37.616538] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0adf0, cid 2, qid 0 00:22:46.191 [2024-11-26 15:46:37.616545] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.191 [2024-11-26 15:46:37.616552] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0b0b0, cid 4, qid 0 00:22:46.191 [2024-11-26 15:46:37.616750] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.191 [2024-11-26 15:46:37.616765] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.191 [2024-11-26 15:46:37.616772] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.616778] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0b0b0) on tqpair=0xc8ae10 00:22:46.191 [2024-11-26 15:46:37.616788] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:22:46.191 [2024-11-26 15:46:37.616796] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:22:46.191 [2024-11-26 15:46:37.616814] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.616823] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.616829] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc8ae10) 00:22:46.191 [2024-11-26 15:46:37.616840] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.191 [2024-11-26 15:46:37.616860] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0b0b0, cid 4, qid 0 00:22:46.191 [2024-11-26 15:46:37.616995] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:46.191 [2024-11-26 15:46:37.617010] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:46.191 [2024-11-26 15:46:37.617017] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.617023] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc8ae10): datao=0, datal=4096, cccid=4 00:22:46.191 [2024-11-26 15:46:37.617030] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xd0b0b0) on tqpair(0xc8ae10): expected_datao=0, payload_size=4096 00:22:46.191 [2024-11-26 15:46:37.617069] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.617079] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.617178] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.191 [2024-11-26 15:46:37.617189] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.191 [2024-11-26 15:46:37.617196] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.617202] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0b0b0) on tqpair=0xc8ae10 00:22:46.191 [2024-11-26 15:46:37.617221] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:22:46.191 [2024-11-26 15:46:37.617258] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.617269] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.617275] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc8ae10) 00:22:46.191 [2024-11-26 15:46:37.617286] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.191 [2024-11-26 15:46:37.617297] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.617304] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.617310] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xc8ae10) 00:22:46.191 [2024-11-26 15:46:37.617319] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:46.191 [2024-11-26 15:46:37.617345] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0b0b0, cid 4, qid 0 00:22:46.191 [2024-11-26 15:46:37.617357] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0b210, cid 5, qid 0 00:22:46.191 [2024-11-26 15:46:37.617526] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:46.191 [2024-11-26 15:46:37.617541] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:46.191 [2024-11-26 15:46:37.617548] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.617554] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc8ae10): datao=0, datal=1024, cccid=4 00:22:46.191 [2024-11-26 15:46:37.617562] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xd0b0b0) on tqpair(0xc8ae10): expected_datao=0, payload_size=1024 00:22:46.191 [2024-11-26 15:46:37.617572] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.617579] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.617588] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.191 [2024-11-26 15:46:37.617597] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.191 [2024-11-26 15:46:37.617603] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.191 [2024-11-26 15:46:37.617609] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0b210) on tqpair=0xc8ae10 00:22:46.452 [2024-11-26 15:46:37.658898] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.452 [2024-11-26 15:46:37.658917] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.452 [2024-11-26 15:46:37.658925] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.452 [2024-11-26 15:46:37.658932] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0b0b0) on tqpair=0xc8ae10 00:22:46.452 [2024-11-26 15:46:37.658949] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.452 [2024-11-26 15:46:37.658958] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.452 [2024-11-26 15:46:37.658964] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc8ae10) 00:22:46.452 [2024-11-26 15:46:37.658975] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.452 [2024-11-26 15:46:37.659011] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0b0b0, cid 4, qid 0 00:22:46.452 [2024-11-26 15:46:37.659220] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:46.452 [2024-11-26 15:46:37.659235] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:46.452 [2024-11-26 15:46:37.659242] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:46.452 [2024-11-26 15:46:37.659249] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc8ae10): datao=0, datal=3072, cccid=4 00:22:46.452 [2024-11-26 15:46:37.659256] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xd0b0b0) on tqpair(0xc8ae10): expected_datao=0, payload_size=3072 00:22:46.452 [2024-11-26 15:46:37.659267] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:46.452 [2024-11-26 15:46:37.659275] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:46.452 [2024-11-26 15:46:37.659286] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.452 [2024-11-26 15:46:37.659296] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.452 [2024-11-26 15:46:37.659303] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.452 [2024-11-26 15:46:37.659309] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0b0b0) on tqpair=0xc8ae10 00:22:46.452 [2024-11-26 15:46:37.659324] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.452 [2024-11-26 15:46:37.659333] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.452 [2024-11-26 15:46:37.659339] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc8ae10) 00:22:46.452 [2024-11-26 15:46:37.659350] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.452 [2024-11-26 15:46:37.659378] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0b0b0, cid 4, qid 0 00:22:46.452 [2024-11-26 15:46:37.659499] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:46.452 [2024-11-26 15:46:37.659514] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:46.452 [2024-11-26 15:46:37.659521] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:46.452 [2024-11-26 15:46:37.659527] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc8ae10): datao=0, datal=8, cccid=4 00:22:46.452 [2024-11-26 15:46:37.659534] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xd0b0b0) on tqpair(0xc8ae10): expected_datao=0, payload_size=8 00:22:46.452 [2024-11-26 15:46:37.659545] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:46.452 [2024-11-26 15:46:37.659552] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:46.452 [2024-11-26 15:46:37.702700] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.452 [2024-11-26 15:46:37.702718] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.452 [2024-11-26 15:46:37.702725] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.452 [2024-11-26 15:46:37.702747] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0b0b0) on tqpair=0xc8ae10 00:22:46.452 ===================================================== 00:22:46.452 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:22:46.452 ===================================================== 00:22:46.452 Controller Capabilities/Features 00:22:46.452 ================================ 00:22:46.453 Vendor ID: 0000 00:22:46.453 Subsystem Vendor ID: 0000 00:22:46.453 Serial Number: .................... 00:22:46.453 Model Number: ........................................ 00:22:46.453 Firmware Version: 24.01.1 00:22:46.453 Recommended Arb Burst: 0 00:22:46.453 IEEE OUI Identifier: 00 00 00 00:22:46.453 Multi-path I/O 00:22:46.453 May have multiple subsystem ports: No 00:22:46.453 May have multiple controllers: No 00:22:46.453 Associated with SR-IOV VF: No 00:22:46.453 Max Data Transfer Size: 131072 00:22:46.453 Max Number of Namespaces: 0 00:22:46.453 Max Number of I/O Queues: 1024 00:22:46.453 NVMe Specification Version (VS): 1.3 00:22:46.453 NVMe Specification Version (Identify): 1.3 00:22:46.453 Maximum Queue Entries: 128 00:22:46.453 Contiguous Queues Required: Yes 00:22:46.453 Arbitration Mechanisms Supported 00:22:46.453 Weighted Round Robin: Not Supported 00:22:46.453 Vendor Specific: Not Supported 00:22:46.453 Reset Timeout: 15000 ms 00:22:46.453 Doorbell Stride: 4 bytes 00:22:46.453 NVM Subsystem Reset: Not Supported 00:22:46.453 Command Sets Supported 00:22:46.453 NVM Command Set: Supported 00:22:46.453 Boot Partition: Not Supported 00:22:46.453 Memory Page Size Minimum: 4096 bytes 00:22:46.453 Memory Page Size Maximum: 4096 bytes 00:22:46.453 Persistent Memory Region: Not Supported 00:22:46.453 Optional Asynchronous Events Supported 00:22:46.453 Namespace Attribute Notices: Not Supported 00:22:46.453 Firmware Activation Notices: Not Supported 00:22:46.453 ANA Change Notices: Not Supported 00:22:46.453 PLE Aggregate Log Change Notices: Not Supported 00:22:46.453 LBA Status Info Alert Notices: Not Supported 00:22:46.453 EGE Aggregate Log Change Notices: Not Supported 00:22:46.453 Normal NVM Subsystem Shutdown event: Not Supported 00:22:46.453 Zone Descriptor Change Notices: Not Supported 00:22:46.453 Discovery Log Change Notices: Supported 00:22:46.453 Controller Attributes 00:22:46.453 128-bit Host Identifier: Not Supported 00:22:46.453 Non-Operational Permissive Mode: Not Supported 00:22:46.453 NVM Sets: Not Supported 00:22:46.453 Read Recovery Levels: Not Supported 00:22:46.453 Endurance Groups: Not Supported 00:22:46.453 Predictable Latency Mode: Not Supported 00:22:46.453 Traffic Based Keep ALive: Not Supported 00:22:46.453 Namespace Granularity: Not Supported 00:22:46.453 SQ Associations: Not Supported 00:22:46.453 UUID List: Not Supported 00:22:46.453 Multi-Domain Subsystem: Not Supported 00:22:46.453 Fixed Capacity Management: Not Supported 00:22:46.453 Variable Capacity Management: Not Supported 00:22:46.453 Delete Endurance Group: Not Supported 00:22:46.453 Delete NVM Set: Not Supported 00:22:46.453 Extended LBA Formats Supported: Not Supported 00:22:46.453 Flexible Data Placement Supported: Not Supported 00:22:46.453 00:22:46.453 Controller Memory Buffer Support 00:22:46.453 ================================ 00:22:46.453 Supported: No 00:22:46.453 00:22:46.453 Persistent Memory Region Support 00:22:46.453 ================================ 00:22:46.453 Supported: No 00:22:46.453 00:22:46.453 Admin Command Set Attributes 00:22:46.453 ============================ 00:22:46.453 Security Send/Receive: Not Supported 00:22:46.453 Format NVM: Not Supported 00:22:46.453 Firmware Activate/Download: Not Supported 00:22:46.453 Namespace Management: Not Supported 00:22:46.453 Device Self-Test: Not Supported 00:22:46.453 Directives: Not Supported 00:22:46.453 NVMe-MI: Not Supported 00:22:46.453 Virtualization Management: Not Supported 00:22:46.453 Doorbell Buffer Config: Not Supported 00:22:46.453 Get LBA Status Capability: Not Supported 00:22:46.453 Command & Feature Lockdown Capability: Not Supported 00:22:46.453 Abort Command Limit: 1 00:22:46.453 Async Event Request Limit: 4 00:22:46.453 Number of Firmware Slots: N/A 00:22:46.453 Firmware Slot 1 Read-Only: N/A 00:22:46.453 Firmware Activation Without Reset: N/A 00:22:46.453 Multiple Update Detection Support: N/A 00:22:46.453 Firmware Update Granularity: No Information Provided 00:22:46.453 Per-Namespace SMART Log: No 00:22:46.453 Asymmetric Namespace Access Log Page: Not Supported 00:22:46.453 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:22:46.453 Command Effects Log Page: Not Supported 00:22:46.453 Get Log Page Extended Data: Supported 00:22:46.453 Telemetry Log Pages: Not Supported 00:22:46.453 Persistent Event Log Pages: Not Supported 00:22:46.453 Supported Log Pages Log Page: May Support 00:22:46.453 Commands Supported & Effects Log Page: Not Supported 00:22:46.453 Feature Identifiers & Effects Log Page:May Support 00:22:46.453 NVMe-MI Commands & Effects Log Page: May Support 00:22:46.453 Data Area 4 for Telemetry Log: Not Supported 00:22:46.453 Error Log Page Entries Supported: 128 00:22:46.453 Keep Alive: Not Supported 00:22:46.453 00:22:46.453 NVM Command Set Attributes 00:22:46.453 ========================== 00:22:46.453 Submission Queue Entry Size 00:22:46.453 Max: 1 00:22:46.453 Min: 1 00:22:46.453 Completion Queue Entry Size 00:22:46.453 Max: 1 00:22:46.453 Min: 1 00:22:46.453 Number of Namespaces: 0 00:22:46.453 Compare Command: Not Supported 00:22:46.453 Write Uncorrectable Command: Not Supported 00:22:46.453 Dataset Management Command: Not Supported 00:22:46.453 Write Zeroes Command: Not Supported 00:22:46.453 Set Features Save Field: Not Supported 00:22:46.453 Reservations: Not Supported 00:22:46.453 Timestamp: Not Supported 00:22:46.453 Copy: Not Supported 00:22:46.453 Volatile Write Cache: Not Present 00:22:46.453 Atomic Write Unit (Normal): 1 00:22:46.453 Atomic Write Unit (PFail): 1 00:22:46.453 Atomic Compare & Write Unit: 1 00:22:46.453 Fused Compare & Write: Supported 00:22:46.453 Scatter-Gather List 00:22:46.453 SGL Command Set: Supported 00:22:46.453 SGL Keyed: Supported 00:22:46.453 SGL Bit Bucket Descriptor: Not Supported 00:22:46.453 SGL Metadata Pointer: Not Supported 00:22:46.453 Oversized SGL: Not Supported 00:22:46.453 SGL Metadata Address: Not Supported 00:22:46.453 SGL Offset: Supported 00:22:46.453 Transport SGL Data Block: Not Supported 00:22:46.453 Replay Protected Memory Block: Not Supported 00:22:46.453 00:22:46.453 Firmware Slot Information 00:22:46.453 ========================= 00:22:46.453 Active slot: 0 00:22:46.453 00:22:46.453 00:22:46.453 Error Log 00:22:46.453 ========= 00:22:46.453 00:22:46.453 Active Namespaces 00:22:46.453 ================= 00:22:46.453 Discovery Log Page 00:22:46.453 ================== 00:22:46.453 Generation Counter: 2 00:22:46.453 Number of Records: 2 00:22:46.453 Record Format: 0 00:22:46.453 00:22:46.453 Discovery Log Entry 0 00:22:46.453 ---------------------- 00:22:46.453 Transport Type: 3 (TCP) 00:22:46.453 Address Family: 1 (IPv4) 00:22:46.453 Subsystem Type: 3 (Current Discovery Subsystem) 00:22:46.453 Entry Flags: 00:22:46.453 Duplicate Returned Information: 1 00:22:46.453 Explicit Persistent Connection Support for Discovery: 1 00:22:46.453 Transport Requirements: 00:22:46.453 Secure Channel: Not Required 00:22:46.453 Port ID: 0 (0x0000) 00:22:46.453 Controller ID: 65535 (0xffff) 00:22:46.453 Admin Max SQ Size: 128 00:22:46.453 Transport Service Identifier: 4420 00:22:46.453 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:22:46.453 Transport Address: 10.0.0.2 00:22:46.453 Discovery Log Entry 1 00:22:46.453 ---------------------- 00:22:46.453 Transport Type: 3 (TCP) 00:22:46.453 Address Family: 1 (IPv4) 00:22:46.453 Subsystem Type: 2 (NVM Subsystem) 00:22:46.453 Entry Flags: 00:22:46.453 Duplicate Returned Information: 0 00:22:46.453 Explicit Persistent Connection Support for Discovery: 0 00:22:46.453 Transport Requirements: 00:22:46.453 Secure Channel: Not Required 00:22:46.453 Port ID: 0 (0x0000) 00:22:46.453 Controller ID: 65535 (0xffff) 00:22:46.453 Admin Max SQ Size: 128 00:22:46.453 Transport Service Identifier: 4420 00:22:46.453 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:22:46.453 Transport Address: 10.0.0.2 [2024-11-26 15:46:37.702869] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:22:46.453 [2024-11-26 15:46:37.702896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:46.453 [2024-11-26 15:46:37.702908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:46.453 [2024-11-26 15:46:37.702918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:46.453 [2024-11-26 15:46:37.702927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:46.454 [2024-11-26 15:46:37.702941] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.702949] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.702959] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.454 [2024-11-26 15:46:37.702971] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.454 [2024-11-26 15:46:37.702996] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.454 [2024-11-26 15:46:37.703097] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.454 [2024-11-26 15:46:37.703113] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.454 [2024-11-26 15:46:37.703120] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.703126] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.454 [2024-11-26 15:46:37.703138] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.703145] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.703152] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.454 [2024-11-26 15:46:37.703162] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.454 [2024-11-26 15:46:37.703189] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.454 [2024-11-26 15:46:37.703360] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.454 [2024-11-26 15:46:37.703375] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.454 [2024-11-26 15:46:37.703382] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.703388] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.454 [2024-11-26 15:46:37.703397] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:22:46.454 [2024-11-26 15:46:37.703405] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:22:46.454 [2024-11-26 15:46:37.703421] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.703429] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.703436] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.454 [2024-11-26 15:46:37.703446] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.454 [2024-11-26 15:46:37.703481] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.454 [2024-11-26 15:46:37.703695] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.454 [2024-11-26 15:46:37.703710] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.454 [2024-11-26 15:46:37.703716] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.703723] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.454 [2024-11-26 15:46:37.703740] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.703748] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.703755] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.454 [2024-11-26 15:46:37.703765] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.454 [2024-11-26 15:46:37.703786] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.454 [2024-11-26 15:46:37.703885] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.454 [2024-11-26 15:46:37.703900] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.454 [2024-11-26 15:46:37.703906] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.703913] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.454 [2024-11-26 15:46:37.703933] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.703943] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.703949] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.454 [2024-11-26 15:46:37.703959] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.454 [2024-11-26 15:46:37.703980] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.454 [2024-11-26 15:46:37.704078] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.454 [2024-11-26 15:46:37.704093] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.454 [2024-11-26 15:46:37.704099] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704106] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.454 [2024-11-26 15:46:37.704122] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704131] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704137] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.454 [2024-11-26 15:46:37.704147] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.454 [2024-11-26 15:46:37.704168] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.454 [2024-11-26 15:46:37.704294] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.454 [2024-11-26 15:46:37.704306] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.454 [2024-11-26 15:46:37.704312] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704318] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.454 [2024-11-26 15:46:37.704334] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704342] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704349] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.454 [2024-11-26 15:46:37.704359] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.454 [2024-11-26 15:46:37.704379] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.454 [2024-11-26 15:46:37.704532] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.454 [2024-11-26 15:46:37.704544] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.454 [2024-11-26 15:46:37.704551] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704557] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.454 [2024-11-26 15:46:37.704573] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704582] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704588] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.454 [2024-11-26 15:46:37.704598] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.454 [2024-11-26 15:46:37.704618] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.454 [2024-11-26 15:46:37.704724] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.454 [2024-11-26 15:46:37.704739] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.454 [2024-11-26 15:46:37.704746] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704752] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.454 [2024-11-26 15:46:37.704769] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704781] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704788] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.454 [2024-11-26 15:46:37.704799] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.454 [2024-11-26 15:46:37.704820] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.454 [2024-11-26 15:46:37.704918] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.454 [2024-11-26 15:46:37.704932] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.454 [2024-11-26 15:46:37.704939] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704945] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.454 [2024-11-26 15:46:37.704962] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704970] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.704976] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.454 [2024-11-26 15:46:37.704987] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.454 [2024-11-26 15:46:37.705007] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.454 [2024-11-26 15:46:37.705121] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.454 [2024-11-26 15:46:37.705136] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.454 [2024-11-26 15:46:37.705143] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.705149] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.454 [2024-11-26 15:46:37.705165] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.705174] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.705180] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.454 [2024-11-26 15:46:37.705190] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.454 [2024-11-26 15:46:37.705211] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.454 [2024-11-26 15:46:37.705321] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.454 [2024-11-26 15:46:37.705336] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.454 [2024-11-26 15:46:37.705343] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.705349] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.454 [2024-11-26 15:46:37.705365] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.705374] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.454 [2024-11-26 15:46:37.705380] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.454 [2024-11-26 15:46:37.705390] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.454 [2024-11-26 15:46:37.705411] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.455 [2024-11-26 15:46:37.705525] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.455 [2024-11-26 15:46:37.705539] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.455 [2024-11-26 15:46:37.705546] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.705552] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.455 [2024-11-26 15:46:37.705568] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.705577] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.705587] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.455 [2024-11-26 15:46:37.705598] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.455 [2024-11-26 15:46:37.705619] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.455 [2024-11-26 15:46:37.705725] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.455 [2024-11-26 15:46:37.705740] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.455 [2024-11-26 15:46:37.705747] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.705753] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.455 [2024-11-26 15:46:37.705769] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.705778] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.705784] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.455 [2024-11-26 15:46:37.705795] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.455 [2024-11-26 15:46:37.705815] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.455 [2024-11-26 15:46:37.705926] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.455 [2024-11-26 15:46:37.705941] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.455 [2024-11-26 15:46:37.705947] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.705953] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.455 [2024-11-26 15:46:37.705970] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.705978] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.705985] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.455 [2024-11-26 15:46:37.705995] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.455 [2024-11-26 15:46:37.706016] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.455 [2024-11-26 15:46:37.706129] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.455 [2024-11-26 15:46:37.706144] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.455 [2024-11-26 15:46:37.706150] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.706157] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.455 [2024-11-26 15:46:37.706173] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.706181] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.706188] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.455 [2024-11-26 15:46:37.706198] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.455 [2024-11-26 15:46:37.706218] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.455 [2024-11-26 15:46:37.706336] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.455 [2024-11-26 15:46:37.706348] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.455 [2024-11-26 15:46:37.706355] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.706361] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.455 [2024-11-26 15:46:37.706376] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.706385] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.706391] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.455 [2024-11-26 15:46:37.706406] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.455 [2024-11-26 15:46:37.706427] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.455 [2024-11-26 15:46:37.706524] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.455 [2024-11-26 15:46:37.706538] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.455 [2024-11-26 15:46:37.706545] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.706551] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.455 [2024-11-26 15:46:37.706567] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.706576] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.706582] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.455 [2024-11-26 15:46:37.706592] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.455 [2024-11-26 15:46:37.706613] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.455 [2024-11-26 15:46:37.710710] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.455 [2024-11-26 15:46:37.710727] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.455 [2024-11-26 15:46:37.710734] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.710740] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.455 [2024-11-26 15:46:37.710757] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.710766] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.710772] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc8ae10) 00:22:46.455 [2024-11-26 15:46:37.710782] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.455 [2024-11-26 15:46:37.710804] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd0af50, cid 3, qid 0 00:22:46.455 [2024-11-26 15:46:37.710962] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.455 [2024-11-26 15:46:37.710974] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.455 [2024-11-26 15:46:37.710981] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.710987] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd0af50) on tqpair=0xc8ae10 00:22:46.455 [2024-11-26 15:46:37.711000] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 7 milliseconds 00:22:46.455 00:22:46.455 15:46:37 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:22:46.455 [2024-11-26 15:46:37.741087] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:46.455 [2024-11-26 15:46:37.741124] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid941733 ] 00:22:46.455 EAL: No free 2048 kB hugepages reported on node 1 00:22:46.455 [2024-11-26 15:46:37.772516] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:22:46.455 [2024-11-26 15:46:37.772564] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:22:46.455 [2024-11-26 15:46:37.772574] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:22:46.455 [2024-11-26 15:46:37.772590] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:22:46.455 [2024-11-26 15:46:37.772601] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:22:46.455 [2024-11-26 15:46:37.772842] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:22:46.455 [2024-11-26 15:46:37.772889] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x11cee10 0 00:22:46.455 [2024-11-26 15:46:37.783702] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:22:46.455 [2024-11-26 15:46:37.783722] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:22:46.455 [2024-11-26 15:46:37.783730] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:22:46.455 [2024-11-26 15:46:37.783736] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:22:46.455 [2024-11-26 15:46:37.783776] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.783788] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.783795] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11cee10) 00:22:46.455 [2024-11-26 15:46:37.783808] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:46.455 [2024-11-26 15:46:37.783833] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124eb30, cid 0, qid 0 00:22:46.455 [2024-11-26 15:46:37.790701] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.455 [2024-11-26 15:46:37.790719] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.455 [2024-11-26 15:46:37.790726] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.790733] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124eb30) on tqpair=0x11cee10 00:22:46.455 [2024-11-26 15:46:37.790750] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:46.455 [2024-11-26 15:46:37.790760] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:22:46.455 [2024-11-26 15:46:37.790769] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:22:46.455 [2024-11-26 15:46:37.790785] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.790793] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.455 [2024-11-26 15:46:37.790800] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11cee10) 00:22:46.455 [2024-11-26 15:46:37.790811] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.455 [2024-11-26 15:46:37.790833] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124eb30, cid 0, qid 0 00:22:46.455 [2024-11-26 15:46:37.790980] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.455 [2024-11-26 15:46:37.790998] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.456 [2024-11-26 15:46:37.791006] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.791012] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124eb30) on tqpair=0x11cee10 00:22:46.456 [2024-11-26 15:46:37.791022] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:22:46.456 [2024-11-26 15:46:37.791034] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:22:46.456 [2024-11-26 15:46:37.791048] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.791056] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.791063] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11cee10) 00:22:46.456 [2024-11-26 15:46:37.791074] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.456 [2024-11-26 15:46:37.791100] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124eb30, cid 0, qid 0 00:22:46.456 [2024-11-26 15:46:37.791206] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.456 [2024-11-26 15:46:37.791220] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.456 [2024-11-26 15:46:37.791227] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.791236] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124eb30) on tqpair=0x11cee10 00:22:46.456 [2024-11-26 15:46:37.791246] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:22:46.456 [2024-11-26 15:46:37.791259] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:22:46.456 [2024-11-26 15:46:37.791271] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.791278] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.791287] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11cee10) 00:22:46.456 [2024-11-26 15:46:37.791297] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.456 [2024-11-26 15:46:37.791318] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124eb30, cid 0, qid 0 00:22:46.456 [2024-11-26 15:46:37.791412] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.456 [2024-11-26 15:46:37.791426] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.456 [2024-11-26 15:46:37.791433] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.791439] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124eb30) on tqpair=0x11cee10 00:22:46.456 [2024-11-26 15:46:37.791448] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:46.456 [2024-11-26 15:46:37.791466] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.791475] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.791481] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11cee10) 00:22:46.456 [2024-11-26 15:46:37.791492] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.456 [2024-11-26 15:46:37.791512] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124eb30, cid 0, qid 0 00:22:46.456 [2024-11-26 15:46:37.791629] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.456 [2024-11-26 15:46:37.791646] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.456 [2024-11-26 15:46:37.791653] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.791660] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124eb30) on tqpair=0x11cee10 00:22:46.456 [2024-11-26 15:46:37.791668] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:22:46.456 [2024-11-26 15:46:37.791676] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:22:46.456 [2024-11-26 15:46:37.791736] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:46.456 [2024-11-26 15:46:37.791851] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:22:46.456 [2024-11-26 15:46:37.791859] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:46.456 [2024-11-26 15:46:37.791871] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.791878] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.791888] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11cee10) 00:22:46.456 [2024-11-26 15:46:37.791899] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.456 [2024-11-26 15:46:37.791920] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124eb30, cid 0, qid 0 00:22:46.456 [2024-11-26 15:46:37.792063] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.456 [2024-11-26 15:46:37.792078] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.456 [2024-11-26 15:46:37.792087] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.792094] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124eb30) on tqpair=0x11cee10 00:22:46.456 [2024-11-26 15:46:37.792103] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:46.456 [2024-11-26 15:46:37.792119] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.792127] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.792136] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11cee10) 00:22:46.456 [2024-11-26 15:46:37.792147] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.456 [2024-11-26 15:46:37.792168] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124eb30, cid 0, qid 0 00:22:46.456 [2024-11-26 15:46:37.792267] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.456 [2024-11-26 15:46:37.792281] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.456 [2024-11-26 15:46:37.792288] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.792294] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124eb30) on tqpair=0x11cee10 00:22:46.456 [2024-11-26 15:46:37.792303] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:46.456 [2024-11-26 15:46:37.792311] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:22:46.456 [2024-11-26 15:46:37.792325] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:22:46.456 [2024-11-26 15:46:37.792340] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:22:46.456 [2024-11-26 15:46:37.792353] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.792361] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.792367] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11cee10) 00:22:46.456 [2024-11-26 15:46:37.792377] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.456 [2024-11-26 15:46:37.792398] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124eb30, cid 0, qid 0 00:22:46.456 [2024-11-26 15:46:37.792537] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:46.456 [2024-11-26 15:46:37.792551] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:46.456 [2024-11-26 15:46:37.792558] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.792564] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11cee10): datao=0, datal=4096, cccid=0 00:22:46.456 [2024-11-26 15:46:37.792607] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x124eb30) on tqpair(0x11cee10): expected_datao=0, payload_size=4096 00:22:46.456 [2024-11-26 15:46:37.792630] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.792668] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.792693] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.456 [2024-11-26 15:46:37.792709] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.456 [2024-11-26 15:46:37.792716] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.792723] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124eb30) on tqpair=0x11cee10 00:22:46.456 [2024-11-26 15:46:37.792735] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:22:46.456 [2024-11-26 15:46:37.792743] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:22:46.456 [2024-11-26 15:46:37.792750] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:22:46.456 [2024-11-26 15:46:37.792757] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:22:46.456 [2024-11-26 15:46:37.792764] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:22:46.456 [2024-11-26 15:46:37.792771] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:22:46.456 [2024-11-26 15:46:37.792792] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:22:46.456 [2024-11-26 15:46:37.792806] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.792813] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.792819] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11cee10) 00:22:46.456 [2024-11-26 15:46:37.792830] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:46.456 [2024-11-26 15:46:37.792852] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124eb30, cid 0, qid 0 00:22:46.456 [2024-11-26 15:46:37.792968] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.456 [2024-11-26 15:46:37.792982] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.456 [2024-11-26 15:46:37.792989] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.792995] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124eb30) on tqpair=0x11cee10 00:22:46.456 [2024-11-26 15:46:37.793006] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.793013] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.793020] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11cee10) 00:22:46.456 [2024-11-26 15:46:37.793029] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:46.456 [2024-11-26 15:46:37.793039] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.456 [2024-11-26 15:46:37.793046] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.793052] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x11cee10) 00:22:46.457 [2024-11-26 15:46:37.793060] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:46.457 [2024-11-26 15:46:37.793070] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.793076] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.793082] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x11cee10) 00:22:46.457 [2024-11-26 15:46:37.793091] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:46.457 [2024-11-26 15:46:37.793100] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.793106] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.793112] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11cee10) 00:22:46.457 [2024-11-26 15:46:37.793124] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:46.457 [2024-11-26 15:46:37.793149] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:22:46.457 [2024-11-26 15:46:37.793168] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:46.457 [2024-11-26 15:46:37.793180] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.793186] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.793192] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11cee10) 00:22:46.457 [2024-11-26 15:46:37.793202] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.457 [2024-11-26 15:46:37.793222] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124eb30, cid 0, qid 0 00:22:46.457 [2024-11-26 15:46:37.793247] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124ec90, cid 1, qid 0 00:22:46.457 [2024-11-26 15:46:37.793255] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124edf0, cid 2, qid 0 00:22:46.457 [2024-11-26 15:46:37.793262] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124ef50, cid 3, qid 0 00:22:46.457 [2024-11-26 15:46:37.793269] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f0b0, cid 4, qid 0 00:22:46.457 [2024-11-26 15:46:37.793434] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.457 [2024-11-26 15:46:37.793448] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.457 [2024-11-26 15:46:37.793455] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.793461] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f0b0) on tqpair=0x11cee10 00:22:46.457 [2024-11-26 15:46:37.793470] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:22:46.457 [2024-11-26 15:46:37.793478] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:22:46.457 [2024-11-26 15:46:37.793493] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:22:46.457 [2024-11-26 15:46:37.793510] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:22:46.457 [2024-11-26 15:46:37.793521] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.793543] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.793549] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11cee10) 00:22:46.457 [2024-11-26 15:46:37.793559] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:46.457 [2024-11-26 15:46:37.793580] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f0b0, cid 4, qid 0 00:22:46.457 [2024-11-26 15:46:37.793762] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.457 [2024-11-26 15:46:37.793778] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.457 [2024-11-26 15:46:37.793785] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.793791] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f0b0) on tqpair=0x11cee10 00:22:46.457 [2024-11-26 15:46:37.793857] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:22:46.457 [2024-11-26 15:46:37.793878] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:22:46.457 [2024-11-26 15:46:37.793897] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.793920] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.793926] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11cee10) 00:22:46.457 [2024-11-26 15:46:37.793937] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.457 [2024-11-26 15:46:37.793957] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f0b0, cid 4, qid 0 00:22:46.457 [2024-11-26 15:46:37.794146] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:46.457 [2024-11-26 15:46:37.794161] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:46.457 [2024-11-26 15:46:37.794168] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.794174] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11cee10): datao=0, datal=4096, cccid=4 00:22:46.457 [2024-11-26 15:46:37.794182] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x124f0b0) on tqpair(0x11cee10): expected_datao=0, payload_size=4096 00:22:46.457 [2024-11-26 15:46:37.794193] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.794200] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.838714] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.457 [2024-11-26 15:46:37.838732] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.457 [2024-11-26 15:46:37.838739] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.838746] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f0b0) on tqpair=0x11cee10 00:22:46.457 [2024-11-26 15:46:37.838773] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:22:46.457 [2024-11-26 15:46:37.838789] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:22:46.457 [2024-11-26 15:46:37.838810] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:22:46.457 [2024-11-26 15:46:37.838824] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.838831] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.838837] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11cee10) 00:22:46.457 [2024-11-26 15:46:37.838848] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.457 [2024-11-26 15:46:37.838871] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f0b0, cid 4, qid 0 00:22:46.457 [2024-11-26 15:46:37.839037] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:46.457 [2024-11-26 15:46:37.839052] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:46.457 [2024-11-26 15:46:37.839091] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.839099] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11cee10): datao=0, datal=4096, cccid=4 00:22:46.457 [2024-11-26 15:46:37.839106] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x124f0b0) on tqpair(0x11cee10): expected_datao=0, payload_size=4096 00:22:46.457 [2024-11-26 15:46:37.839125] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.839134] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.880849] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.457 [2024-11-26 15:46:37.880870] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.457 [2024-11-26 15:46:37.880878] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.880885] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f0b0) on tqpair=0x11cee10 00:22:46.457 [2024-11-26 15:46:37.880912] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:22:46.457 [2024-11-26 15:46:37.880938] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:22:46.457 [2024-11-26 15:46:37.880954] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.880961] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.457 [2024-11-26 15:46:37.880968] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11cee10) 00:22:46.457 [2024-11-26 15:46:37.880979] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.457 [2024-11-26 15:46:37.881003] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f0b0, cid 4, qid 0 00:22:46.457 [2024-11-26 15:46:37.881150] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:46.457 [2024-11-26 15:46:37.881165] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:46.457 [2024-11-26 15:46:37.881172] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:46.458 [2024-11-26 15:46:37.881178] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11cee10): datao=0, datal=4096, cccid=4 00:22:46.458 [2024-11-26 15:46:37.881186] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x124f0b0) on tqpair(0x11cee10): expected_datao=0, payload_size=4096 00:22:46.458 [2024-11-26 15:46:37.881197] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:46.458 [2024-11-26 15:46:37.881204] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.922705] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.719 [2024-11-26 15:46:37.922724] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.719 [2024-11-26 15:46:37.922746] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.922753] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f0b0) on tqpair=0x11cee10 00:22:46.719 [2024-11-26 15:46:37.922769] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:22:46.719 [2024-11-26 15:46:37.922787] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:22:46.719 [2024-11-26 15:46:37.922804] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:22:46.719 [2024-11-26 15:46:37.922815] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:22:46.719 [2024-11-26 15:46:37.922824] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:22:46.719 [2024-11-26 15:46:37.922832] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:22:46.719 [2024-11-26 15:46:37.922840] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:22:46.719 [2024-11-26 15:46:37.922849] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:22:46.719 [2024-11-26 15:46:37.922868] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.922876] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.922883] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11cee10) 00:22:46.719 [2024-11-26 15:46:37.922894] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.719 [2024-11-26 15:46:37.922905] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.922912] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.922922] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x11cee10) 00:22:46.719 [2024-11-26 15:46:37.922932] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:46.719 [2024-11-26 15:46:37.922959] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f0b0, cid 4, qid 0 00:22:46.719 [2024-11-26 15:46:37.922971] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f210, cid 5, qid 0 00:22:46.719 [2024-11-26 15:46:37.923086] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.719 [2024-11-26 15:46:37.923101] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.719 [2024-11-26 15:46:37.923108] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.923114] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f0b0) on tqpair=0x11cee10 00:22:46.719 [2024-11-26 15:46:37.923125] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.719 [2024-11-26 15:46:37.923134] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.719 [2024-11-26 15:46:37.923141] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.923147] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f210) on tqpair=0x11cee10 00:22:46.719 [2024-11-26 15:46:37.923165] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.923174] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.923181] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x11cee10) 00:22:46.719 [2024-11-26 15:46:37.923191] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.719 [2024-11-26 15:46:37.923212] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f210, cid 5, qid 0 00:22:46.719 [2024-11-26 15:46:37.923320] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.719 [2024-11-26 15:46:37.923335] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.719 [2024-11-26 15:46:37.923341] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.923348] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f210) on tqpair=0x11cee10 00:22:46.719 [2024-11-26 15:46:37.923367] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.923376] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.923382] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x11cee10) 00:22:46.719 [2024-11-26 15:46:37.923392] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.719 [2024-11-26 15:46:37.923412] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f210, cid 5, qid 0 00:22:46.719 [2024-11-26 15:46:37.923520] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.719 [2024-11-26 15:46:37.923534] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.719 [2024-11-26 15:46:37.923543] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.923550] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f210) on tqpair=0x11cee10 00:22:46.719 [2024-11-26 15:46:37.923566] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.923575] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.923581] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x11cee10) 00:22:46.719 [2024-11-26 15:46:37.923593] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.719 [2024-11-26 15:46:37.923614] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f210, cid 5, qid 0 00:22:46.719 [2024-11-26 15:46:37.923713] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.719 [2024-11-26 15:46:37.923734] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.719 [2024-11-26 15:46:37.923742] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.923748] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f210) on tqpair=0x11cee10 00:22:46.719 [2024-11-26 15:46:37.923769] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.719 [2024-11-26 15:46:37.923781] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.923788] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x11cee10) 00:22:46.720 [2024-11-26 15:46:37.923798] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.720 [2024-11-26 15:46:37.923811] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.923818] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.923824] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11cee10) 00:22:46.720 [2024-11-26 15:46:37.923833] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.720 [2024-11-26 15:46:37.923845] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.923852] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.923858] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x11cee10) 00:22:46.720 [2024-11-26 15:46:37.923867] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.720 [2024-11-26 15:46:37.923879] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.923886] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.923907] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x11cee10) 00:22:46.720 [2024-11-26 15:46:37.923917] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.720 [2024-11-26 15:46:37.923938] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f210, cid 5, qid 0 00:22:46.720 [2024-11-26 15:46:37.923949] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f0b0, cid 4, qid 0 00:22:46.720 [2024-11-26 15:46:37.923956] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f370, cid 6, qid 0 00:22:46.720 [2024-11-26 15:46:37.923982] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f4d0, cid 7, qid 0 00:22:46.720 [2024-11-26 15:46:37.924235] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:46.720 [2024-11-26 15:46:37.924250] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:46.720 [2024-11-26 15:46:37.924256] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924263] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11cee10): datao=0, datal=8192, cccid=5 00:22:46.720 [2024-11-26 15:46:37.924299] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x124f210) on tqpair(0x11cee10): expected_datao=0, payload_size=8192 00:22:46.720 [2024-11-26 15:46:37.924315] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924323] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924332] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:46.720 [2024-11-26 15:46:37.924340] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:46.720 [2024-11-26 15:46:37.924347] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924353] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11cee10): datao=0, datal=512, cccid=4 00:22:46.720 [2024-11-26 15:46:37.924360] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x124f0b0) on tqpair(0x11cee10): expected_datao=0, payload_size=512 00:22:46.720 [2024-11-26 15:46:37.924374] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924382] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924390] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:46.720 [2024-11-26 15:46:37.924399] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:46.720 [2024-11-26 15:46:37.924405] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924411] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11cee10): datao=0, datal=512, cccid=6 00:22:46.720 [2024-11-26 15:46:37.924418] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x124f370) on tqpair(0x11cee10): expected_datao=0, payload_size=512 00:22:46.720 [2024-11-26 15:46:37.924428] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924435] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924443] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:46.720 [2024-11-26 15:46:37.924452] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:46.720 [2024-11-26 15:46:37.924458] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924464] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11cee10): datao=0, datal=4096, cccid=7 00:22:46.720 [2024-11-26 15:46:37.924471] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x124f4d0) on tqpair(0x11cee10): expected_datao=0, payload_size=4096 00:22:46.720 [2024-11-26 15:46:37.924481] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924489] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924501] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.720 [2024-11-26 15:46:37.924529] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.720 [2024-11-26 15:46:37.924536] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924542] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f210) on tqpair=0x11cee10 00:22:46.720 [2024-11-26 15:46:37.924562] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.720 [2024-11-26 15:46:37.924586] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.720 [2024-11-26 15:46:37.924593] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924599] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f0b0) on tqpair=0x11cee10 00:22:46.720 [2024-11-26 15:46:37.924613] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.720 [2024-11-26 15:46:37.924623] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.720 [2024-11-26 15:46:37.924629] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924635] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f370) on tqpair=0x11cee10 00:22:46.720 [2024-11-26 15:46:37.924646] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.720 [2024-11-26 15:46:37.924655] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.720 [2024-11-26 15:46:37.924674] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.720 [2024-11-26 15:46:37.924681] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f4d0) on tqpair=0x11cee10 00:22:46.720 ===================================================== 00:22:46.720 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:46.720 ===================================================== 00:22:46.720 Controller Capabilities/Features 00:22:46.720 ================================ 00:22:46.720 Vendor ID: 8086 00:22:46.720 Subsystem Vendor ID: 8086 00:22:46.720 Serial Number: SPDK00000000000001 00:22:46.720 Model Number: SPDK bdev Controller 00:22:46.720 Firmware Version: 24.01.1 00:22:46.720 Recommended Arb Burst: 6 00:22:46.720 IEEE OUI Identifier: e4 d2 5c 00:22:46.720 Multi-path I/O 00:22:46.720 May have multiple subsystem ports: Yes 00:22:46.720 May have multiple controllers: Yes 00:22:46.720 Associated with SR-IOV VF: No 00:22:46.720 Max Data Transfer Size: 131072 00:22:46.720 Max Number of Namespaces: 32 00:22:46.720 Max Number of I/O Queues: 127 00:22:46.721 NVMe Specification Version (VS): 1.3 00:22:46.721 NVMe Specification Version (Identify): 1.3 00:22:46.721 Maximum Queue Entries: 128 00:22:46.721 Contiguous Queues Required: Yes 00:22:46.721 Arbitration Mechanisms Supported 00:22:46.721 Weighted Round Robin: Not Supported 00:22:46.721 Vendor Specific: Not Supported 00:22:46.721 Reset Timeout: 15000 ms 00:22:46.721 Doorbell Stride: 4 bytes 00:22:46.721 NVM Subsystem Reset: Not Supported 00:22:46.721 Command Sets Supported 00:22:46.721 NVM Command Set: Supported 00:22:46.721 Boot Partition: Not Supported 00:22:46.721 Memory Page Size Minimum: 4096 bytes 00:22:46.721 Memory Page Size Maximum: 4096 bytes 00:22:46.721 Persistent Memory Region: Not Supported 00:22:46.721 Optional Asynchronous Events Supported 00:22:46.721 Namespace Attribute Notices: Supported 00:22:46.721 Firmware Activation Notices: Not Supported 00:22:46.721 ANA Change Notices: Not Supported 00:22:46.721 PLE Aggregate Log Change Notices: Not Supported 00:22:46.721 LBA Status Info Alert Notices: Not Supported 00:22:46.721 EGE Aggregate Log Change Notices: Not Supported 00:22:46.721 Normal NVM Subsystem Shutdown event: Not Supported 00:22:46.721 Zone Descriptor Change Notices: Not Supported 00:22:46.721 Discovery Log Change Notices: Not Supported 00:22:46.721 Controller Attributes 00:22:46.721 128-bit Host Identifier: Supported 00:22:46.721 Non-Operational Permissive Mode: Not Supported 00:22:46.721 NVM Sets: Not Supported 00:22:46.721 Read Recovery Levels: Not Supported 00:22:46.721 Endurance Groups: Not Supported 00:22:46.721 Predictable Latency Mode: Not Supported 00:22:46.721 Traffic Based Keep ALive: Not Supported 00:22:46.721 Namespace Granularity: Not Supported 00:22:46.721 SQ Associations: Not Supported 00:22:46.721 UUID List: Not Supported 00:22:46.721 Multi-Domain Subsystem: Not Supported 00:22:46.721 Fixed Capacity Management: Not Supported 00:22:46.721 Variable Capacity Management: Not Supported 00:22:46.721 Delete Endurance Group: Not Supported 00:22:46.721 Delete NVM Set: Not Supported 00:22:46.721 Extended LBA Formats Supported: Not Supported 00:22:46.721 Flexible Data Placement Supported: Not Supported 00:22:46.721 00:22:46.721 Controller Memory Buffer Support 00:22:46.721 ================================ 00:22:46.721 Supported: No 00:22:46.721 00:22:46.721 Persistent Memory Region Support 00:22:46.721 ================================ 00:22:46.721 Supported: No 00:22:46.721 00:22:46.721 Admin Command Set Attributes 00:22:46.721 ============================ 00:22:46.721 Security Send/Receive: Not Supported 00:22:46.721 Format NVM: Not Supported 00:22:46.721 Firmware Activate/Download: Not Supported 00:22:46.721 Namespace Management: Not Supported 00:22:46.721 Device Self-Test: Not Supported 00:22:46.721 Directives: Not Supported 00:22:46.721 NVMe-MI: Not Supported 00:22:46.721 Virtualization Management: Not Supported 00:22:46.721 Doorbell Buffer Config: Not Supported 00:22:46.721 Get LBA Status Capability: Not Supported 00:22:46.721 Command & Feature Lockdown Capability: Not Supported 00:22:46.721 Abort Command Limit: 4 00:22:46.721 Async Event Request Limit: 4 00:22:46.721 Number of Firmware Slots: N/A 00:22:46.721 Firmware Slot 1 Read-Only: N/A 00:22:46.721 Firmware Activation Without Reset: N/A 00:22:46.721 Multiple Update Detection Support: N/A 00:22:46.721 Firmware Update Granularity: No Information Provided 00:22:46.721 Per-Namespace SMART Log: No 00:22:46.721 Asymmetric Namespace Access Log Page: Not Supported 00:22:46.721 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:22:46.721 Command Effects Log Page: Supported 00:22:46.721 Get Log Page Extended Data: Supported 00:22:46.721 Telemetry Log Pages: Not Supported 00:22:46.721 Persistent Event Log Pages: Not Supported 00:22:46.721 Supported Log Pages Log Page: May Support 00:22:46.721 Commands Supported & Effects Log Page: Not Supported 00:22:46.721 Feature Identifiers & Effects Log Page:May Support 00:22:46.721 NVMe-MI Commands & Effects Log Page: May Support 00:22:46.721 Data Area 4 for Telemetry Log: Not Supported 00:22:46.721 Error Log Page Entries Supported: 128 00:22:46.721 Keep Alive: Supported 00:22:46.721 Keep Alive Granularity: 10000 ms 00:22:46.721 00:22:46.721 NVM Command Set Attributes 00:22:46.721 ========================== 00:22:46.721 Submission Queue Entry Size 00:22:46.721 Max: 64 00:22:46.721 Min: 64 00:22:46.721 Completion Queue Entry Size 00:22:46.721 Max: 16 00:22:46.721 Min: 16 00:22:46.721 Number of Namespaces: 32 00:22:46.721 Compare Command: Supported 00:22:46.721 Write Uncorrectable Command: Not Supported 00:22:46.721 Dataset Management Command: Supported 00:22:46.721 Write Zeroes Command: Supported 00:22:46.721 Set Features Save Field: Not Supported 00:22:46.721 Reservations: Supported 00:22:46.721 Timestamp: Not Supported 00:22:46.721 Copy: Supported 00:22:46.721 Volatile Write Cache: Present 00:22:46.721 Atomic Write Unit (Normal): 1 00:22:46.721 Atomic Write Unit (PFail): 1 00:22:46.721 Atomic Compare & Write Unit: 1 00:22:46.721 Fused Compare & Write: Supported 00:22:46.721 Scatter-Gather List 00:22:46.721 SGL Command Set: Supported 00:22:46.721 SGL Keyed: Supported 00:22:46.721 SGL Bit Bucket Descriptor: Not Supported 00:22:46.721 SGL Metadata Pointer: Not Supported 00:22:46.721 Oversized SGL: Not Supported 00:22:46.721 SGL Metadata Address: Not Supported 00:22:46.721 SGL Offset: Supported 00:22:46.721 Transport SGL Data Block: Not Supported 00:22:46.721 Replay Protected Memory Block: Not Supported 00:22:46.721 00:22:46.721 Firmware Slot Information 00:22:46.721 ========================= 00:22:46.722 Active slot: 1 00:22:46.722 Slot 1 Firmware Revision: 24.01.1 00:22:46.722 00:22:46.722 00:22:46.722 Commands Supported and Effects 00:22:46.722 ============================== 00:22:46.722 Admin Commands 00:22:46.722 -------------- 00:22:46.722 Get Log Page (02h): Supported 00:22:46.722 Identify (06h): Supported 00:22:46.722 Abort (08h): Supported 00:22:46.722 Set Features (09h): Supported 00:22:46.722 Get Features (0Ah): Supported 00:22:46.722 Asynchronous Event Request (0Ch): Supported 00:22:46.722 Keep Alive (18h): Supported 00:22:46.722 I/O Commands 00:22:46.722 ------------ 00:22:46.722 Flush (00h): Supported LBA-Change 00:22:46.722 Write (01h): Supported LBA-Change 00:22:46.722 Read (02h): Supported 00:22:46.722 Compare (05h): Supported 00:22:46.722 Write Zeroes (08h): Supported LBA-Change 00:22:46.722 Dataset Management (09h): Supported LBA-Change 00:22:46.722 Copy (19h): Supported LBA-Change 00:22:46.722 Unknown (79h): Supported LBA-Change 00:22:46.722 Unknown (7Ah): Supported 00:22:46.722 00:22:46.722 Error Log 00:22:46.722 ========= 00:22:46.722 00:22:46.722 Arbitration 00:22:46.722 =========== 00:22:46.722 Arbitration Burst: 1 00:22:46.722 00:22:46.722 Power Management 00:22:46.722 ================ 00:22:46.722 Number of Power States: 1 00:22:46.722 Current Power State: Power State #0 00:22:46.722 Power State #0: 00:22:46.722 Max Power: 0.00 W 00:22:46.722 Non-Operational State: Operational 00:22:46.722 Entry Latency: Not Reported 00:22:46.722 Exit Latency: Not Reported 00:22:46.722 Relative Read Throughput: 0 00:22:46.722 Relative Read Latency: 0 00:22:46.722 Relative Write Throughput: 0 00:22:46.722 Relative Write Latency: 0 00:22:46.722 Idle Power: Not Reported 00:22:46.722 Active Power: Not Reported 00:22:46.722 Non-Operational Permissive Mode: Not Supported 00:22:46.722 00:22:46.722 Health Information 00:22:46.722 ================== 00:22:46.722 Critical Warnings: 00:22:46.722 Available Spare Space: OK 00:22:46.722 Temperature: OK 00:22:46.722 Device Reliability: OK 00:22:46.722 Read Only: No 00:22:46.722 Volatile Memory Backup: OK 00:22:46.722 Current Temperature: 0 Kelvin (-273 Celsius) 00:22:46.722 Temperature Threshold: [2024-11-26 15:46:37.924809] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.722 [2024-11-26 15:46:37.924821] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.722 [2024-11-26 15:46:37.924827] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x11cee10) 00:22:46.722 [2024-11-26 15:46:37.924838] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.722 [2024-11-26 15:46:37.924859] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124f4d0, cid 7, qid 0 00:22:46.722 [2024-11-26 15:46:37.925012] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.722 [2024-11-26 15:46:37.925027] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.722 [2024-11-26 15:46:37.925034] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.722 [2024-11-26 15:46:37.925040] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124f4d0) on tqpair=0x11cee10 00:22:46.722 [2024-11-26 15:46:37.925082] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:22:46.722 [2024-11-26 15:46:37.925103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:46.722 [2024-11-26 15:46:37.925117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:46.722 [2024-11-26 15:46:37.925127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:46.722 [2024-11-26 15:46:37.925136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:46.722 [2024-11-26 15:46:37.925148] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.722 [2024-11-26 15:46:37.925155] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.722 [2024-11-26 15:46:37.925161] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11cee10) 00:22:46.722 [2024-11-26 15:46:37.925172] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.722 [2024-11-26 15:46:37.925207] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124ef50, cid 3, qid 0 00:22:46.722 [2024-11-26 15:46:37.925370] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.722 [2024-11-26 15:46:37.925385] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.722 [2024-11-26 15:46:37.925392] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.722 [2024-11-26 15:46:37.925398] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124ef50) on tqpair=0x11cee10 00:22:46.722 [2024-11-26 15:46:37.925410] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.722 [2024-11-26 15:46:37.925417] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.722 [2024-11-26 15:46:37.925423] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11cee10) 00:22:46.722 [2024-11-26 15:46:37.925434] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.722 [2024-11-26 15:46:37.925461] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124ef50, cid 3, qid 0 00:22:46.722 [2024-11-26 15:46:37.925575] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.722 [2024-11-26 15:46:37.925590] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.722 [2024-11-26 15:46:37.925596] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.722 [2024-11-26 15:46:37.925603] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124ef50) on tqpair=0x11cee10 00:22:46.722 [2024-11-26 15:46:37.925611] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:22:46.722 [2024-11-26 15:46:37.925619] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:22:46.722 [2024-11-26 15:46:37.925636] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.722 [2024-11-26 15:46:37.925645] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.722 [2024-11-26 15:46:37.925651] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11cee10) 00:22:46.722 [2024-11-26 15:46:37.925661] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.722 [2024-11-26 15:46:37.925681] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124ef50, cid 3, qid 0 00:22:46.722 [2024-11-26 15:46:37.925790] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.723 [2024-11-26 15:46:37.925809] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.723 [2024-11-26 15:46:37.925817] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.925823] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124ef50) on tqpair=0x11cee10 00:22:46.723 [2024-11-26 15:46:37.925842] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.925852] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.925858] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11cee10) 00:22:46.723 [2024-11-26 15:46:37.925868] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.723 [2024-11-26 15:46:37.925888] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124ef50, cid 3, qid 0 00:22:46.723 [2024-11-26 15:46:37.925985] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.723 [2024-11-26 15:46:37.926000] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.723 [2024-11-26 15:46:37.926006] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926013] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124ef50) on tqpair=0x11cee10 00:22:46.723 [2024-11-26 15:46:37.926032] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926041] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926047] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11cee10) 00:22:46.723 [2024-11-26 15:46:37.926057] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.723 [2024-11-26 15:46:37.926078] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124ef50, cid 3, qid 0 00:22:46.723 [2024-11-26 15:46:37.926187] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.723 [2024-11-26 15:46:37.926202] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.723 [2024-11-26 15:46:37.926208] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926215] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124ef50) on tqpair=0x11cee10 00:22:46.723 [2024-11-26 15:46:37.926234] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926242] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926249] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11cee10) 00:22:46.723 [2024-11-26 15:46:37.926259] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.723 [2024-11-26 15:46:37.926279] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124ef50, cid 3, qid 0 00:22:46.723 [2024-11-26 15:46:37.926377] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.723 [2024-11-26 15:46:37.926391] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.723 [2024-11-26 15:46:37.926397] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926404] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124ef50) on tqpair=0x11cee10 00:22:46.723 [2024-11-26 15:46:37.926423] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926432] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926438] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11cee10) 00:22:46.723 [2024-11-26 15:46:37.926449] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.723 [2024-11-26 15:46:37.926469] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124ef50, cid 3, qid 0 00:22:46.723 [2024-11-26 15:46:37.926562] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.723 [2024-11-26 15:46:37.926577] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.723 [2024-11-26 15:46:37.926587] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926594] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124ef50) on tqpair=0x11cee10 00:22:46.723 [2024-11-26 15:46:37.926614] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926622] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926629] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11cee10) 00:22:46.723 [2024-11-26 15:46:37.926639] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.723 [2024-11-26 15:46:37.926659] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124ef50, cid 3, qid 0 00:22:46.723 [2024-11-26 15:46:37.926766] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.723 [2024-11-26 15:46:37.926781] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.723 [2024-11-26 15:46:37.926788] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926794] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124ef50) on tqpair=0x11cee10 00:22:46.723 [2024-11-26 15:46:37.926814] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926823] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926829] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11cee10) 00:22:46.723 [2024-11-26 15:46:37.926839] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.723 [2024-11-26 15:46:37.926860] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124ef50, cid 3, qid 0 00:22:46.723 [2024-11-26 15:46:37.926956] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.723 [2024-11-26 15:46:37.926971] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.723 [2024-11-26 15:46:37.926977] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.926984] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124ef50) on tqpair=0x11cee10 00:22:46.723 [2024-11-26 15:46:37.927003] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.927012] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.927018] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11cee10) 00:22:46.723 [2024-11-26 15:46:37.927028] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.723 [2024-11-26 15:46:37.927049] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124ef50, cid 3, qid 0 00:22:46.723 [2024-11-26 15:46:37.927145] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.723 [2024-11-26 15:46:37.927159] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.723 [2024-11-26 15:46:37.927166] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.927172] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124ef50) on tqpair=0x11cee10 00:22:46.723 [2024-11-26 15:46:37.927192] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.927200] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.927207] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11cee10) 00:22:46.723 [2024-11-26 15:46:37.927217] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.723 [2024-11-26 15:46:37.927237] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124ef50, cid 3, qid 0 00:22:46.723 [2024-11-26 15:46:37.930702] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.723 [2024-11-26 15:46:37.930726] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.723 [2024-11-26 15:46:37.930734] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.723 [2024-11-26 15:46:37.930744] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124ef50) on tqpair=0x11cee10 00:22:46.724 [2024-11-26 15:46:37.930766] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:46.724 [2024-11-26 15:46:37.930775] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:46.724 [2024-11-26 15:46:37.930781] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11cee10) 00:22:46.724 [2024-11-26 15:46:37.930792] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:46.724 [2024-11-26 15:46:37.930812] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x124ef50, cid 3, qid 0 00:22:46.724 [2024-11-26 15:46:37.930948] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:46.724 [2024-11-26 15:46:37.930963] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:46.724 [2024-11-26 15:46:37.930973] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:46.724 [2024-11-26 15:46:37.930979] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x124ef50) on tqpair=0x11cee10 00:22:46.724 [2024-11-26 15:46:37.930993] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:22:46.724 0 Kelvin (-273 Celsius) 00:22:46.724 Available Spare: 0% 00:22:46.724 Available Spare Threshold: 0% 00:22:46.724 Life Percentage Used: 0% 00:22:46.724 Data Units Read: 0 00:22:46.724 Data Units Written: 0 00:22:46.724 Host Read Commands: 0 00:22:46.724 Host Write Commands: 0 00:22:46.724 Controller Busy Time: 0 minutes 00:22:46.724 Power Cycles: 0 00:22:46.724 Power On Hours: 0 hours 00:22:46.724 Unsafe Shutdowns: 0 00:22:46.724 Unrecoverable Media Errors: 0 00:22:46.724 Lifetime Error Log Entries: 0 00:22:46.724 Warning Temperature Time: 0 minutes 00:22:46.724 Critical Temperature Time: 0 minutes 00:22:46.724 00:22:46.724 Number of Queues 00:22:46.724 ================ 00:22:46.724 Number of I/O Submission Queues: 127 00:22:46.724 Number of I/O Completion Queues: 127 00:22:46.724 00:22:46.724 Active Namespaces 00:22:46.724 ================= 00:22:46.724 Namespace ID:1 00:22:46.724 Error Recovery Timeout: Unlimited 00:22:46.724 Command Set Identifier: NVM (00h) 00:22:46.724 Deallocate: Supported 00:22:46.724 Deallocated/Unwritten Error: Not Supported 00:22:46.724 Deallocated Read Value: Unknown 00:22:46.724 Deallocate in Write Zeroes: Not Supported 00:22:46.724 Deallocated Guard Field: 0xFFFF 00:22:46.724 Flush: Supported 00:22:46.724 Reservation: Supported 00:22:46.724 Namespace Sharing Capabilities: Multiple Controllers 00:22:46.724 Size (in LBAs): 131072 (0GiB) 00:22:46.724 Capacity (in LBAs): 131072 (0GiB) 00:22:46.724 Utilization (in LBAs): 131072 (0GiB) 00:22:46.724 NGUID: ABCDEF0123456789ABCDEF0123456789 00:22:46.724 EUI64: ABCDEF0123456789 00:22:46.724 UUID: 422819f0-2c2c-4c68-9520-e527bd9660c1 00:22:46.724 Thin Provisioning: Not Supported 00:22:46.724 Per-NS Atomic Units: Yes 00:22:46.724 Atomic Boundary Size (Normal): 0 00:22:46.724 Atomic Boundary Size (PFail): 0 00:22:46.724 Atomic Boundary Offset: 0 00:22:46.724 Maximum Single Source Range Length: 65535 00:22:46.724 Maximum Copy Length: 65535 00:22:46.724 Maximum Source Range Count: 1 00:22:46.724 NGUID/EUI64 Never Reused: No 00:22:46.724 Namespace Write Protected: No 00:22:46.724 Number of LBA Formats: 1 00:22:46.724 Current LBA Format: LBA Format #00 00:22:46.724 LBA Format #00: Data Size: 512 Metadata Size: 0 00:22:46.724 00:22:46.724 15:46:37 -- host/identify.sh@51 -- # sync 00:22:46.724 15:46:37 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:46.724 15:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.724 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:22:46.724 15:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.724 15:46:37 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:22:46.724 15:46:37 -- host/identify.sh@56 -- # nvmftestfini 00:22:46.724 15:46:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:46.724 15:46:37 -- nvmf/common.sh@116 -- # sync 00:22:46.724 15:46:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:46.724 15:46:37 -- nvmf/common.sh@119 -- # set +e 00:22:46.724 15:46:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:46.724 15:46:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:46.724 rmmod nvme_tcp 00:22:46.724 rmmod nvme_fabrics 00:22:46.724 rmmod nvme_keyring 00:22:46.724 15:46:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:46.724 15:46:38 -- nvmf/common.sh@123 -- # set -e 00:22:46.724 15:46:38 -- nvmf/common.sh@124 -- # return 0 00:22:46.724 15:46:38 -- nvmf/common.sh@477 -- # '[' -n 941577 ']' 00:22:46.724 15:46:38 -- nvmf/common.sh@478 -- # killprocess 941577 00:22:46.724 15:46:38 -- common/autotest_common.sh@936 -- # '[' -z 941577 ']' 00:22:46.724 15:46:38 -- common/autotest_common.sh@940 -- # kill -0 941577 00:22:46.724 15:46:38 -- common/autotest_common.sh@941 -- # uname 00:22:46.724 15:46:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:46.724 15:46:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 941577 00:22:46.724 15:46:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:46.724 15:46:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:46.724 15:46:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 941577' 00:22:46.724 killing process with pid 941577 00:22:46.724 15:46:38 -- common/autotest_common.sh@955 -- # kill 941577 00:22:46.724 [2024-11-26 15:46:38.061122] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:46.724 15:46:38 -- common/autotest_common.sh@960 -- # wait 941577 00:22:46.982 15:46:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:46.983 15:46:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:46.983 15:46:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:46.983 15:46:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:46.983 15:46:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:46.983 15:46:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:46.983 15:46:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:46.983 15:46:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:49.516 15:46:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:49.516 00:22:49.516 real 0m6.223s 00:22:49.516 user 0m7.652s 00:22:49.516 sys 0m1.917s 00:22:49.516 15:46:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:49.516 15:46:40 -- common/autotest_common.sh@10 -- # set +x 00:22:49.516 ************************************ 00:22:49.516 END TEST nvmf_identify 00:22:49.516 ************************************ 00:22:49.516 15:46:40 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:22:49.516 15:46:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:49.516 15:46:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:49.516 15:46:40 -- common/autotest_common.sh@10 -- # set +x 00:22:49.516 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:22:49.516 ************************************ 00:22:49.516 START TEST nvmf_perf 00:22:49.516 ************************************ 00:22:49.516 15:46:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:22:49.516 * Looking for test storage... 00:22:49.516 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:49.516 15:46:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:49.516 15:46:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:49.516 15:46:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:49.516 15:46:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:49.516 15:46:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:49.516 15:46:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:49.516 15:46:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:49.516 15:46:40 -- scripts/common.sh@335 -- # IFS=.-: 00:22:49.516 15:46:40 -- scripts/common.sh@335 -- # read -ra ver1 00:22:49.516 15:46:40 -- scripts/common.sh@336 -- # IFS=.-: 00:22:49.516 15:46:40 -- scripts/common.sh@336 -- # read -ra ver2 00:22:49.516 15:46:40 -- scripts/common.sh@337 -- # local 'op=<' 00:22:49.516 15:46:40 -- scripts/common.sh@339 -- # ver1_l=2 00:22:49.516 15:46:40 -- scripts/common.sh@340 -- # ver2_l=1 00:22:49.516 15:46:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:49.516 15:46:40 -- scripts/common.sh@343 -- # case "$op" in 00:22:49.516 15:46:40 -- scripts/common.sh@344 -- # : 1 00:22:49.516 15:46:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:49.516 15:46:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:49.516 15:46:40 -- scripts/common.sh@364 -- # decimal 1 00:22:49.516 15:46:40 -- scripts/common.sh@352 -- # local d=1 00:22:49.516 15:46:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:49.516 15:46:40 -- scripts/common.sh@354 -- # echo 1 00:22:49.517 15:46:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:49.517 15:46:40 -- scripts/common.sh@365 -- # decimal 2 00:22:49.517 15:46:40 -- scripts/common.sh@352 -- # local d=2 00:22:49.517 15:46:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:49.517 15:46:40 -- scripts/common.sh@354 -- # echo 2 00:22:49.517 15:46:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:49.517 15:46:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:49.517 15:46:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:49.517 15:46:40 -- scripts/common.sh@367 -- # return 0 00:22:49.517 15:46:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:49.517 15:46:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:49.517 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:49.517 --rc genhtml_branch_coverage=1 00:22:49.517 --rc genhtml_function_coverage=1 00:22:49.517 --rc genhtml_legend=1 00:22:49.517 --rc geninfo_all_blocks=1 00:22:49.517 --rc geninfo_unexecuted_blocks=1 00:22:49.517 00:22:49.517 ' 00:22:49.517 15:46:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:49.517 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:49.517 --rc genhtml_branch_coverage=1 00:22:49.517 --rc genhtml_function_coverage=1 00:22:49.517 --rc genhtml_legend=1 00:22:49.517 --rc geninfo_all_blocks=1 00:22:49.517 --rc geninfo_unexecuted_blocks=1 00:22:49.517 00:22:49.517 ' 00:22:49.517 15:46:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:49.517 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:49.517 --rc genhtml_branch_coverage=1 00:22:49.517 --rc genhtml_function_coverage=1 00:22:49.517 --rc genhtml_legend=1 00:22:49.517 --rc geninfo_all_blocks=1 00:22:49.517 --rc geninfo_unexecuted_blocks=1 00:22:49.517 00:22:49.517 ' 00:22:49.517 15:46:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:49.517 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:49.517 --rc genhtml_branch_coverage=1 00:22:49.517 --rc genhtml_function_coverage=1 00:22:49.517 --rc genhtml_legend=1 00:22:49.517 --rc geninfo_all_blocks=1 00:22:49.517 --rc geninfo_unexecuted_blocks=1 00:22:49.517 00:22:49.517 ' 00:22:49.517 15:46:40 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:49.517 15:46:40 -- nvmf/common.sh@7 -- # uname -s 00:22:49.517 15:46:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:49.517 15:46:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:49.517 15:46:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:49.517 15:46:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:49.517 15:46:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:49.517 15:46:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:49.517 15:46:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:49.517 15:46:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:49.517 15:46:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:49.517 15:46:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:49.517 15:46:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:49.517 15:46:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:49.517 15:46:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:49.517 15:46:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:49.517 15:46:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:49.517 15:46:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:49.517 15:46:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:49.517 15:46:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:49.517 15:46:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:49.517 15:46:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:49.517 15:46:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:49.517 15:46:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:49.517 15:46:40 -- paths/export.sh@5 -- # export PATH 00:22:49.517 15:46:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:49.517 15:46:40 -- nvmf/common.sh@46 -- # : 0 00:22:49.517 15:46:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:49.517 15:46:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:49.517 15:46:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:49.517 15:46:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:49.517 15:46:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:49.517 15:46:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:49.517 15:46:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:49.517 15:46:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:49.517 15:46:40 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:22:49.517 15:46:40 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:22:49.517 15:46:40 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:22:49.517 15:46:40 -- host/perf.sh@17 -- # nvmftestinit 00:22:49.517 15:46:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:49.517 15:46:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:49.517 15:46:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:49.517 15:46:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:49.517 15:46:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:49.517 15:46:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:49.517 15:46:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:49.517 15:46:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:49.517 15:46:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:49.517 15:46:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:49.517 15:46:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:49.517 15:46:40 -- common/autotest_common.sh@10 -- # set +x 00:22:51.420 15:46:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:51.420 15:46:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:51.420 15:46:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:51.420 15:46:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:51.420 15:46:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:51.420 15:46:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:51.420 15:46:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:51.420 15:46:42 -- nvmf/common.sh@294 -- # net_devs=() 00:22:51.420 15:46:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:51.420 15:46:42 -- nvmf/common.sh@295 -- # e810=() 00:22:51.420 15:46:42 -- nvmf/common.sh@295 -- # local -ga e810 00:22:51.420 15:46:42 -- nvmf/common.sh@296 -- # x722=() 00:22:51.420 15:46:42 -- nvmf/common.sh@296 -- # local -ga x722 00:22:51.420 15:46:42 -- nvmf/common.sh@297 -- # mlx=() 00:22:51.420 15:46:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:51.420 15:46:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:51.420 15:46:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:51.420 15:46:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:51.420 15:46:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:51.420 15:46:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:51.420 15:46:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:51.420 15:46:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:51.420 15:46:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:51.420 15:46:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:51.420 15:46:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:51.420 15:46:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:51.420 15:46:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:51.420 15:46:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:51.420 15:46:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:51.420 15:46:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:51.420 15:46:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:51.420 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:51.420 15:46:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:51.420 15:46:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:51.420 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:51.420 15:46:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:51.420 15:46:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:51.420 15:46:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:51.420 15:46:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:51.420 15:46:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:51.420 15:46:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:51.420 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:51.420 15:46:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:51.420 15:46:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:51.420 15:46:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:51.420 15:46:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:51.420 15:46:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:51.420 15:46:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:51.420 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:51.420 15:46:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:51.420 15:46:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:51.420 15:46:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:51.420 15:46:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:51.420 15:46:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:51.420 15:46:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:51.420 15:46:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:51.420 15:46:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:51.420 15:46:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:51.420 15:46:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:51.420 15:46:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:51.420 15:46:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:51.420 15:46:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:51.420 15:46:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:51.420 15:46:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:51.420 15:46:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:51.420 15:46:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:51.420 15:46:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:51.420 15:46:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:51.420 15:46:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:51.420 15:46:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:51.420 15:46:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:51.420 15:46:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:51.420 15:46:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:51.420 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:51.420 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:22:51.420 00:22:51.420 --- 10.0.0.2 ping statistics --- 00:22:51.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:51.420 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:22:51.420 15:46:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:51.420 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:51.420 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:22:51.420 00:22:51.420 --- 10.0.0.1 ping statistics --- 00:22:51.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:51.420 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:22:51.420 15:46:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:51.420 15:46:42 -- nvmf/common.sh@410 -- # return 0 00:22:51.420 15:46:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:51.420 15:46:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:51.420 15:46:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:51.420 15:46:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:51.421 15:46:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:51.421 15:46:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:51.421 15:46:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:51.421 15:46:42 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:22:51.421 15:46:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:51.421 15:46:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:51.421 15:46:42 -- common/autotest_common.sh@10 -- # set +x 00:22:51.421 15:46:42 -- nvmf/common.sh@469 -- # nvmfpid=943650 00:22:51.421 15:46:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:51.421 15:46:42 -- nvmf/common.sh@470 -- # waitforlisten 943650 00:22:51.421 15:46:42 -- common/autotest_common.sh@829 -- # '[' -z 943650 ']' 00:22:51.421 15:46:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:51.421 15:46:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:51.421 15:46:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:51.421 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:51.421 15:46:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:51.421 15:46:42 -- common/autotest_common.sh@10 -- # set +x 00:22:51.421 [2024-11-26 15:46:42.801483] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:51.421 [2024-11-26 15:46:42.801561] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:51.421 EAL: No free 2048 kB hugepages reported on node 1 00:22:51.679 [2024-11-26 15:46:42.872199] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:51.679 [2024-11-26 15:46:42.991750] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:51.679 [2024-11-26 15:46:42.991900] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:51.679 [2024-11-26 15:46:42.991928] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:51.679 [2024-11-26 15:46:42.991948] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:51.679 [2024-11-26 15:46:42.992022] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:51.679 [2024-11-26 15:46:42.992053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:51.679 [2024-11-26 15:46:42.992107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:51.679 [2024-11-26 15:46:42.992110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:52.612 15:46:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:52.612 15:46:43 -- common/autotest_common.sh@862 -- # return 0 00:22:52.612 15:46:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:52.612 15:46:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:52.612 15:46:43 -- common/autotest_common.sh@10 -- # set +x 00:22:52.612 15:46:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:52.612 15:46:43 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:22:52.612 15:46:43 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:22:55.946 15:46:46 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:22:55.946 15:46:46 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:22:55.946 15:46:47 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:22:55.946 15:46:47 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:22:56.204 15:46:47 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:22:56.204 15:46:47 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:22:56.204 15:46:47 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:22:56.204 15:46:47 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:22:56.204 15:46:47 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:22:56.204 [2024-11-26 15:46:47.641780] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:56.462 15:46:47 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:56.720 15:46:47 -- host/perf.sh@45 -- # for bdev in $bdevs 00:22:56.720 15:46:47 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:56.720 15:46:48 -- host/perf.sh@45 -- # for bdev in $bdevs 00:22:56.720 15:46:48 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:22:56.979 15:46:48 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:57.238 [2024-11-26 15:46:48.664714] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:57.495 15:46:48 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:22:57.495 15:46:48 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:22:57.495 15:46:48 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:22:57.495 15:46:48 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:22:57.495 15:46:48 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:22:58.869 Initializing NVMe Controllers 00:22:58.869 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:22:58.869 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:22:58.869 Initialization complete. Launching workers. 00:22:58.869 ======================================================== 00:22:58.869 Latency(us) 00:22:58.869 Device Information : IOPS MiB/s Average min max 00:22:58.869 PCIE (0000:88:00.0) NSID 1 from core 0: 85923.70 335.64 371.91 27.90 4301.92 00:22:58.869 ======================================================== 00:22:58.869 Total : 85923.70 335.64 371.91 27.90 4301.92 00:22:58.869 00:22:58.869 15:46:50 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:58.869 EAL: No free 2048 kB hugepages reported on node 1 00:23:00.242 Initializing NVMe Controllers 00:23:00.242 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:00.242 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:00.242 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:00.242 Initialization complete. Launching workers. 00:23:00.242 ======================================================== 00:23:00.242 Latency(us) 00:23:00.242 Device Information : IOPS MiB/s Average min max 00:23:00.242 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 97.65 0.38 10240.14 154.17 45730.48 00:23:00.242 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 51.82 0.20 19451.27 7938.23 47897.09 00:23:00.242 ======================================================== 00:23:00.242 Total : 149.47 0.58 13433.34 154.17 47897.09 00:23:00.242 00:23:00.242 15:46:51 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:00.242 EAL: No free 2048 kB hugepages reported on node 1 00:23:01.618 Initializing NVMe Controllers 00:23:01.618 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:01.618 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:01.618 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:01.618 Initialization complete. Launching workers. 00:23:01.618 ======================================================== 00:23:01.618 Latency(us) 00:23:01.618 Device Information : IOPS MiB/s Average min max 00:23:01.618 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8592.03 33.56 3724.66 752.30 9810.09 00:23:01.618 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3670.17 14.34 8756.80 4446.10 16790.95 00:23:01.618 ======================================================== 00:23:01.618 Total : 12262.20 47.90 5230.82 752.30 16790.95 00:23:01.618 00:23:01.618 15:46:52 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:01.618 15:46:52 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:01.618 15:46:52 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:01.618 EAL: No free 2048 kB hugepages reported on node 1 00:23:04.150 Initializing NVMe Controllers 00:23:04.150 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:04.150 Controller IO queue size 128, less than required. 00:23:04.150 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:04.150 Controller IO queue size 128, less than required. 00:23:04.150 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:04.150 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:04.150 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:04.150 Initialization complete. Launching workers. 00:23:04.150 ======================================================== 00:23:04.150 Latency(us) 00:23:04.150 Device Information : IOPS MiB/s Average min max 00:23:04.150 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1529.67 382.42 85444.01 58923.10 122356.49 00:23:04.150 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 566.27 141.57 233219.72 75142.89 364580.34 00:23:04.150 ======================================================== 00:23:04.150 Total : 2095.94 523.99 125369.13 58923.10 364580.34 00:23:04.150 00:23:04.150 15:46:55 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:04.150 EAL: No free 2048 kB hugepages reported on node 1 00:23:04.409 No valid NVMe controllers or AIO or URING devices found 00:23:04.409 Initializing NVMe Controllers 00:23:04.409 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:04.409 Controller IO queue size 128, less than required. 00:23:04.409 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:04.409 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:04.409 Controller IO queue size 128, less than required. 00:23:04.409 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:04.409 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:04.409 WARNING: Some requested NVMe devices were skipped 00:23:04.409 15:46:55 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:04.409 EAL: No free 2048 kB hugepages reported on node 1 00:23:06.939 Initializing NVMe Controllers 00:23:06.939 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:06.939 Controller IO queue size 128, less than required. 00:23:06.939 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:06.939 Controller IO queue size 128, less than required. 00:23:06.939 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:06.939 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:06.939 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:06.939 Initialization complete. Launching workers. 00:23:06.939 00:23:06.939 ==================== 00:23:06.939 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:06.939 TCP transport: 00:23:06.939 polls: 10009 00:23:06.939 idle_polls: 5791 00:23:06.939 sock_completions: 4218 00:23:06.939 nvme_completions: 5257 00:23:06.939 submitted_requests: 7984 00:23:06.939 queued_requests: 1 00:23:06.939 00:23:06.939 ==================== 00:23:06.939 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:06.939 TCP transport: 00:23:06.939 polls: 10240 00:23:06.939 idle_polls: 5626 00:23:06.939 sock_completions: 4614 00:23:06.939 nvme_completions: 6126 00:23:06.939 submitted_requests: 9340 00:23:06.939 queued_requests: 1 00:23:06.939 ======================================================== 00:23:06.939 Latency(us) 00:23:06.939 Device Information : IOPS MiB/s Average min max 00:23:06.939 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1375.81 343.95 94742.05 65380.36 168901.99 00:23:06.939 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1592.47 398.12 81468.99 43787.15 117681.31 00:23:06.939 ======================================================== 00:23:06.939 Total : 2968.28 742.07 87621.12 43787.15 168901.99 00:23:06.939 00:23:06.939 15:46:58 -- host/perf.sh@66 -- # sync 00:23:06.939 15:46:58 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:07.197 15:46:58 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:07.197 15:46:58 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:07.197 15:46:58 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:10.476 15:47:01 -- host/perf.sh@72 -- # ls_guid=f1b20313-6b58-4cde-9d92-bd23f2de747d 00:23:10.476 15:47:01 -- host/perf.sh@73 -- # get_lvs_free_mb f1b20313-6b58-4cde-9d92-bd23f2de747d 00:23:10.476 15:47:01 -- common/autotest_common.sh@1353 -- # local lvs_uuid=f1b20313-6b58-4cde-9d92-bd23f2de747d 00:23:10.476 15:47:01 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:10.476 15:47:01 -- common/autotest_common.sh@1355 -- # local fc 00:23:10.476 15:47:01 -- common/autotest_common.sh@1356 -- # local cs 00:23:10.476 15:47:01 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:10.734 15:47:01 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:10.734 { 00:23:10.734 "uuid": "f1b20313-6b58-4cde-9d92-bd23f2de747d", 00:23:10.734 "name": "lvs_0", 00:23:10.734 "base_bdev": "Nvme0n1", 00:23:10.734 "total_data_clusters": 238234, 00:23:10.734 "free_clusters": 238234, 00:23:10.734 "block_size": 512, 00:23:10.734 "cluster_size": 4194304 00:23:10.734 } 00:23:10.734 ]' 00:23:10.734 15:47:01 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="f1b20313-6b58-4cde-9d92-bd23f2de747d") .free_clusters' 00:23:10.734 15:47:01 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:10.734 15:47:01 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="f1b20313-6b58-4cde-9d92-bd23f2de747d") .cluster_size' 00:23:10.734 15:47:02 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:10.734 15:47:02 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:10.734 15:47:02 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:10.734 952936 00:23:10.734 15:47:02 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:10.734 15:47:02 -- host/perf.sh@78 -- # free_mb=20480 00:23:10.734 15:47:02 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u f1b20313-6b58-4cde-9d92-bd23f2de747d lbd_0 20480 00:23:11.300 15:47:02 -- host/perf.sh@80 -- # lb_guid=69d57b56-b145-4c65-8102-01062c4341b8 00:23:11.300 15:47:02 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 69d57b56-b145-4c65-8102-01062c4341b8 lvs_n_0 00:23:12.235 15:47:03 -- host/perf.sh@83 -- # ls_nested_guid=c4e19eea-56da-4fb6-85c5-74b3bfa5606b 00:23:12.235 15:47:03 -- host/perf.sh@84 -- # get_lvs_free_mb c4e19eea-56da-4fb6-85c5-74b3bfa5606b 00:23:12.235 15:47:03 -- common/autotest_common.sh@1353 -- # local lvs_uuid=c4e19eea-56da-4fb6-85c5-74b3bfa5606b 00:23:12.235 15:47:03 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:12.235 15:47:03 -- common/autotest_common.sh@1355 -- # local fc 00:23:12.235 15:47:03 -- common/autotest_common.sh@1356 -- # local cs 00:23:12.235 15:47:03 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:12.235 15:47:03 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:12.235 { 00:23:12.235 "uuid": "f1b20313-6b58-4cde-9d92-bd23f2de747d", 00:23:12.235 "name": "lvs_0", 00:23:12.235 "base_bdev": "Nvme0n1", 00:23:12.235 "total_data_clusters": 238234, 00:23:12.235 "free_clusters": 233114, 00:23:12.235 "block_size": 512, 00:23:12.235 "cluster_size": 4194304 00:23:12.235 }, 00:23:12.235 { 00:23:12.235 "uuid": "c4e19eea-56da-4fb6-85c5-74b3bfa5606b", 00:23:12.235 "name": "lvs_n_0", 00:23:12.235 "base_bdev": "69d57b56-b145-4c65-8102-01062c4341b8", 00:23:12.235 "total_data_clusters": 5114, 00:23:12.235 "free_clusters": 5114, 00:23:12.235 "block_size": 512, 00:23:12.235 "cluster_size": 4194304 00:23:12.235 } 00:23:12.235 ]' 00:23:12.235 15:47:03 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="c4e19eea-56da-4fb6-85c5-74b3bfa5606b") .free_clusters' 00:23:12.235 15:47:03 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:12.235 15:47:03 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="c4e19eea-56da-4fb6-85c5-74b3bfa5606b") .cluster_size' 00:23:12.493 15:47:03 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:12.493 15:47:03 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:12.493 15:47:03 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:12.493 20456 00:23:12.493 15:47:03 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:12.493 15:47:03 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u c4e19eea-56da-4fb6-85c5-74b3bfa5606b lbd_nest_0 20456 00:23:12.750 15:47:03 -- host/perf.sh@88 -- # lb_nested_guid=1bed9230-397e-4721-9447-24ddc604a6bc 00:23:12.750 15:47:03 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:13.009 15:47:04 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:13.009 15:47:04 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 1bed9230-397e-4721-9447-24ddc604a6bc 00:23:13.267 15:47:04 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:13.267 15:47:04 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:13.267 15:47:04 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:13.267 15:47:04 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:13.267 15:47:04 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:13.267 15:47:04 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:13.525 EAL: No free 2048 kB hugepages reported on node 1 00:23:25.722 Initializing NVMe Controllers 00:23:25.722 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:25.722 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:25.722 Initialization complete. Launching workers. 00:23:25.722 ======================================================== 00:23:25.722 Latency(us) 00:23:25.722 Device Information : IOPS MiB/s Average min max 00:23:25.722 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 48.00 0.02 20908.72 181.16 45950.94 00:23:25.722 ======================================================== 00:23:25.722 Total : 48.00 0.02 20908.72 181.16 45950.94 00:23:25.722 00:23:25.722 15:47:15 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:25.722 15:47:15 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:25.722 EAL: No free 2048 kB hugepages reported on node 1 00:23:35.686 Initializing NVMe Controllers 00:23:35.686 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:35.686 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:35.686 Initialization complete. Launching workers. 00:23:35.686 ======================================================== 00:23:35.686 Latency(us) 00:23:35.686 Device Information : IOPS MiB/s Average min max 00:23:35.686 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 82.50 10.31 12139.43 5986.05 50834.73 00:23:35.686 ======================================================== 00:23:35.686 Total : 82.50 10.31 12139.43 5986.05 50834.73 00:23:35.686 00:23:35.686 15:47:25 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:35.686 15:47:25 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:35.686 15:47:25 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:35.686 EAL: No free 2048 kB hugepages reported on node 1 00:23:45.655 Initializing NVMe Controllers 00:23:45.655 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:45.655 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:45.655 Initialization complete. Launching workers. 00:23:45.655 ======================================================== 00:23:45.655 Latency(us) 00:23:45.655 Device Information : IOPS MiB/s Average min max 00:23:45.655 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7441.10 3.63 4301.00 420.96 11116.06 00:23:45.655 ======================================================== 00:23:45.655 Total : 7441.10 3.63 4301.00 420.96 11116.06 00:23:45.655 00:23:45.655 15:47:35 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:45.655 15:47:35 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:45.655 EAL: No free 2048 kB hugepages reported on node 1 00:23:55.624 Initializing NVMe Controllers 00:23:55.624 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:55.624 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:55.624 Initialization complete. Launching workers. 00:23:55.624 ======================================================== 00:23:55.624 Latency(us) 00:23:55.624 Device Information : IOPS MiB/s Average min max 00:23:55.624 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 2659.70 332.46 12039.94 752.36 24790.16 00:23:55.624 ======================================================== 00:23:55.624 Total : 2659.70 332.46 12039.94 752.36 24790.16 00:23:55.624 00:23:55.624 15:47:46 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:55.624 15:47:46 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:55.624 15:47:46 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:55.624 EAL: No free 2048 kB hugepages reported on node 1 00:24:05.665 Initializing NVMe Controllers 00:24:05.665 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:05.665 Controller IO queue size 128, less than required. 00:24:05.665 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:05.665 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:05.665 Initialization complete. Launching workers. 00:24:05.665 ======================================================== 00:24:05.665 Latency(us) 00:24:05.665 Device Information : IOPS MiB/s Average min max 00:24:05.665 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12017.03 5.87 10653.44 1690.03 25411.18 00:24:05.665 ======================================================== 00:24:05.665 Total : 12017.03 5.87 10653.44 1690.03 25411.18 00:24:05.665 00:24:05.665 15:47:56 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:05.665 15:47:56 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:05.665 EAL: No free 2048 kB hugepages reported on node 1 00:24:17.863 Initializing NVMe Controllers 00:24:17.863 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:17.863 Controller IO queue size 128, less than required. 00:24:17.863 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:17.863 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:17.863 Initialization complete. Launching workers. 00:24:17.863 ======================================================== 00:24:17.863 Latency(us) 00:24:17.863 Device Information : IOPS MiB/s Average min max 00:24:17.863 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1208.30 151.04 106676.45 23691.98 218848.16 00:24:17.863 ======================================================== 00:24:17.863 Total : 1208.30 151.04 106676.45 23691.98 218848.16 00:24:17.863 00:24:17.863 15:48:07 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:17.863 15:48:07 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 1bed9230-397e-4721-9447-24ddc604a6bc 00:24:17.863 15:48:08 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:17.864 15:48:08 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 69d57b56-b145-4c65-8102-01062c4341b8 00:24:17.864 15:48:08 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:17.864 15:48:09 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:17.864 15:48:09 -- host/perf.sh@114 -- # nvmftestfini 00:24:17.864 15:48:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:17.864 15:48:09 -- nvmf/common.sh@116 -- # sync 00:24:17.864 15:48:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:17.864 15:48:09 -- nvmf/common.sh@119 -- # set +e 00:24:17.864 15:48:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:17.864 15:48:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:17.864 rmmod nvme_tcp 00:24:17.864 rmmod nvme_fabrics 00:24:17.864 rmmod nvme_keyring 00:24:17.864 15:48:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:17.864 15:48:09 -- nvmf/common.sh@123 -- # set -e 00:24:17.864 15:48:09 -- nvmf/common.sh@124 -- # return 0 00:24:17.864 15:48:09 -- nvmf/common.sh@477 -- # '[' -n 943650 ']' 00:24:17.864 15:48:09 -- nvmf/common.sh@478 -- # killprocess 943650 00:24:17.864 15:48:09 -- common/autotest_common.sh@936 -- # '[' -z 943650 ']' 00:24:17.864 15:48:09 -- common/autotest_common.sh@940 -- # kill -0 943650 00:24:17.864 15:48:09 -- common/autotest_common.sh@941 -- # uname 00:24:17.864 15:48:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:17.864 15:48:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 943650 00:24:17.864 15:48:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:17.864 15:48:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:17.864 15:48:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 943650' 00:24:17.864 killing process with pid 943650 00:24:17.864 15:48:09 -- common/autotest_common.sh@955 -- # kill 943650 00:24:17.864 15:48:09 -- common/autotest_common.sh@960 -- # wait 943650 00:24:19.766 15:48:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:19.766 15:48:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:19.766 15:48:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:19.766 15:48:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:19.766 15:48:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:19.766 15:48:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:19.766 15:48:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:19.766 15:48:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:21.670 15:48:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:21.670 00:24:21.670 real 1m32.528s 00:24:21.670 user 5m37.147s 00:24:21.670 sys 0m16.596s 00:24:21.670 15:48:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:21.670 15:48:12 -- common/autotest_common.sh@10 -- # set +x 00:24:21.670 ************************************ 00:24:21.670 END TEST nvmf_perf 00:24:21.670 ************************************ 00:24:21.670 15:48:12 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:21.670 15:48:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:21.670 15:48:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:21.670 15:48:12 -- common/autotest_common.sh@10 -- # set +x 00:24:21.670 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:24:21.671 ************************************ 00:24:21.671 START TEST nvmf_fio_host 00:24:21.671 ************************************ 00:24:21.671 15:48:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:21.671 * Looking for test storage... 00:24:21.671 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:21.671 15:48:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:21.671 15:48:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:21.671 15:48:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:21.930 15:48:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:21.930 15:48:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:21.930 15:48:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:21.930 15:48:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:21.930 15:48:13 -- scripts/common.sh@335 -- # IFS=.-: 00:24:21.930 15:48:13 -- scripts/common.sh@335 -- # read -ra ver1 00:24:21.930 15:48:13 -- scripts/common.sh@336 -- # IFS=.-: 00:24:21.930 15:48:13 -- scripts/common.sh@336 -- # read -ra ver2 00:24:21.930 15:48:13 -- scripts/common.sh@337 -- # local 'op=<' 00:24:21.930 15:48:13 -- scripts/common.sh@339 -- # ver1_l=2 00:24:21.930 15:48:13 -- scripts/common.sh@340 -- # ver2_l=1 00:24:21.930 15:48:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:21.930 15:48:13 -- scripts/common.sh@343 -- # case "$op" in 00:24:21.930 15:48:13 -- scripts/common.sh@344 -- # : 1 00:24:21.930 15:48:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:21.930 15:48:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:21.930 15:48:13 -- scripts/common.sh@364 -- # decimal 1 00:24:21.930 15:48:13 -- scripts/common.sh@352 -- # local d=1 00:24:21.930 15:48:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:21.930 15:48:13 -- scripts/common.sh@354 -- # echo 1 00:24:21.930 15:48:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:21.930 15:48:13 -- scripts/common.sh@365 -- # decimal 2 00:24:21.930 15:48:13 -- scripts/common.sh@352 -- # local d=2 00:24:21.930 15:48:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:21.930 15:48:13 -- scripts/common.sh@354 -- # echo 2 00:24:21.930 15:48:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:21.930 15:48:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:21.930 15:48:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:21.930 15:48:13 -- scripts/common.sh@367 -- # return 0 00:24:21.930 15:48:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:21.930 15:48:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:21.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:21.930 --rc genhtml_branch_coverage=1 00:24:21.930 --rc genhtml_function_coverage=1 00:24:21.930 --rc genhtml_legend=1 00:24:21.930 --rc geninfo_all_blocks=1 00:24:21.930 --rc geninfo_unexecuted_blocks=1 00:24:21.930 00:24:21.930 ' 00:24:21.930 15:48:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:21.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:21.930 --rc genhtml_branch_coverage=1 00:24:21.930 --rc genhtml_function_coverage=1 00:24:21.930 --rc genhtml_legend=1 00:24:21.930 --rc geninfo_all_blocks=1 00:24:21.930 --rc geninfo_unexecuted_blocks=1 00:24:21.930 00:24:21.930 ' 00:24:21.930 15:48:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:21.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:21.930 --rc genhtml_branch_coverage=1 00:24:21.930 --rc genhtml_function_coverage=1 00:24:21.930 --rc genhtml_legend=1 00:24:21.930 --rc geninfo_all_blocks=1 00:24:21.930 --rc geninfo_unexecuted_blocks=1 00:24:21.930 00:24:21.930 ' 00:24:21.930 15:48:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:21.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:21.930 --rc genhtml_branch_coverage=1 00:24:21.930 --rc genhtml_function_coverage=1 00:24:21.930 --rc genhtml_legend=1 00:24:21.930 --rc geninfo_all_blocks=1 00:24:21.930 --rc geninfo_unexecuted_blocks=1 00:24:21.930 00:24:21.930 ' 00:24:21.930 15:48:13 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:21.930 15:48:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:21.930 15:48:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:21.930 15:48:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:21.930 15:48:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.930 15:48:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.930 15:48:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.930 15:48:13 -- paths/export.sh@5 -- # export PATH 00:24:21.930 15:48:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.930 15:48:13 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:21.930 15:48:13 -- nvmf/common.sh@7 -- # uname -s 00:24:21.930 15:48:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:21.930 15:48:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:21.930 15:48:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:21.930 15:48:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:21.930 15:48:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:21.930 15:48:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:21.930 15:48:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:21.930 15:48:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:21.930 15:48:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:21.930 15:48:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:21.930 15:48:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:21.930 15:48:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:21.930 15:48:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:21.930 15:48:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:21.930 15:48:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:21.930 15:48:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:21.930 15:48:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:21.930 15:48:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:21.930 15:48:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:21.931 15:48:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.931 15:48:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.931 15:48:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.931 15:48:13 -- paths/export.sh@5 -- # export PATH 00:24:21.931 15:48:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.931 15:48:13 -- nvmf/common.sh@46 -- # : 0 00:24:21.931 15:48:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:21.931 15:48:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:21.931 15:48:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:21.931 15:48:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:21.931 15:48:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:21.931 15:48:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:21.931 15:48:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:21.931 15:48:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:21.931 15:48:13 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:21.931 15:48:13 -- host/fio.sh@14 -- # nvmftestinit 00:24:21.931 15:48:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:21.931 15:48:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:21.931 15:48:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:21.931 15:48:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:21.931 15:48:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:21.931 15:48:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:21.931 15:48:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:21.931 15:48:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:21.931 15:48:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:21.931 15:48:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:21.931 15:48:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:21.931 15:48:13 -- common/autotest_common.sh@10 -- # set +x 00:24:23.833 15:48:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:23.833 15:48:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:23.833 15:48:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:23.833 15:48:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:23.833 15:48:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:23.833 15:48:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:23.833 15:48:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:23.833 15:48:15 -- nvmf/common.sh@294 -- # net_devs=() 00:24:23.833 15:48:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:23.833 15:48:15 -- nvmf/common.sh@295 -- # e810=() 00:24:23.833 15:48:15 -- nvmf/common.sh@295 -- # local -ga e810 00:24:23.833 15:48:15 -- nvmf/common.sh@296 -- # x722=() 00:24:23.833 15:48:15 -- nvmf/common.sh@296 -- # local -ga x722 00:24:23.833 15:48:15 -- nvmf/common.sh@297 -- # mlx=() 00:24:23.833 15:48:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:23.833 15:48:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:23.833 15:48:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:23.833 15:48:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:23.833 15:48:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:23.833 15:48:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:23.833 15:48:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:23.833 15:48:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:23.833 15:48:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:23.833 15:48:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:23.833 15:48:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:23.833 15:48:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:23.833 15:48:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:23.833 15:48:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:23.833 15:48:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:23.833 15:48:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:23.833 15:48:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:23.833 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:23.833 15:48:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:23.833 15:48:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:23.833 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:23.833 15:48:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:23.833 15:48:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:23.833 15:48:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:23.833 15:48:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:23.833 15:48:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:23.833 15:48:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:23.833 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:23.833 15:48:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:23.833 15:48:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:23.833 15:48:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:23.833 15:48:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:23.833 15:48:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:23.833 15:48:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:23.833 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:23.833 15:48:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:23.833 15:48:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:23.833 15:48:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:23.833 15:48:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:23.833 15:48:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:23.833 15:48:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:23.833 15:48:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:23.833 15:48:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:23.833 15:48:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:23.833 15:48:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:23.833 15:48:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:23.833 15:48:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:23.833 15:48:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:23.833 15:48:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:23.833 15:48:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:23.833 15:48:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:23.833 15:48:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:23.833 15:48:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:23.833 15:48:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:23.833 15:48:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:23.833 15:48:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:23.833 15:48:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:24.092 15:48:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:24.092 15:48:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:24.092 15:48:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:24.092 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:24.092 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:24:24.092 00:24:24.092 --- 10.0.0.2 ping statistics --- 00:24:24.092 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:24.092 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:24:24.092 15:48:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:24.092 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:24.092 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:24:24.092 00:24:24.092 --- 10.0.0.1 ping statistics --- 00:24:24.092 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:24.092 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:24:24.092 15:48:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:24.092 15:48:15 -- nvmf/common.sh@410 -- # return 0 00:24:24.092 15:48:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:24.092 15:48:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:24.092 15:48:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:24.092 15:48:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:24.092 15:48:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:24.092 15:48:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:24.092 15:48:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:24.092 15:48:15 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:24.092 15:48:15 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:24.092 15:48:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:24.092 15:48:15 -- common/autotest_common.sh@10 -- # set +x 00:24:24.092 15:48:15 -- host/fio.sh@24 -- # nvmfpid=956309 00:24:24.092 15:48:15 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:24.092 15:48:15 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:24.092 15:48:15 -- host/fio.sh@28 -- # waitforlisten 956309 00:24:24.092 15:48:15 -- common/autotest_common.sh@829 -- # '[' -z 956309 ']' 00:24:24.092 15:48:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:24.092 15:48:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:24.092 15:48:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:24.092 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:24.092 15:48:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:24.092 15:48:15 -- common/autotest_common.sh@10 -- # set +x 00:24:24.092 [2024-11-26 15:48:15.406330] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:24.092 [2024-11-26 15:48:15.406399] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:24.092 EAL: No free 2048 kB hugepages reported on node 1 00:24:24.092 [2024-11-26 15:48:15.476276] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:24.352 [2024-11-26 15:48:15.592700] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:24.352 [2024-11-26 15:48:15.592857] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:24.352 [2024-11-26 15:48:15.592888] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:24.352 [2024-11-26 15:48:15.592910] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:24.352 [2024-11-26 15:48:15.592981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:24.352 [2024-11-26 15:48:15.593019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:24.352 [2024-11-26 15:48:15.593085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:24.352 [2024-11-26 15:48:15.593089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:24.918 15:48:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:24.918 15:48:16 -- common/autotest_common.sh@862 -- # return 0 00:24:24.918 15:48:16 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:25.483 [2024-11-26 15:48:16.636015] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:25.483 15:48:16 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:25.483 15:48:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:25.483 15:48:16 -- common/autotest_common.sh@10 -- # set +x 00:24:25.483 15:48:16 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:25.741 Malloc1 00:24:25.741 15:48:17 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:25.998 15:48:17 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:26.254 15:48:17 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:26.512 [2024-11-26 15:48:17.739171] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:26.512 15:48:17 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:26.777 15:48:18 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:26.777 15:48:18 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:26.777 15:48:18 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:26.777 15:48:18 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:26.777 15:48:18 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:26.777 15:48:18 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:26.777 15:48:18 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:26.777 15:48:18 -- common/autotest_common.sh@1330 -- # shift 00:24:26.777 15:48:18 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:26.777 15:48:18 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:26.777 15:48:18 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:26.777 15:48:18 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:26.777 15:48:18 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:26.777 15:48:18 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:26.777 15:48:18 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:26.777 15:48:18 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:26.777 15:48:18 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:26.777 15:48:18 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:26.777 15:48:18 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:26.777 15:48:18 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:26.777 15:48:18 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:26.777 15:48:18 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:26.777 15:48:18 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:27.036 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:27.036 fio-3.35 00:24:27.036 Starting 1 thread 00:24:27.036 EAL: No free 2048 kB hugepages reported on node 1 00:24:29.576 00:24:29.577 test: (groupid=0, jobs=1): err= 0: pid=956791: Tue Nov 26 15:48:20 2024 00:24:29.577 read: IOPS=9481, BW=37.0MiB/s (38.8MB/s)(74.3MiB/2006msec) 00:24:29.577 slat (nsec): min=1772, max=168509, avg=2359.55, stdev=1951.65 00:24:29.577 clat (usec): min=2232, max=13665, avg=7453.59, stdev=564.05 00:24:29.577 lat (usec): min=2257, max=13667, avg=7455.94, stdev=563.94 00:24:29.577 clat percentiles (usec): 00:24:29.577 | 1.00th=[ 6194], 5.00th=[ 6587], 10.00th=[ 6783], 20.00th=[ 7046], 00:24:29.577 | 30.00th=[ 7177], 40.00th=[ 7308], 50.00th=[ 7439], 60.00th=[ 7570], 00:24:29.577 | 70.00th=[ 7701], 80.00th=[ 7898], 90.00th=[ 8160], 95.00th=[ 8291], 00:24:29.577 | 99.00th=[ 8717], 99.50th=[ 8717], 99.90th=[10814], 99.95th=[12518], 00:24:29.577 | 99.99th=[13698] 00:24:29.577 bw ( KiB/s): min=37064, max=38656, per=99.97%, avg=37912.00, stdev=654.08, samples=4 00:24:29.577 iops : min= 9266, max= 9664, avg=9478.00, stdev=163.52, samples=4 00:24:29.577 write: IOPS=9491, BW=37.1MiB/s (38.9MB/s)(74.4MiB/2006msec); 0 zone resets 00:24:29.577 slat (usec): min=2, max=139, avg= 2.57, stdev= 1.57 00:24:29.577 clat (usec): min=1755, max=10874, avg=5992.33, stdev=490.51 00:24:29.577 lat (usec): min=1764, max=10876, avg=5994.90, stdev=490.46 00:24:29.577 clat percentiles (usec): 00:24:29.577 | 1.00th=[ 4883], 5.00th=[ 5276], 10.00th=[ 5407], 20.00th=[ 5604], 00:24:29.577 | 30.00th=[ 5735], 40.00th=[ 5866], 50.00th=[ 5997], 60.00th=[ 6128], 00:24:29.577 | 70.00th=[ 6259], 80.00th=[ 6390], 90.00th=[ 6587], 95.00th=[ 6718], 00:24:29.577 | 99.00th=[ 7046], 99.50th=[ 7242], 99.90th=[ 9634], 99.95th=[10552], 00:24:29.577 | 99.99th=[10814] 00:24:29.577 bw ( KiB/s): min=37888, max=38144, per=99.96%, avg=37952.00, stdev=128.00, samples=4 00:24:29.577 iops : min= 9472, max= 9536, avg=9488.00, stdev=32.00, samples=4 00:24:29.577 lat (msec) : 2=0.02%, 4=0.10%, 10=99.77%, 20=0.11% 00:24:29.577 cpu : usr=60.90%, sys=35.41%, ctx=70, majf=0, minf=37 00:24:29.577 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:29.577 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:29.577 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:29.577 issued rwts: total=19019,19040,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:29.577 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:29.577 00:24:29.577 Run status group 0 (all jobs): 00:24:29.577 READ: bw=37.0MiB/s (38.8MB/s), 37.0MiB/s-37.0MiB/s (38.8MB/s-38.8MB/s), io=74.3MiB (77.9MB), run=2006-2006msec 00:24:29.577 WRITE: bw=37.1MiB/s (38.9MB/s), 37.1MiB/s-37.1MiB/s (38.9MB/s-38.9MB/s), io=74.4MiB (78.0MB), run=2006-2006msec 00:24:29.577 15:48:20 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:29.577 15:48:20 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:29.577 15:48:20 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:29.577 15:48:20 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:29.577 15:48:20 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:29.577 15:48:20 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:29.577 15:48:20 -- common/autotest_common.sh@1330 -- # shift 00:24:29.577 15:48:20 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:29.577 15:48:20 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:29.577 15:48:20 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:29.577 15:48:20 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:29.577 15:48:20 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:29.577 15:48:20 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:29.577 15:48:20 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:29.577 15:48:20 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:29.577 15:48:20 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:29.577 15:48:20 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:29.577 15:48:20 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:29.577 15:48:20 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:29.577 15:48:20 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:29.577 15:48:20 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:29.577 15:48:20 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:29.577 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:24:29.577 fio-3.35 00:24:29.577 Starting 1 thread 00:24:29.577 EAL: No free 2048 kB hugepages reported on node 1 00:24:32.107 00:24:32.107 test: (groupid=0, jobs=1): err= 0: pid=957118: Tue Nov 26 15:48:23 2024 00:24:32.107 read: IOPS=8389, BW=131MiB/s (137MB/s)(263MiB/2007msec) 00:24:32.107 slat (nsec): min=2829, max=92773, avg=3511.17, stdev=1602.05 00:24:32.107 clat (usec): min=2555, max=17598, avg=8843.63, stdev=2054.41 00:24:32.107 lat (usec): min=2559, max=17602, avg=8847.14, stdev=2054.45 00:24:32.107 clat percentiles (usec): 00:24:32.107 | 1.00th=[ 4752], 5.00th=[ 5473], 10.00th=[ 6128], 20.00th=[ 6980], 00:24:32.107 | 30.00th=[ 7701], 40.00th=[ 8356], 50.00th=[ 8848], 60.00th=[ 9372], 00:24:32.107 | 70.00th=[ 9896], 80.00th=[10552], 90.00th=[11469], 95.00th=[12256], 00:24:32.107 | 99.00th=[14091], 99.50th=[14484], 99.90th=[16712], 99.95th=[16909], 00:24:32.107 | 99.99th=[16909] 00:24:32.107 bw ( KiB/s): min=61280, max=82016, per=51.75%, avg=69464.00, stdev=9351.39, samples=4 00:24:32.107 iops : min= 3830, max= 5126, avg=4341.50, stdev=584.46, samples=4 00:24:32.107 write: IOPS=4965, BW=77.6MiB/s (81.3MB/s)(142MiB/1833msec); 0 zone resets 00:24:32.107 slat (usec): min=30, max=130, avg=32.98, stdev= 4.56 00:24:32.107 clat (usec): min=6371, max=18983, avg=11069.68, stdev=2112.83 00:24:32.107 lat (usec): min=6402, max=19019, avg=11102.66, stdev=2112.86 00:24:32.107 clat percentiles (usec): 00:24:32.107 | 1.00th=[ 7308], 5.00th=[ 8160], 10.00th=[ 8717], 20.00th=[ 9241], 00:24:32.107 | 30.00th=[ 9765], 40.00th=[10290], 50.00th=[10814], 60.00th=[11338], 00:24:32.107 | 70.00th=[11863], 80.00th=[12911], 90.00th=[14091], 95.00th=[15008], 00:24:32.107 | 99.00th=[16909], 99.50th=[17695], 99.90th=[18744], 99.95th=[18744], 00:24:32.107 | 99.99th=[19006] 00:24:32.107 bw ( KiB/s): min=64576, max=84928, per=90.96%, avg=72256.00, stdev=9181.75, samples=4 00:24:32.107 iops : min= 4036, max= 5308, avg=4516.00, stdev=573.86, samples=4 00:24:32.107 lat (msec) : 4=0.17%, 10=59.05%, 20=40.78% 00:24:32.107 cpu : usr=75.32%, sys=22.03%, ctx=41, majf=0, minf=69 00:24:32.107 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:24:32.107 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:32.107 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:32.107 issued rwts: total=16837,9101,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:32.107 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:32.107 00:24:32.107 Run status group 0 (all jobs): 00:24:32.107 READ: bw=131MiB/s (137MB/s), 131MiB/s-131MiB/s (137MB/s-137MB/s), io=263MiB (276MB), run=2007-2007msec 00:24:32.107 WRITE: bw=77.6MiB/s (81.3MB/s), 77.6MiB/s-77.6MiB/s (81.3MB/s-81.3MB/s), io=142MiB (149MB), run=1833-1833msec 00:24:32.107 15:48:23 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:32.107 15:48:23 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:24:32.107 15:48:23 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:24:32.107 15:48:23 -- host/fio.sh@51 -- # get_nvme_bdfs 00:24:32.107 15:48:23 -- common/autotest_common.sh@1508 -- # bdfs=() 00:24:32.107 15:48:23 -- common/autotest_common.sh@1508 -- # local bdfs 00:24:32.107 15:48:23 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:24:32.107 15:48:23 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:24:32.107 15:48:23 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:24:32.107 15:48:23 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:24:32.107 15:48:23 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:24:32.107 15:48:23 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:24:35.395 Nvme0n1 00:24:35.395 15:48:26 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:24:38.687 15:48:29 -- host/fio.sh@53 -- # ls_guid=ef1ed42b-fbe3-4d87-b531-39f706ea51d3 00:24:38.687 15:48:29 -- host/fio.sh@54 -- # get_lvs_free_mb ef1ed42b-fbe3-4d87-b531-39f706ea51d3 00:24:38.687 15:48:29 -- common/autotest_common.sh@1353 -- # local lvs_uuid=ef1ed42b-fbe3-4d87-b531-39f706ea51d3 00:24:38.687 15:48:29 -- common/autotest_common.sh@1354 -- # local lvs_info 00:24:38.687 15:48:29 -- common/autotest_common.sh@1355 -- # local fc 00:24:38.687 15:48:29 -- common/autotest_common.sh@1356 -- # local cs 00:24:38.687 15:48:29 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:38.687 15:48:29 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:24:38.687 { 00:24:38.687 "uuid": "ef1ed42b-fbe3-4d87-b531-39f706ea51d3", 00:24:38.687 "name": "lvs_0", 00:24:38.687 "base_bdev": "Nvme0n1", 00:24:38.687 "total_data_clusters": 930, 00:24:38.687 "free_clusters": 930, 00:24:38.687 "block_size": 512, 00:24:38.687 "cluster_size": 1073741824 00:24:38.687 } 00:24:38.687 ]' 00:24:38.687 15:48:29 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="ef1ed42b-fbe3-4d87-b531-39f706ea51d3") .free_clusters' 00:24:38.687 15:48:29 -- common/autotest_common.sh@1358 -- # fc=930 00:24:38.687 15:48:29 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="ef1ed42b-fbe3-4d87-b531-39f706ea51d3") .cluster_size' 00:24:38.687 15:48:29 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:24:38.687 15:48:29 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:24:38.687 15:48:29 -- common/autotest_common.sh@1363 -- # echo 952320 00:24:38.687 952320 00:24:38.687 15:48:29 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:24:38.946 9c4444f4-5241-45ba-b04c-7207c8f80834 00:24:38.946 15:48:30 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:24:39.204 15:48:30 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:24:39.463 15:48:30 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:24:39.721 15:48:31 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:39.721 15:48:31 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:39.721 15:48:31 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:39.721 15:48:31 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:39.721 15:48:31 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:39.721 15:48:31 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:39.721 15:48:31 -- common/autotest_common.sh@1330 -- # shift 00:24:39.721 15:48:31 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:39.721 15:48:31 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:39.721 15:48:31 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:39.721 15:48:31 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:39.721 15:48:31 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:39.721 15:48:31 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:39.721 15:48:31 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:39.721 15:48:31 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:39.721 15:48:31 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:39.721 15:48:31 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:39.721 15:48:31 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:39.721 15:48:31 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:39.721 15:48:31 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:39.721 15:48:31 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:39.721 15:48:31 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:39.980 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:39.980 fio-3.35 00:24:39.980 Starting 1 thread 00:24:39.980 EAL: No free 2048 kB hugepages reported on node 1 00:24:42.514 00:24:42.514 test: (groupid=0, jobs=1): err= 0: pid=958447: Tue Nov 26 15:48:33 2024 00:24:42.514 read: IOPS=6439, BW=25.2MiB/s (26.4MB/s)(50.5MiB/2008msec) 00:24:42.514 slat (nsec): min=1899, max=218117, avg=2503.48, stdev=2602.43 00:24:42.514 clat (usec): min=952, max=170608, avg=10942.92, stdev=11236.25 00:24:42.514 lat (usec): min=957, max=170655, avg=10945.42, stdev=11236.78 00:24:42.514 clat percentiles (msec): 00:24:42.514 | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 10], 00:24:42.514 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:24:42.514 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:24:42.514 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:24:42.514 | 99.99th=[ 171] 00:24:42.514 bw ( KiB/s): min=18024, max=28400, per=99.90%, avg=25732.00, stdev=5139.60, samples=4 00:24:42.514 iops : min= 4506, max= 7100, avg=6433.00, stdev=1284.90, samples=4 00:24:42.514 write: IOPS=6444, BW=25.2MiB/s (26.4MB/s)(50.5MiB/2008msec); 0 zone resets 00:24:42.514 slat (usec): min=2, max=205, avg= 2.58, stdev= 2.12 00:24:42.514 clat (usec): min=290, max=168802, avg=8783.78, stdev=10555.65 00:24:42.514 lat (usec): min=295, max=168813, avg=8786.36, stdev=10556.22 00:24:42.514 clat percentiles (msec): 00:24:42.514 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:24:42.514 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 9], 00:24:42.514 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 9], 95.00th=[ 10], 00:24:42.514 | 99.00th=[ 10], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:24:42.514 | 99.99th=[ 169] 00:24:42.514 bw ( KiB/s): min=19032, max=28160, per=99.91%, avg=25754.00, stdev=4483.24, samples=4 00:24:42.514 iops : min= 4758, max= 7040, avg=6438.50, stdev=1120.81, samples=4 00:24:42.514 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:24:42.514 lat (msec) : 2=0.03%, 4=0.18%, 10=70.56%, 20=28.71%, 250=0.49% 00:24:42.514 cpu : usr=63.48%, sys=33.73%, ctx=112, majf=0, minf=37 00:24:42.514 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:42.514 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:42.515 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:42.515 issued rwts: total=12930,12940,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:42.515 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:42.515 00:24:42.515 Run status group 0 (all jobs): 00:24:42.515 READ: bw=25.2MiB/s (26.4MB/s), 25.2MiB/s-25.2MiB/s (26.4MB/s-26.4MB/s), io=50.5MiB (53.0MB), run=2008-2008msec 00:24:42.515 WRITE: bw=25.2MiB/s (26.4MB/s), 25.2MiB/s-25.2MiB/s (26.4MB/s-26.4MB/s), io=50.5MiB (53.0MB), run=2008-2008msec 00:24:42.515 15:48:33 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:24:42.775 15:48:33 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:24:43.709 15:48:35 -- host/fio.sh@64 -- # ls_nested_guid=6f41c507-b880-44f5-a5e0-25f982c71e88 00:24:43.709 15:48:35 -- host/fio.sh@65 -- # get_lvs_free_mb 6f41c507-b880-44f5-a5e0-25f982c71e88 00:24:43.709 15:48:35 -- common/autotest_common.sh@1353 -- # local lvs_uuid=6f41c507-b880-44f5-a5e0-25f982c71e88 00:24:43.709 15:48:35 -- common/autotest_common.sh@1354 -- # local lvs_info 00:24:43.709 15:48:35 -- common/autotest_common.sh@1355 -- # local fc 00:24:43.709 15:48:35 -- common/autotest_common.sh@1356 -- # local cs 00:24:43.709 15:48:35 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:43.968 15:48:35 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:24:43.968 { 00:24:43.968 "uuid": "ef1ed42b-fbe3-4d87-b531-39f706ea51d3", 00:24:43.968 "name": "lvs_0", 00:24:43.968 "base_bdev": "Nvme0n1", 00:24:43.968 "total_data_clusters": 930, 00:24:43.968 "free_clusters": 0, 00:24:43.968 "block_size": 512, 00:24:43.968 "cluster_size": 1073741824 00:24:43.968 }, 00:24:43.968 { 00:24:43.968 "uuid": "6f41c507-b880-44f5-a5e0-25f982c71e88", 00:24:43.968 "name": "lvs_n_0", 00:24:43.968 "base_bdev": "9c4444f4-5241-45ba-b04c-7207c8f80834", 00:24:43.968 "total_data_clusters": 237847, 00:24:43.968 "free_clusters": 237847, 00:24:43.968 "block_size": 512, 00:24:43.968 "cluster_size": 4194304 00:24:43.968 } 00:24:43.968 ]' 00:24:43.968 15:48:35 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="6f41c507-b880-44f5-a5e0-25f982c71e88") .free_clusters' 00:24:43.968 15:48:35 -- common/autotest_common.sh@1358 -- # fc=237847 00:24:43.968 15:48:35 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="6f41c507-b880-44f5-a5e0-25f982c71e88") .cluster_size' 00:24:44.227 15:48:35 -- common/autotest_common.sh@1359 -- # cs=4194304 00:24:44.227 15:48:35 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:24:44.227 15:48:35 -- common/autotest_common.sh@1363 -- # echo 951388 00:24:44.227 951388 00:24:44.227 15:48:35 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:24:44.794 9a46f26f-14e2-473d-a141-727e2969b88c 00:24:44.794 15:48:36 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:24:45.052 15:48:36 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:24:45.324 15:48:36 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:24:45.584 15:48:36 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:45.584 15:48:36 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:45.584 15:48:36 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:45.584 15:48:36 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:45.584 15:48:36 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:45.584 15:48:36 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:45.584 15:48:36 -- common/autotest_common.sh@1330 -- # shift 00:24:45.584 15:48:36 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:45.584 15:48:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:45.584 15:48:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:45.584 15:48:36 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:45.584 15:48:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:45.584 15:48:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:45.584 15:48:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:45.584 15:48:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:45.584 15:48:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:45.584 15:48:36 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:45.584 15:48:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:45.584 15:48:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:45.584 15:48:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:45.584 15:48:36 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:45.584 15:48:36 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:45.845 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:45.845 fio-3.35 00:24:45.845 Starting 1 thread 00:24:45.845 EAL: No free 2048 kB hugepages reported on node 1 00:24:48.376 00:24:48.376 test: (groupid=0, jobs=1): err= 0: pid=959217: Tue Nov 26 15:48:39 2024 00:24:48.376 read: IOPS=6136, BW=24.0MiB/s (25.1MB/s)(48.2MiB/2009msec) 00:24:48.376 slat (nsec): min=1980, max=163285, avg=2535.56, stdev=2248.60 00:24:48.376 clat (usec): min=4257, max=18547, avg=11528.53, stdev=966.32 00:24:48.376 lat (usec): min=4273, max=18549, avg=11531.07, stdev=966.22 00:24:48.376 clat percentiles (usec): 00:24:48.376 | 1.00th=[ 9110], 5.00th=[10028], 10.00th=[10290], 20.00th=[10814], 00:24:48.376 | 30.00th=[11076], 40.00th=[11338], 50.00th=[11600], 60.00th=[11731], 00:24:48.376 | 70.00th=[11994], 80.00th=[12256], 90.00th=[12649], 95.00th=[13042], 00:24:48.376 | 99.00th=[13698], 99.50th=[13829], 99.90th=[16450], 99.95th=[17695], 00:24:48.376 | 99.99th=[17957] 00:24:48.376 bw ( KiB/s): min=23193, max=25032, per=99.87%, avg=24516.25, stdev=886.16, samples=4 00:24:48.376 iops : min= 5798, max= 6258, avg=6129.00, stdev=221.66, samples=4 00:24:48.376 write: IOPS=6120, BW=23.9MiB/s (25.1MB/s)(48.0MiB/2009msec); 0 zone resets 00:24:48.376 slat (usec): min=2, max=137, avg= 2.61, stdev= 1.52 00:24:48.376 clat (usec): min=2112, max=16583, avg=9179.20, stdev=861.37 00:24:48.376 lat (usec): min=2120, max=16600, avg=9181.81, stdev=861.33 00:24:48.376 clat percentiles (usec): 00:24:48.376 | 1.00th=[ 7177], 5.00th=[ 7832], 10.00th=[ 8160], 20.00th=[ 8586], 00:24:48.376 | 30.00th=[ 8717], 40.00th=[ 8979], 50.00th=[ 9241], 60.00th=[ 9372], 00:24:48.376 | 70.00th=[ 9634], 80.00th=[ 9896], 90.00th=[10159], 95.00th=[10421], 00:24:48.376 | 99.00th=[11076], 99.50th=[11207], 99.90th=[15926], 99.95th=[16188], 00:24:48.376 | 99.99th=[16581] 00:24:48.376 bw ( KiB/s): min=24223, max=24584, per=99.89%, avg=24455.75, stdev=159.28, samples=4 00:24:48.376 iops : min= 6055, max= 6146, avg=6113.75, stdev=40.19, samples=4 00:24:48.376 lat (msec) : 4=0.04%, 10=45.06%, 20=54.90% 00:24:48.376 cpu : usr=59.26%, sys=38.05%, ctx=139, majf=0, minf=37 00:24:48.376 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:24:48.376 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:48.376 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:48.376 issued rwts: total=12329,12296,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:48.376 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:48.376 00:24:48.376 Run status group 0 (all jobs): 00:24:48.376 READ: bw=24.0MiB/s (25.1MB/s), 24.0MiB/s-24.0MiB/s (25.1MB/s-25.1MB/s), io=48.2MiB (50.5MB), run=2009-2009msec 00:24:48.376 WRITE: bw=23.9MiB/s (25.1MB/s), 23.9MiB/s-23.9MiB/s (25.1MB/s-25.1MB/s), io=48.0MiB (50.4MB), run=2009-2009msec 00:24:48.376 15:48:39 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:24:48.376 15:48:39 -- host/fio.sh@74 -- # sync 00:24:48.376 15:48:39 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:24:52.616 15:48:43 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:52.616 15:48:43 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:24:55.907 15:48:46 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:55.907 15:48:46 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:24:57.822 15:48:48 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:24:57.822 15:48:48 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:24:57.822 15:48:48 -- host/fio.sh@86 -- # nvmftestfini 00:24:57.822 15:48:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:57.822 15:48:48 -- nvmf/common.sh@116 -- # sync 00:24:57.822 15:48:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:57.822 15:48:48 -- nvmf/common.sh@119 -- # set +e 00:24:57.822 15:48:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:57.822 15:48:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:57.822 rmmod nvme_tcp 00:24:57.822 rmmod nvme_fabrics 00:24:57.822 rmmod nvme_keyring 00:24:57.822 15:48:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:57.822 15:48:48 -- nvmf/common.sh@123 -- # set -e 00:24:57.822 15:48:48 -- nvmf/common.sh@124 -- # return 0 00:24:57.822 15:48:48 -- nvmf/common.sh@477 -- # '[' -n 956309 ']' 00:24:57.822 15:48:48 -- nvmf/common.sh@478 -- # killprocess 956309 00:24:57.822 15:48:48 -- common/autotest_common.sh@936 -- # '[' -z 956309 ']' 00:24:57.822 15:48:48 -- common/autotest_common.sh@940 -- # kill -0 956309 00:24:57.822 15:48:48 -- common/autotest_common.sh@941 -- # uname 00:24:57.822 15:48:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:57.822 15:48:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 956309 00:24:57.822 15:48:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:57.822 15:48:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:57.822 15:48:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 956309' 00:24:57.822 killing process with pid 956309 00:24:57.822 15:48:48 -- common/autotest_common.sh@955 -- # kill 956309 00:24:57.822 15:48:48 -- common/autotest_common.sh@960 -- # wait 956309 00:24:57.822 15:48:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:57.822 15:48:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:57.822 15:48:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:57.822 15:48:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:57.822 15:48:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:57.822 15:48:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:57.822 15:48:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:57.822 15:48:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:00.359 15:48:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:00.359 00:25:00.359 real 0m38.250s 00:25:00.359 user 2m26.843s 00:25:00.359 sys 0m6.865s 00:25:00.359 15:48:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:00.359 15:48:51 -- common/autotest_common.sh@10 -- # set +x 00:25:00.359 ************************************ 00:25:00.359 END TEST nvmf_fio_host 00:25:00.359 ************************************ 00:25:00.359 15:48:51 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:00.359 15:48:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:00.359 15:48:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:00.359 15:48:51 -- common/autotest_common.sh@10 -- # set +x 00:25:00.359 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:25:00.359 ************************************ 00:25:00.359 START TEST nvmf_failover 00:25:00.359 ************************************ 00:25:00.359 15:48:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:00.359 * Looking for test storage... 00:25:00.359 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:00.359 15:48:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:00.359 15:48:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:00.359 15:48:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:00.359 15:48:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:00.359 15:48:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:00.359 15:48:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:00.359 15:48:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:00.359 15:48:51 -- scripts/common.sh@335 -- # IFS=.-: 00:25:00.359 15:48:51 -- scripts/common.sh@335 -- # read -ra ver1 00:25:00.359 15:48:51 -- scripts/common.sh@336 -- # IFS=.-: 00:25:00.359 15:48:51 -- scripts/common.sh@336 -- # read -ra ver2 00:25:00.359 15:48:51 -- scripts/common.sh@337 -- # local 'op=<' 00:25:00.359 15:48:51 -- scripts/common.sh@339 -- # ver1_l=2 00:25:00.359 15:48:51 -- scripts/common.sh@340 -- # ver2_l=1 00:25:00.359 15:48:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:00.359 15:48:51 -- scripts/common.sh@343 -- # case "$op" in 00:25:00.359 15:48:51 -- scripts/common.sh@344 -- # : 1 00:25:00.359 15:48:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:00.359 15:48:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:00.359 15:48:51 -- scripts/common.sh@364 -- # decimal 1 00:25:00.359 15:48:51 -- scripts/common.sh@352 -- # local d=1 00:25:00.359 15:48:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:00.359 15:48:51 -- scripts/common.sh@354 -- # echo 1 00:25:00.359 15:48:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:00.359 15:48:51 -- scripts/common.sh@365 -- # decimal 2 00:25:00.359 15:48:51 -- scripts/common.sh@352 -- # local d=2 00:25:00.359 15:48:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:00.359 15:48:51 -- scripts/common.sh@354 -- # echo 2 00:25:00.359 15:48:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:00.359 15:48:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:00.359 15:48:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:00.359 15:48:51 -- scripts/common.sh@367 -- # return 0 00:25:00.359 15:48:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:00.359 15:48:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:00.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:00.359 --rc genhtml_branch_coverage=1 00:25:00.359 --rc genhtml_function_coverage=1 00:25:00.359 --rc genhtml_legend=1 00:25:00.359 --rc geninfo_all_blocks=1 00:25:00.359 --rc geninfo_unexecuted_blocks=1 00:25:00.359 00:25:00.359 ' 00:25:00.359 15:48:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:00.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:00.359 --rc genhtml_branch_coverage=1 00:25:00.359 --rc genhtml_function_coverage=1 00:25:00.359 --rc genhtml_legend=1 00:25:00.359 --rc geninfo_all_blocks=1 00:25:00.359 --rc geninfo_unexecuted_blocks=1 00:25:00.359 00:25:00.359 ' 00:25:00.359 15:48:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:00.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:00.359 --rc genhtml_branch_coverage=1 00:25:00.359 --rc genhtml_function_coverage=1 00:25:00.359 --rc genhtml_legend=1 00:25:00.359 --rc geninfo_all_blocks=1 00:25:00.359 --rc geninfo_unexecuted_blocks=1 00:25:00.359 00:25:00.359 ' 00:25:00.359 15:48:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:00.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:00.359 --rc genhtml_branch_coverage=1 00:25:00.359 --rc genhtml_function_coverage=1 00:25:00.359 --rc genhtml_legend=1 00:25:00.359 --rc geninfo_all_blocks=1 00:25:00.359 --rc geninfo_unexecuted_blocks=1 00:25:00.359 00:25:00.359 ' 00:25:00.359 15:48:51 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:00.359 15:48:51 -- nvmf/common.sh@7 -- # uname -s 00:25:00.359 15:48:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:00.359 15:48:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:00.359 15:48:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:00.359 15:48:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:00.359 15:48:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:00.359 15:48:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:00.359 15:48:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:00.359 15:48:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:00.359 15:48:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:00.359 15:48:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:00.359 15:48:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:00.359 15:48:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:00.359 15:48:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:00.359 15:48:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:00.359 15:48:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:00.359 15:48:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:00.359 15:48:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:00.359 15:48:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:00.359 15:48:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:00.359 15:48:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.359 15:48:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.359 15:48:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.359 15:48:51 -- paths/export.sh@5 -- # export PATH 00:25:00.359 15:48:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:00.359 15:48:51 -- nvmf/common.sh@46 -- # : 0 00:25:00.359 15:48:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:00.359 15:48:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:00.359 15:48:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:00.359 15:48:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:00.360 15:48:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:00.360 15:48:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:00.360 15:48:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:00.360 15:48:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:00.360 15:48:51 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:00.360 15:48:51 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:00.360 15:48:51 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:00.360 15:48:51 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:00.360 15:48:51 -- host/failover.sh@18 -- # nvmftestinit 00:25:00.360 15:48:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:00.360 15:48:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:00.360 15:48:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:00.360 15:48:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:00.360 15:48:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:00.360 15:48:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:00.360 15:48:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:00.360 15:48:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:00.360 15:48:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:00.360 15:48:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:00.360 15:48:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:00.360 15:48:51 -- common/autotest_common.sh@10 -- # set +x 00:25:02.265 15:48:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:02.265 15:48:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:02.265 15:48:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:02.265 15:48:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:02.265 15:48:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:02.265 15:48:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:02.265 15:48:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:02.265 15:48:53 -- nvmf/common.sh@294 -- # net_devs=() 00:25:02.265 15:48:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:02.265 15:48:53 -- nvmf/common.sh@295 -- # e810=() 00:25:02.265 15:48:53 -- nvmf/common.sh@295 -- # local -ga e810 00:25:02.265 15:48:53 -- nvmf/common.sh@296 -- # x722=() 00:25:02.265 15:48:53 -- nvmf/common.sh@296 -- # local -ga x722 00:25:02.265 15:48:53 -- nvmf/common.sh@297 -- # mlx=() 00:25:02.265 15:48:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:02.265 15:48:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:02.265 15:48:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:02.265 15:48:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:02.265 15:48:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:02.265 15:48:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:02.265 15:48:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:02.265 15:48:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:02.265 15:48:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:02.265 15:48:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:02.265 15:48:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:02.265 15:48:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:02.265 15:48:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:02.265 15:48:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:02.265 15:48:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:02.265 15:48:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:02.265 15:48:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:02.265 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:02.265 15:48:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:02.265 15:48:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:02.265 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:02.265 15:48:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:02.265 15:48:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:02.265 15:48:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:02.265 15:48:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:02.265 15:48:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:02.265 15:48:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:02.265 15:48:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:02.265 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:02.265 15:48:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:02.265 15:48:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:02.266 15:48:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:02.266 15:48:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:02.266 15:48:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:02.266 15:48:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:02.266 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:02.266 15:48:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:02.266 15:48:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:02.266 15:48:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:02.266 15:48:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:02.266 15:48:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:02.266 15:48:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:02.266 15:48:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:02.266 15:48:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:02.266 15:48:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:02.266 15:48:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:02.266 15:48:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:02.266 15:48:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:02.266 15:48:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:02.266 15:48:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:02.266 15:48:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:02.266 15:48:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:02.266 15:48:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:02.266 15:48:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:02.266 15:48:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:02.266 15:48:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:02.266 15:48:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:02.266 15:48:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:02.266 15:48:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:02.266 15:48:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:02.266 15:48:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:02.266 15:48:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:02.266 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:02.266 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.233 ms 00:25:02.266 00:25:02.266 --- 10.0.0.2 ping statistics --- 00:25:02.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:02.266 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:25:02.266 15:48:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:02.266 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:02.266 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:25:02.266 00:25:02.266 --- 10.0.0.1 ping statistics --- 00:25:02.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:02.266 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:25:02.266 15:48:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:02.266 15:48:53 -- nvmf/common.sh@410 -- # return 0 00:25:02.266 15:48:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:02.266 15:48:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:02.266 15:48:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:02.266 15:48:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:02.266 15:48:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:02.266 15:48:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:02.266 15:48:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:02.266 15:48:53 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:02.266 15:48:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:02.266 15:48:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:02.266 15:48:53 -- common/autotest_common.sh@10 -- # set +x 00:25:02.266 15:48:53 -- nvmf/common.sh@469 -- # nvmfpid=962432 00:25:02.266 15:48:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:02.266 15:48:53 -- nvmf/common.sh@470 -- # waitforlisten 962432 00:25:02.266 15:48:53 -- common/autotest_common.sh@829 -- # '[' -z 962432 ']' 00:25:02.266 15:48:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:02.266 15:48:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:02.266 15:48:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:02.266 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:02.266 15:48:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:02.266 15:48:53 -- common/autotest_common.sh@10 -- # set +x 00:25:02.266 [2024-11-26 15:48:53.661724] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:02.266 [2024-11-26 15:48:53.661809] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:02.266 EAL: No free 2048 kB hugepages reported on node 1 00:25:02.526 [2024-11-26 15:48:53.728183] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:02.526 [2024-11-26 15:48:53.841638] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:02.526 [2024-11-26 15:48:53.841814] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:02.526 [2024-11-26 15:48:53.841835] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:02.526 [2024-11-26 15:48:53.841850] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:02.526 [2024-11-26 15:48:53.841915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:02.526 [2024-11-26 15:48:53.842032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:02.526 [2024-11-26 15:48:53.842036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:03.461 15:48:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:03.461 15:48:54 -- common/autotest_common.sh@862 -- # return 0 00:25:03.461 15:48:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:03.461 15:48:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:03.461 15:48:54 -- common/autotest_common.sh@10 -- # set +x 00:25:03.461 15:48:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:03.461 15:48:54 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:03.461 [2024-11-26 15:48:54.858376] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:03.461 15:48:54 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:03.719 Malloc0 00:25:03.719 15:48:55 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:03.977 15:48:55 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:04.236 15:48:55 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:04.495 [2024-11-26 15:48:55.891616] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:04.495 15:48:55 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:04.753 [2024-11-26 15:48:56.136340] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:04.753 15:48:56 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:05.011 [2024-11-26 15:48:56.401245] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:05.011 15:48:56 -- host/failover.sh@31 -- # bdevperf_pid=962840 00:25:05.011 15:48:56 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:05.011 15:48:56 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:05.011 15:48:56 -- host/failover.sh@34 -- # waitforlisten 962840 /var/tmp/bdevperf.sock 00:25:05.011 15:48:56 -- common/autotest_common.sh@829 -- # '[' -z 962840 ']' 00:25:05.011 15:48:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:05.011 15:48:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:05.011 15:48:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:05.011 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:05.011 15:48:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:05.011 15:48:56 -- common/autotest_common.sh@10 -- # set +x 00:25:06.389 15:48:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:06.389 15:48:57 -- common/autotest_common.sh@862 -- # return 0 00:25:06.389 15:48:57 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:06.389 NVMe0n1 00:25:06.390 15:48:57 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:06.959 00:25:06.959 15:48:58 -- host/failover.sh@39 -- # run_test_pid=962983 00:25:06.959 15:48:58 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:06.959 15:48:58 -- host/failover.sh@41 -- # sleep 1 00:25:07.893 15:48:59 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:08.152 [2024-11-26 15:48:59.411013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 [2024-11-26 15:48:59.411632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ccb0 is same with the state(5) to be set 00:25:08.152 15:48:59 -- host/failover.sh@45 -- # sleep 3 00:25:11.445 15:49:02 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:11.445 00:25:11.445 15:49:02 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:11.706 [2024-11-26 15:49:03.135986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.706 [2024-11-26 15:49:03.136387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.707 [2024-11-26 15:49:03.136399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.707 [2024-11-26 15:49:03.136411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.707 [2024-11-26 15:49:03.136423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.707 [2024-11-26 15:49:03.136434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8e3a0 is same with the state(5) to be set 00:25:11.965 15:49:03 -- host/failover.sh@50 -- # sleep 3 00:25:15.252 15:49:06 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:15.252 [2024-11-26 15:49:06.393160] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:15.252 15:49:06 -- host/failover.sh@55 -- # sleep 1 00:25:16.192 15:49:07 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:16.451 [2024-11-26 15:49:07.685265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 [2024-11-26 15:49:07.685588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ea80 is same with the state(5) to be set 00:25:16.451 15:49:07 -- host/failover.sh@59 -- # wait 962983 00:25:23.027 0 00:25:23.027 15:49:13 -- host/failover.sh@61 -- # killprocess 962840 00:25:23.027 15:49:13 -- common/autotest_common.sh@936 -- # '[' -z 962840 ']' 00:25:23.027 15:49:13 -- common/autotest_common.sh@940 -- # kill -0 962840 00:25:23.027 15:49:13 -- common/autotest_common.sh@941 -- # uname 00:25:23.027 15:49:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:23.027 15:49:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 962840 00:25:23.027 15:49:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:23.027 15:49:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:23.027 15:49:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 962840' 00:25:23.027 killing process with pid 962840 00:25:23.027 15:49:13 -- common/autotest_common.sh@955 -- # kill 962840 00:25:23.027 15:49:13 -- common/autotest_common.sh@960 -- # wait 962840 00:25:23.027 15:49:13 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:23.027 [2024-11-26 15:48:56.461460] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:23.027 [2024-11-26 15:48:56.461542] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid962840 ] 00:25:23.027 EAL: No free 2048 kB hugepages reported on node 1 00:25:23.027 [2024-11-26 15:48:56.521394] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:23.027 [2024-11-26 15:48:56.627912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:23.027 Running I/O for 15 seconds... 00:25:23.027 [2024-11-26 15:48:59.411987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:98472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.027 [2024-11-26 15:48:59.412028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.027 [2024-11-26 15:48:59.412056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:98480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.027 [2024-11-26 15:48:59.412073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.027 [2024-11-26 15:48:59.412090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:98488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.027 [2024-11-26 15:48:59.412104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:98496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:98504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:98512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:98528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:98536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:97856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:97864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:97872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:97880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:97888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:97912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:97928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:97952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:97968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:97984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:97992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:98000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:98008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:98024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:98048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:98056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:98560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:98568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:98584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:98592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:98600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:98616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:98640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:98648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.412961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.412977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:98656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.028 [2024-11-26 15:48:59.412990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.413020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:98664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.413033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.413047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:98672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.028 [2024-11-26 15:48:59.413059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.413073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:98680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.413086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.413104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:98688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.028 [2024-11-26 15:48:59.413117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.413132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:98696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.413144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.413158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:98704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.028 [2024-11-26 15:48:59.413171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.413185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:98712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.028 [2024-11-26 15:48:59.413198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.413212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:98720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.028 [2024-11-26 15:48:59.413225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.413239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:98728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.028 [2024-11-26 15:48:59.413252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.028 [2024-11-26 15:48:59.413266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:98736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:98744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.029 [2024-11-26 15:48:59.413304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:98752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:98760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:98064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:98088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:98096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:98112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:98120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:98128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:98136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:98144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:98160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:98168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:98176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:98208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:98232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:98240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:98256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:98264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:98768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:98776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.029 [2024-11-26 15:48:59.413888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:98784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.029 [2024-11-26 15:48:59.413923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:98792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.413951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:98800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.029 [2024-11-26 15:48:59.413979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.413993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:98808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.029 [2024-11-26 15:48:59.414021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:98816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.414049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:98824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.029 [2024-11-26 15:48:59.414076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:98832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.414103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:98840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.029 [2024-11-26 15:48:59.414130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:98848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.029 [2024-11-26 15:48:59.414158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:98856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.029 [2024-11-26 15:48:59.414185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:98864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.414217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:98872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.029 [2024-11-26 15:48:59.414243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:98880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.414271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:98888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.029 [2024-11-26 15:48:59.414297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:98896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.029 [2024-11-26 15:48:59.414325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:98904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.029 [2024-11-26 15:48:59.414352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:98912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.029 [2024-11-26 15:48:59.414385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:98920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.029 [2024-11-26 15:48:59.414413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.029 [2024-11-26 15:48:59.414427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:98928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.414440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:98936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.414466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:98944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.414493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:98952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.414520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:98960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.414551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:98968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.414579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:98272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.414605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:98288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.414633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:98296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.414660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:98320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.414694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:98328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.414740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:98360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.414769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:98408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.414797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:98440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.414825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:98976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.414859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:98984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.414887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:98992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.414915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:99000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.414947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:99008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.414975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.414989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:99016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.415018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:99024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.415046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:99032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.415073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:99040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.415100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:99048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.415127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:99056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.415154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:99064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.415181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:99072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.415208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:99080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.415235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:99088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.415262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:99096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.415289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:99104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.415343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:99112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.415372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:99120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.415399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:99128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.415427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:99136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.415454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:99144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.415483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:99152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.415511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:99160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.030 [2024-11-26 15:48:59.415538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:98464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.415566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.030 [2024-11-26 15:48:59.415580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:98520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.030 [2024-11-26 15:48:59.415593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:48:59.415608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:98544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:48:59.415621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:48:59.415635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:98552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:48:59.415649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:48:59.415663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:98576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:48:59.415680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:48:59.415707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:98608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:48:59.415721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:48:59.415736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:98624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:48:59.415749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:48:59.415763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf9b6a0 is same with the state(5) to be set 00:25:23.031 [2024-11-26 15:48:59.415780] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:23.031 [2024-11-26 15:48:59.415798] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:23.031 [2024-11-26 15:48:59.415810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:98632 len:8 PRP1 0x0 PRP2 0x0 00:25:23.031 [2024-11-26 15:48:59.415823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:48:59.415888] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xf9b6a0 was disconnected and freed. reset controller. 00:25:23.031 [2024-11-26 15:48:59.415912] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:23.031 [2024-11-26 15:48:59.415949] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:23.031 [2024-11-26 15:48:59.415968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:48:59.415983] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:23.031 [2024-11-26 15:48:59.415995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:48:59.416009] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:23.031 [2024-11-26 15:48:59.416021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:48:59.416035] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:23.031 [2024-11-26 15:48:59.416048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:48:59.416061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:23.031 [2024-11-26 15:48:59.418321] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:23.031 [2024-11-26 15:48:59.418361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf7c870 (9): Bad file descriptor 00:25:23.031 [2024-11-26 15:48:59.610556] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:23.031 [2024-11-26 15:49:03.136598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:29488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.136641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.136681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:29496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.136713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.136732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:29512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.136746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.136761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:29536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.136775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.136789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:29544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.136802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.136817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.136830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.136845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:29576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.136858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.136873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:29584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.136886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.136901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.136914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.136929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:29608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.136942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.136956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.136978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:29000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.137021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:29008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.137048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:29048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.137075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:29064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.137106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:29080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.137134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.137162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.137190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:29640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.137217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:29664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.137244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:29672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.137271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:29680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.137298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:29704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.137325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:29720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.137352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:29728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.031 [2024-11-26 15:49:03.137378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.031 [2024-11-26 15:49:03.137393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:29736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.137405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:29120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.137436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:29144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.137464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:29152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.137491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:29176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.137517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:29208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.137545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:29216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.137572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.137599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:29232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.137626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:29752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.032 [2024-11-26 15:49:03.137653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:29760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.032 [2024-11-26 15:49:03.137680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:29768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.032 [2024-11-26 15:49:03.137734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:29776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.032 [2024-11-26 15:49:03.137762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:29784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.032 [2024-11-26 15:49:03.137789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:29792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.137821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:29800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.137850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:29808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.032 [2024-11-26 15:49:03.137878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:29816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.137905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:29824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.137932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:29832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.032 [2024-11-26 15:49:03.137960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.137974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:29840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.032 [2024-11-26 15:49:03.137987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.138017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.032 [2024-11-26 15:49:03.138030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.138045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:29856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.032 [2024-11-26 15:49:03.138057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.138071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:29864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.138084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.138099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:29872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.032 [2024-11-26 15:49:03.138112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.138126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:29880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.032 [2024-11-26 15:49:03.138139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.138154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:29240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.138167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.138185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:29256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.138198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.138213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:29264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.138225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.138240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:29272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.138252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.138267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:29288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.138280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.138294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:29312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.138307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.138321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:29336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.032 [2024-11-26 15:49:03.138334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.032 [2024-11-26 15:49:03.138349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:29352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.138361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:29888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.033 [2024-11-26 15:49:03.138388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:29896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.138415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:29904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.033 [2024-11-26 15:49:03.138442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:29912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.033 [2024-11-26 15:49:03.138469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:29920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.033 [2024-11-26 15:49:03.138496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:29928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.138527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:29936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.138555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:29360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.138582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:29368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.138609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:29392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.138636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:29408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.138663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:29416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.138716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:29424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.138746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.138773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:29464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.138801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:29944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.138839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:29952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.138866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:29960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.033 [2024-11-26 15:49:03.138894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:29968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.033 [2024-11-26 15:49:03.138925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:29976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.033 [2024-11-26 15:49:03.138953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.138968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:29984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.033 [2024-11-26 15:49:03.138980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:29992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.139031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:30000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.139058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:30008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.139086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.139113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:30024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.033 [2024-11-26 15:49:03.139140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:30032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.139167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:30040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.033 [2024-11-26 15:49:03.139195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:30048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.033 [2024-11-26 15:49:03.139221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:30056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.033 [2024-11-26 15:49:03.139248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.139278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:30072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.139305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.139332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.139359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:30096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.139386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:30104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.033 [2024-11-26 15:49:03.139413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:30112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.033 [2024-11-26 15:49:03.139440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:30120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.139467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.033 [2024-11-26 15:49:03.139482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:29480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.033 [2024-11-26 15:49:03.139495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:29504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.139521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:29520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.139548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:29528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.139574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:29552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.139601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:29560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.139632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:29592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.139659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:29616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.139693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:30128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.034 [2024-11-26 15:49:03.139740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:30136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.034 [2024-11-26 15:49:03.139767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:30144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.139795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:30152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.034 [2024-11-26 15:49:03.139822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.139849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:30168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.034 [2024-11-26 15:49:03.139877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:30176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.139904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:30184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.034 [2024-11-26 15:49:03.139932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:30192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.034 [2024-11-26 15:49:03.139964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.139978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:30200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.034 [2024-11-26 15:49:03.140006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:30208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.034 [2024-11-26 15:49:03.140039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:30216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.034 [2024-11-26 15:49:03.140066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:30224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.140092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:30232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.034 [2024-11-26 15:49:03.140119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.034 [2024-11-26 15:49:03.140145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:29624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.140173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:29632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.140199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:29648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.140226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:29656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.140252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:29688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.140279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:29696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.140305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:29712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.034 [2024-11-26 15:49:03.140332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c90 is same with the state(5) to be set 00:25:23.034 [2024-11-26 15:49:03.140373] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:23.034 [2024-11-26 15:49:03.140386] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:23.034 [2024-11-26 15:49:03.140397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29744 len:8 PRP1 0x0 PRP2 0x0 00:25:23.034 [2024-11-26 15:49:03.140409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140472] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xfa8c90 was disconnected and freed. reset controller. 00:25:23.034 [2024-11-26 15:49:03.140488] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:23.034 [2024-11-26 15:49:03.140539] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:23.034 [2024-11-26 15:49:03.140558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140573] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:23.034 [2024-11-26 15:49:03.140586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140599] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:23.034 [2024-11-26 15:49:03.140611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140625] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:23.034 [2024-11-26 15:49:03.140637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:03.140650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:23.034 [2024-11-26 15:49:03.140697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf7c870 (9): Bad file descriptor 00:25:23.034 [2024-11-26 15:49:03.143079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:23.034 [2024-11-26 15:49:03.176431] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:23.034 [2024-11-26 15:49:07.685465] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:23.034 [2024-11-26 15:49:07.685509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.034 [2024-11-26 15:49:07.685528] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:23.034 [2024-11-26 15:49:07.685541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.685556] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:23.035 [2024-11-26 15:49:07.685569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.685584] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:23.035 [2024-11-26 15:49:07.685597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.685610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf7c870 is same with the state(5) to be set 00:25:23.035 [2024-11-26 15:49:07.685727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:120544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.685751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.685776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:120552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.685791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.685807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:120560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.685820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.685835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:120584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.685848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.685863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:120616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.685876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.685890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:120656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.685904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.685918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:120680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.685932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.685946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:120688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.685959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.685973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:120704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.685986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:120728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:120736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:120744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.035 [2024-11-26 15:49:07.686083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:120752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.035 [2024-11-26 15:49:07.686116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:120760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:120768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:120776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:120784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.035 [2024-11-26 15:49:07.686243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:120792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:120800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.035 [2024-11-26 15:49:07.686298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:119968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:119976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:119984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:119992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:120008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:120016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:120024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:120032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:120040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:120048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:120056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:120080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:120096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:120104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:120128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:120152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:120808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.035 [2024-11-26 15:49:07.686792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:120816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.035 [2024-11-26 15:49:07.686820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.035 [2024-11-26 15:49:07.686835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:120824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.686848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.686867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:120832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.036 [2024-11-26 15:49:07.686881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.686896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:120840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.036 [2024-11-26 15:49:07.686909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.686924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:120848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.686937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.686952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:120856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.036 [2024-11-26 15:49:07.686965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.686980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:120864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.036 [2024-11-26 15:49:07.686993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:120872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:120160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:120192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:120224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:120232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:120240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:120256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:120264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:120288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:120880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.036 [2024-11-26 15:49:07.687278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:120888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:120896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:120904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.036 [2024-11-26 15:49:07.687361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:120912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.036 [2024-11-26 15:49:07.687388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:120920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.036 [2024-11-26 15:49:07.687416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:120928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:120304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:120320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:120352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:120376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:120384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:120392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:120416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:120432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:120936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:120944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.036 [2024-11-26 15:49:07.687736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:120952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:120960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.036 [2024-11-26 15:49:07.687791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:120968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.036 [2024-11-26 15:49:07.687819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.036 [2024-11-26 15:49:07.687834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:120976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.687846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.687861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:120984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.687874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.687889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:120992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.687902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.687916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:121000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.687934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.687950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:121008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.687969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.687984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:120456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.687997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:120464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:120480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:120488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:120496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:120504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:120512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:120520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:121016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:121024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.037 [2024-11-26 15:49:07.688246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:121032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:121040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:121048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.037 [2024-11-26 15:49:07.688333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:121056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:121064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:121072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:121080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.037 [2024-11-26 15:49:07.688444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:121088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:121096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:121104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:121112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.037 [2024-11-26 15:49:07.688562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:121120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:121128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.037 [2024-11-26 15:49:07.688616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:121136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:121144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:121152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.037 [2024-11-26 15:49:07.688712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:121160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.037 [2024-11-26 15:49:07.688739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:121168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.037 [2024-11-26 15:49:07.688767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:121176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:121184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.037 [2024-11-26 15:49:07.688821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:121192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.037 [2024-11-26 15:49:07.688854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:121200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:121208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.037 [2024-11-26 15:49:07.688910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:121216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.037 [2024-11-26 15:49:07.688939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:120528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.037 [2024-11-26 15:49:07.688967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.037 [2024-11-26 15:49:07.688981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:120536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.038 [2024-11-26 15:49:07.688994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:120568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.038 [2024-11-26 15:49:07.689026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:120576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.038 [2024-11-26 15:49:07.689054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:120592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.038 [2024-11-26 15:49:07.689082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:120600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.038 [2024-11-26 15:49:07.689109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:120608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.038 [2024-11-26 15:49:07.689136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:120624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.038 [2024-11-26 15:49:07.689163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:121224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:23.038 [2024-11-26 15:49:07.689191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:120632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.038 [2024-11-26 15:49:07.689218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:120640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.038 [2024-11-26 15:49:07.689246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:120648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.038 [2024-11-26 15:49:07.689273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:120664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.038 [2024-11-26 15:49:07.689305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:120672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.038 [2024-11-26 15:49:07.689334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:120696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.038 [2024-11-26 15:49:07.689362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:120712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:23.038 [2024-11-26 15:49:07.689394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf88d10 is same with the state(5) to be set 00:25:23.038 [2024-11-26 15:49:07.689424] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:23.038 [2024-11-26 15:49:07.689434] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:23.038 [2024-11-26 15:49:07.689446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:120720 len:8 PRP1 0x0 PRP2 0x0 00:25:23.038 [2024-11-26 15:49:07.689458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:23.038 [2024-11-26 15:49:07.689517] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xf88d10 was disconnected and freed. reset controller. 00:25:23.038 [2024-11-26 15:49:07.689534] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:23.038 [2024-11-26 15:49:07.689550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:23.038 [2024-11-26 15:49:07.691674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:23.038 [2024-11-26 15:49:07.691719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf7c870 (9): Bad file descriptor 00:25:23.038 [2024-11-26 15:49:07.721592] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:23.038 00:25:23.038 Latency(us) 00:25:23.038 [2024-11-26T14:49:14.491Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:23.038 [2024-11-26T14:49:14.491Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:23.038 Verification LBA range: start 0x0 length 0x4000 00:25:23.038 NVMe0n1 : 15.01 12221.66 47.74 971.67 0.00 9685.38 561.30 17961.72 00:25:23.038 [2024-11-26T14:49:14.491Z] =================================================================================================================== 00:25:23.038 [2024-11-26T14:49:14.491Z] Total : 12221.66 47.74 971.67 0.00 9685.38 561.30 17961.72 00:25:23.038 Received shutdown signal, test time was about 15.000000 seconds 00:25:23.038 00:25:23.038 Latency(us) 00:25:23.038 [2024-11-26T14:49:14.491Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:23.038 [2024-11-26T14:49:14.491Z] =================================================================================================================== 00:25:23.038 [2024-11-26T14:49:14.491Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:23.038 15:49:13 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:23.038 15:49:13 -- host/failover.sh@65 -- # count=3 00:25:23.038 15:49:13 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:23.038 15:49:13 -- host/failover.sh@73 -- # bdevperf_pid=964786 00:25:23.038 15:49:13 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:23.038 15:49:13 -- host/failover.sh@75 -- # waitforlisten 964786 /var/tmp/bdevperf.sock 00:25:23.038 15:49:13 -- common/autotest_common.sh@829 -- # '[' -z 964786 ']' 00:25:23.038 15:49:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:23.038 15:49:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:23.038 15:49:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:23.038 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:23.038 15:49:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:23.038 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.297 15:49:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:23.297 15:49:14 -- common/autotest_common.sh@862 -- # return 0 00:25:23.297 15:49:14 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:23.555 [2024-11-26 15:49:14.874120] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:23.555 15:49:14 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:23.813 [2024-11-26 15:49:15.126785] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:23.813 15:49:15 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:24.071 NVMe0n1 00:25:24.071 15:49:15 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:24.637 00:25:24.637 15:49:15 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:24.895 00:25:24.895 15:49:16 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:24.895 15:49:16 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:25.153 15:49:16 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:25.411 15:49:16 -- host/failover.sh@87 -- # sleep 3 00:25:28.698 15:49:19 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:28.698 15:49:19 -- host/failover.sh@88 -- # grep -q NVMe0 00:25:28.698 15:49:20 -- host/failover.sh@90 -- # run_test_pid=965569 00:25:28.698 15:49:20 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:28.698 15:49:20 -- host/failover.sh@92 -- # wait 965569 00:25:30.077 0 00:25:30.077 15:49:21 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:30.077 [2024-11-26 15:49:13.665985] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:30.077 [2024-11-26 15:49:13.666067] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid964786 ] 00:25:30.077 EAL: No free 2048 kB hugepages reported on node 1 00:25:30.077 [2024-11-26 15:49:13.723876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:30.077 [2024-11-26 15:49:13.826879] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:30.077 [2024-11-26 15:49:16.786280] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:30.077 [2024-11-26 15:49:16.786363] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:30.077 [2024-11-26 15:49:16.786387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:30.077 [2024-11-26 15:49:16.786403] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:30.077 [2024-11-26 15:49:16.786417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:30.077 [2024-11-26 15:49:16.786431] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:30.077 [2024-11-26 15:49:16.786444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:30.077 [2024-11-26 15:49:16.786458] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:30.077 [2024-11-26 15:49:16.786471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:30.077 [2024-11-26 15:49:16.786484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:30.077 [2024-11-26 15:49:16.786519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:30.077 [2024-11-26 15:49:16.786550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b38870 (9): Bad file descriptor 00:25:30.077 [2024-11-26 15:49:16.835063] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:30.077 Running I/O for 1 seconds... 00:25:30.077 00:25:30.077 Latency(us) 00:25:30.077 [2024-11-26T14:49:21.530Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:30.077 [2024-11-26T14:49:21.530Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:30.077 Verification LBA range: start 0x0 length 0x4000 00:25:30.077 NVMe0n1 : 1.01 12724.53 49.71 0.00 0.00 10010.50 1498.83 17476.27 00:25:30.077 [2024-11-26T14:49:21.530Z] =================================================================================================================== 00:25:30.077 [2024-11-26T14:49:21.530Z] Total : 12724.53 49.71 0.00 0.00 10010.50 1498.83 17476.27 00:25:30.077 15:49:21 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:30.077 15:49:21 -- host/failover.sh@95 -- # grep -q NVMe0 00:25:30.078 15:49:21 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:30.338 15:49:21 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:30.338 15:49:21 -- host/failover.sh@99 -- # grep -q NVMe0 00:25:30.597 15:49:22 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:30.856 15:49:22 -- host/failover.sh@101 -- # sleep 3 00:25:34.221 15:49:25 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:34.221 15:49:25 -- host/failover.sh@103 -- # grep -q NVMe0 00:25:34.221 15:49:25 -- host/failover.sh@108 -- # killprocess 964786 00:25:34.221 15:49:25 -- common/autotest_common.sh@936 -- # '[' -z 964786 ']' 00:25:34.221 15:49:25 -- common/autotest_common.sh@940 -- # kill -0 964786 00:25:34.221 15:49:25 -- common/autotest_common.sh@941 -- # uname 00:25:34.221 15:49:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:34.221 15:49:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 964786 00:25:34.221 15:49:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:34.221 15:49:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:34.221 15:49:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 964786' 00:25:34.221 killing process with pid 964786 00:25:34.221 15:49:25 -- common/autotest_common.sh@955 -- # kill 964786 00:25:34.221 15:49:25 -- common/autotest_common.sh@960 -- # wait 964786 00:25:34.479 15:49:25 -- host/failover.sh@110 -- # sync 00:25:34.479 15:49:25 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:34.738 15:49:26 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:25:34.738 15:49:26 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:34.738 15:49:26 -- host/failover.sh@116 -- # nvmftestfini 00:25:34.738 15:49:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:34.738 15:49:26 -- nvmf/common.sh@116 -- # sync 00:25:34.738 15:49:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:34.738 15:49:26 -- nvmf/common.sh@119 -- # set +e 00:25:34.738 15:49:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:34.738 15:49:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:34.738 rmmod nvme_tcp 00:25:34.738 rmmod nvme_fabrics 00:25:34.738 rmmod nvme_keyring 00:25:34.738 15:49:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:34.738 15:49:26 -- nvmf/common.sh@123 -- # set -e 00:25:34.738 15:49:26 -- nvmf/common.sh@124 -- # return 0 00:25:34.738 15:49:26 -- nvmf/common.sh@477 -- # '[' -n 962432 ']' 00:25:34.738 15:49:26 -- nvmf/common.sh@478 -- # killprocess 962432 00:25:34.738 15:49:26 -- common/autotest_common.sh@936 -- # '[' -z 962432 ']' 00:25:34.738 15:49:26 -- common/autotest_common.sh@940 -- # kill -0 962432 00:25:34.738 15:49:26 -- common/autotest_common.sh@941 -- # uname 00:25:34.738 15:49:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:34.738 15:49:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 962432 00:25:34.997 15:49:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:34.997 15:49:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:34.997 15:49:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 962432' 00:25:34.997 killing process with pid 962432 00:25:34.997 15:49:26 -- common/autotest_common.sh@955 -- # kill 962432 00:25:34.997 15:49:26 -- common/autotest_common.sh@960 -- # wait 962432 00:25:35.257 15:49:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:35.257 15:49:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:35.257 15:49:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:35.257 15:49:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:35.257 15:49:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:35.257 15:49:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:35.257 15:49:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:35.257 15:49:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:37.164 15:49:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:37.164 00:25:37.164 real 0m37.311s 00:25:37.164 user 2m11.157s 00:25:37.164 sys 0m6.226s 00:25:37.164 15:49:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:37.164 15:49:28 -- common/autotest_common.sh@10 -- # set +x 00:25:37.164 ************************************ 00:25:37.164 END TEST nvmf_failover 00:25:37.164 ************************************ 00:25:37.164 15:49:28 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:25:37.164 15:49:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:37.164 15:49:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:37.164 15:49:28 -- common/autotest_common.sh@10 -- # set +x 00:25:37.164 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:25:37.164 ************************************ 00:25:37.164 START TEST nvmf_discovery 00:25:37.164 ************************************ 00:25:37.164 15:49:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:25:37.424 * Looking for test storage... 00:25:37.424 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:37.424 15:49:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:37.424 15:49:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:37.424 15:49:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:37.424 15:49:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:37.424 15:49:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:37.424 15:49:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:37.424 15:49:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:37.424 15:49:28 -- scripts/common.sh@335 -- # IFS=.-: 00:25:37.424 15:49:28 -- scripts/common.sh@335 -- # read -ra ver1 00:25:37.424 15:49:28 -- scripts/common.sh@336 -- # IFS=.-: 00:25:37.424 15:49:28 -- scripts/common.sh@336 -- # read -ra ver2 00:25:37.424 15:49:28 -- scripts/common.sh@337 -- # local 'op=<' 00:25:37.424 15:49:28 -- scripts/common.sh@339 -- # ver1_l=2 00:25:37.424 15:49:28 -- scripts/common.sh@340 -- # ver2_l=1 00:25:37.424 15:49:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:37.424 15:49:28 -- scripts/common.sh@343 -- # case "$op" in 00:25:37.424 15:49:28 -- scripts/common.sh@344 -- # : 1 00:25:37.424 15:49:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:37.424 15:49:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:37.424 15:49:28 -- scripts/common.sh@364 -- # decimal 1 00:25:37.424 15:49:28 -- scripts/common.sh@352 -- # local d=1 00:25:37.424 15:49:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:37.424 15:49:28 -- scripts/common.sh@354 -- # echo 1 00:25:37.424 15:49:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:37.424 15:49:28 -- scripts/common.sh@365 -- # decimal 2 00:25:37.424 15:49:28 -- scripts/common.sh@352 -- # local d=2 00:25:37.424 15:49:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:37.424 15:49:28 -- scripts/common.sh@354 -- # echo 2 00:25:37.424 15:49:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:37.424 15:49:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:37.424 15:49:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:37.424 15:49:28 -- scripts/common.sh@367 -- # return 0 00:25:37.424 15:49:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:37.424 15:49:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:37.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:37.424 --rc genhtml_branch_coverage=1 00:25:37.424 --rc genhtml_function_coverage=1 00:25:37.424 --rc genhtml_legend=1 00:25:37.424 --rc geninfo_all_blocks=1 00:25:37.424 --rc geninfo_unexecuted_blocks=1 00:25:37.424 00:25:37.424 ' 00:25:37.424 15:49:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:37.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:37.424 --rc genhtml_branch_coverage=1 00:25:37.424 --rc genhtml_function_coverage=1 00:25:37.424 --rc genhtml_legend=1 00:25:37.424 --rc geninfo_all_blocks=1 00:25:37.424 --rc geninfo_unexecuted_blocks=1 00:25:37.424 00:25:37.424 ' 00:25:37.424 15:49:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:37.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:37.424 --rc genhtml_branch_coverage=1 00:25:37.424 --rc genhtml_function_coverage=1 00:25:37.424 --rc genhtml_legend=1 00:25:37.424 --rc geninfo_all_blocks=1 00:25:37.424 --rc geninfo_unexecuted_blocks=1 00:25:37.424 00:25:37.424 ' 00:25:37.424 15:49:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:37.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:37.424 --rc genhtml_branch_coverage=1 00:25:37.424 --rc genhtml_function_coverage=1 00:25:37.424 --rc genhtml_legend=1 00:25:37.424 --rc geninfo_all_blocks=1 00:25:37.424 --rc geninfo_unexecuted_blocks=1 00:25:37.424 00:25:37.424 ' 00:25:37.424 15:49:28 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:37.424 15:49:28 -- nvmf/common.sh@7 -- # uname -s 00:25:37.424 15:49:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:37.424 15:49:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:37.424 15:49:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:37.424 15:49:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:37.424 15:49:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:37.424 15:49:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:37.424 15:49:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:37.424 15:49:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:37.424 15:49:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:37.424 15:49:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:37.424 15:49:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:37.424 15:49:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:37.424 15:49:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:37.424 15:49:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:37.424 15:49:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:37.424 15:49:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:37.424 15:49:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:37.424 15:49:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:37.424 15:49:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:37.424 15:49:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:37.424 15:49:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:37.424 15:49:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:37.424 15:49:28 -- paths/export.sh@5 -- # export PATH 00:25:37.424 15:49:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:37.424 15:49:28 -- nvmf/common.sh@46 -- # : 0 00:25:37.424 15:49:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:37.424 15:49:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:37.424 15:49:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:37.424 15:49:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:37.424 15:49:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:37.424 15:49:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:37.424 15:49:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:37.424 15:49:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:37.424 15:49:28 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:25:37.424 15:49:28 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:25:37.424 15:49:28 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:25:37.424 15:49:28 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:25:37.424 15:49:28 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:25:37.424 15:49:28 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:25:37.424 15:49:28 -- host/discovery.sh@25 -- # nvmftestinit 00:25:37.424 15:49:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:37.425 15:49:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:37.425 15:49:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:37.425 15:49:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:37.425 15:49:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:37.425 15:49:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:37.425 15:49:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:37.425 15:49:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:37.425 15:49:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:37.425 15:49:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:37.425 15:49:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:37.425 15:49:28 -- common/autotest_common.sh@10 -- # set +x 00:25:39.330 15:49:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:39.330 15:49:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:39.330 15:49:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:39.330 15:49:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:39.330 15:49:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:39.330 15:49:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:39.330 15:49:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:39.330 15:49:30 -- nvmf/common.sh@294 -- # net_devs=() 00:25:39.330 15:49:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:39.330 15:49:30 -- nvmf/common.sh@295 -- # e810=() 00:25:39.330 15:49:30 -- nvmf/common.sh@295 -- # local -ga e810 00:25:39.330 15:49:30 -- nvmf/common.sh@296 -- # x722=() 00:25:39.331 15:49:30 -- nvmf/common.sh@296 -- # local -ga x722 00:25:39.331 15:49:30 -- nvmf/common.sh@297 -- # mlx=() 00:25:39.331 15:49:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:39.331 15:49:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:39.331 15:49:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:39.331 15:49:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:39.331 15:49:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:39.331 15:49:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:39.331 15:49:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:39.331 15:49:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:39.331 15:49:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:39.331 15:49:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:39.331 15:49:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:39.331 15:49:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:39.331 15:49:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:39.331 15:49:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:39.331 15:49:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:39.331 15:49:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:39.331 15:49:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:39.331 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:39.331 15:49:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:39.331 15:49:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:39.331 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:39.331 15:49:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:39.331 15:49:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:39.331 15:49:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:39.331 15:49:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:39.331 15:49:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:39.331 15:49:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:39.331 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:39.331 15:49:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:39.331 15:49:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:39.331 15:49:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:39.331 15:49:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:39.331 15:49:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:39.331 15:49:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:39.331 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:39.331 15:49:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:39.331 15:49:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:39.331 15:49:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:39.331 15:49:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:39.331 15:49:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:39.331 15:49:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:39.331 15:49:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:39.331 15:49:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:39.331 15:49:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:39.331 15:49:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:39.331 15:49:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:39.331 15:49:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:39.331 15:49:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:39.331 15:49:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:39.331 15:49:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:39.331 15:49:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:39.331 15:49:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:39.331 15:49:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:39.590 15:49:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:39.590 15:49:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:39.590 15:49:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:39.590 15:49:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:39.590 15:49:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:39.590 15:49:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:39.590 15:49:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:39.591 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:39.591 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.279 ms 00:25:39.591 00:25:39.591 --- 10.0.0.2 ping statistics --- 00:25:39.591 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:39.591 rtt min/avg/max/mdev = 0.279/0.279/0.279/0.000 ms 00:25:39.591 15:49:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:39.591 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:39.591 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:25:39.591 00:25:39.591 --- 10.0.0.1 ping statistics --- 00:25:39.591 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:39.591 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:25:39.591 15:49:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:39.591 15:49:30 -- nvmf/common.sh@410 -- # return 0 00:25:39.591 15:49:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:39.591 15:49:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:39.591 15:49:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:39.591 15:49:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:39.591 15:49:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:39.591 15:49:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:39.591 15:49:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:39.591 15:49:30 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:25:39.591 15:49:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:39.591 15:49:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:39.591 15:49:30 -- common/autotest_common.sh@10 -- # set +x 00:25:39.591 15:49:30 -- nvmf/common.sh@469 -- # nvmfpid=968151 00:25:39.591 15:49:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:25:39.591 15:49:30 -- nvmf/common.sh@470 -- # waitforlisten 968151 00:25:39.591 15:49:30 -- common/autotest_common.sh@829 -- # '[' -z 968151 ']' 00:25:39.591 15:49:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:39.591 15:49:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:39.591 15:49:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:39.591 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:39.591 15:49:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:39.591 15:49:30 -- common/autotest_common.sh@10 -- # set +x 00:25:39.591 [2024-11-26 15:49:30.938624] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:39.591 [2024-11-26 15:49:30.938717] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:39.591 EAL: No free 2048 kB hugepages reported on node 1 00:25:39.591 [2024-11-26 15:49:31.002259] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:39.850 [2024-11-26 15:49:31.110027] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:39.850 [2024-11-26 15:49:31.110174] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:39.850 [2024-11-26 15:49:31.110192] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:39.850 [2024-11-26 15:49:31.110204] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:39.850 [2024-11-26 15:49:31.110239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:40.787 15:49:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:40.787 15:49:31 -- common/autotest_common.sh@862 -- # return 0 00:25:40.787 15:49:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:40.787 15:49:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:40.787 15:49:31 -- common/autotest_common.sh@10 -- # set +x 00:25:40.787 15:49:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:40.787 15:49:31 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:40.787 15:49:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.787 15:49:31 -- common/autotest_common.sh@10 -- # set +x 00:25:40.787 [2024-11-26 15:49:31.977304] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:40.787 15:49:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.787 15:49:31 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:25:40.787 15:49:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.787 15:49:31 -- common/autotest_common.sh@10 -- # set +x 00:25:40.787 [2024-11-26 15:49:31.985499] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:25:40.787 15:49:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.787 15:49:31 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:25:40.787 15:49:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.787 15:49:31 -- common/autotest_common.sh@10 -- # set +x 00:25:40.787 null0 00:25:40.787 15:49:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.787 15:49:31 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:25:40.787 15:49:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.787 15:49:31 -- common/autotest_common.sh@10 -- # set +x 00:25:40.787 null1 00:25:40.787 15:49:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.787 15:49:32 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:25:40.787 15:49:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.787 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:25:40.787 15:49:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.787 15:49:32 -- host/discovery.sh@45 -- # hostpid=968298 00:25:40.787 15:49:32 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:25:40.787 15:49:32 -- host/discovery.sh@46 -- # waitforlisten 968298 /tmp/host.sock 00:25:40.787 15:49:32 -- common/autotest_common.sh@829 -- # '[' -z 968298 ']' 00:25:40.787 15:49:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:25:40.787 15:49:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:40.787 15:49:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:25:40.787 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:25:40.787 15:49:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:40.787 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:25:40.787 [2024-11-26 15:49:32.053715] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:40.787 [2024-11-26 15:49:32.053800] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid968298 ] 00:25:40.787 EAL: No free 2048 kB hugepages reported on node 1 00:25:40.787 [2024-11-26 15:49:32.114941] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:40.787 [2024-11-26 15:49:32.229365] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:40.787 [2024-11-26 15:49:32.229546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:41.723 15:49:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:41.723 15:49:33 -- common/autotest_common.sh@862 -- # return 0 00:25:41.723 15:49:33 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:41.723 15:49:33 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:25:41.723 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.723 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:41.723 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.723 15:49:33 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:25:41.723 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.723 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:41.723 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.723 15:49:33 -- host/discovery.sh@72 -- # notify_id=0 00:25:41.723 15:49:33 -- host/discovery.sh@78 -- # get_subsystem_names 00:25:41.723 15:49:33 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:41.723 15:49:33 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:41.723 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.723 15:49:33 -- host/discovery.sh@59 -- # sort 00:25:41.723 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:41.723 15:49:33 -- host/discovery.sh@59 -- # xargs 00:25:41.723 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.723 15:49:33 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:25:41.723 15:49:33 -- host/discovery.sh@79 -- # get_bdev_list 00:25:41.723 15:49:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:41.723 15:49:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:41.723 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.723 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:41.723 15:49:33 -- host/discovery.sh@55 -- # sort 00:25:41.723 15:49:33 -- host/discovery.sh@55 -- # xargs 00:25:41.723 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.723 15:49:33 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:25:41.723 15:49:33 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:25:41.723 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.723 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:41.982 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.982 15:49:33 -- host/discovery.sh@82 -- # get_subsystem_names 00:25:41.982 15:49:33 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:41.982 15:49:33 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:41.982 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.982 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:41.982 15:49:33 -- host/discovery.sh@59 -- # sort 00:25:41.982 15:49:33 -- host/discovery.sh@59 -- # xargs 00:25:41.982 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.982 15:49:33 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:25:41.982 15:49:33 -- host/discovery.sh@83 -- # get_bdev_list 00:25:41.982 15:49:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:41.982 15:49:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:41.982 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.982 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:41.982 15:49:33 -- host/discovery.sh@55 -- # sort 00:25:41.982 15:49:33 -- host/discovery.sh@55 -- # xargs 00:25:41.982 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.982 15:49:33 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:25:41.982 15:49:33 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:25:41.982 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.982 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:41.982 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.982 15:49:33 -- host/discovery.sh@86 -- # get_subsystem_names 00:25:41.982 15:49:33 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:41.982 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.982 15:49:33 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:41.982 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:41.982 15:49:33 -- host/discovery.sh@59 -- # sort 00:25:41.982 15:49:33 -- host/discovery.sh@59 -- # xargs 00:25:41.982 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.982 15:49:33 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:25:41.982 15:49:33 -- host/discovery.sh@87 -- # get_bdev_list 00:25:41.982 15:49:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:41.982 15:49:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:41.982 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.982 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:41.982 15:49:33 -- host/discovery.sh@55 -- # sort 00:25:41.982 15:49:33 -- host/discovery.sh@55 -- # xargs 00:25:41.982 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.982 15:49:33 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:25:41.982 15:49:33 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:41.982 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.982 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:41.982 [2024-11-26 15:49:33.337286] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:41.982 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.982 15:49:33 -- host/discovery.sh@92 -- # get_subsystem_names 00:25:41.982 15:49:33 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:41.982 15:49:33 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:41.982 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.982 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:41.982 15:49:33 -- host/discovery.sh@59 -- # sort 00:25:41.982 15:49:33 -- host/discovery.sh@59 -- # xargs 00:25:41.982 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.982 15:49:33 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:25:41.982 15:49:33 -- host/discovery.sh@93 -- # get_bdev_list 00:25:41.982 15:49:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:41.982 15:49:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:41.982 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.982 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:41.982 15:49:33 -- host/discovery.sh@55 -- # sort 00:25:41.982 15:49:33 -- host/discovery.sh@55 -- # xargs 00:25:41.982 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.982 15:49:33 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:25:41.982 15:49:33 -- host/discovery.sh@94 -- # get_notification_count 00:25:41.982 15:49:33 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:25:41.982 15:49:33 -- host/discovery.sh@74 -- # jq '. | length' 00:25:41.982 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.982 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:42.241 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.241 15:49:33 -- host/discovery.sh@74 -- # notification_count=0 00:25:42.241 15:49:33 -- host/discovery.sh@75 -- # notify_id=0 00:25:42.241 15:49:33 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:25:42.241 15:49:33 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:25:42.241 15:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.241 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:25:42.241 15:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.241 15:49:33 -- host/discovery.sh@100 -- # sleep 1 00:25:42.810 [2024-11-26 15:49:34.126832] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:42.810 [2024-11-26 15:49:34.126861] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:42.810 [2024-11-26 15:49:34.126887] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:42.810 [2024-11-26 15:49:34.213172] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:25:43.067 [2024-11-26 15:49:34.439491] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:43.067 [2024-11-26 15:49:34.439517] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:43.067 15:49:34 -- host/discovery.sh@101 -- # get_subsystem_names 00:25:43.067 15:49:34 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:43.067 15:49:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.067 15:49:34 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:43.068 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:25:43.068 15:49:34 -- host/discovery.sh@59 -- # sort 00:25:43.068 15:49:34 -- host/discovery.sh@59 -- # xargs 00:25:43.068 15:49:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.068 15:49:34 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:43.068 15:49:34 -- host/discovery.sh@102 -- # get_bdev_list 00:25:43.068 15:49:34 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:43.068 15:49:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.068 15:49:34 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:43.068 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:25:43.068 15:49:34 -- host/discovery.sh@55 -- # sort 00:25:43.068 15:49:34 -- host/discovery.sh@55 -- # xargs 00:25:43.325 15:49:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.325 15:49:34 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:25:43.325 15:49:34 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:25:43.325 15:49:34 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:43.325 15:49:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.325 15:49:34 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:43.325 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:25:43.325 15:49:34 -- host/discovery.sh@63 -- # sort -n 00:25:43.325 15:49:34 -- host/discovery.sh@63 -- # xargs 00:25:43.325 15:49:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.325 15:49:34 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:25:43.325 15:49:34 -- host/discovery.sh@104 -- # get_notification_count 00:25:43.325 15:49:34 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:25:43.325 15:49:34 -- host/discovery.sh@74 -- # jq '. | length' 00:25:43.325 15:49:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.325 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:25:43.325 15:49:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.325 15:49:34 -- host/discovery.sh@74 -- # notification_count=1 00:25:43.325 15:49:34 -- host/discovery.sh@75 -- # notify_id=1 00:25:43.325 15:49:34 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:25:43.325 15:49:34 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:25:43.325 15:49:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.325 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:25:43.325 15:49:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.325 15:49:34 -- host/discovery.sh@109 -- # sleep 1 00:25:44.261 15:49:35 -- host/discovery.sh@110 -- # get_bdev_list 00:25:44.261 15:49:35 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:44.261 15:49:35 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:44.261 15:49:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.261 15:49:35 -- host/discovery.sh@55 -- # sort 00:25:44.261 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:25:44.261 15:49:35 -- host/discovery.sh@55 -- # xargs 00:25:44.261 15:49:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.261 15:49:35 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:44.261 15:49:35 -- host/discovery.sh@111 -- # get_notification_count 00:25:44.261 15:49:35 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:25:44.261 15:49:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.261 15:49:35 -- host/discovery.sh@74 -- # jq '. | length' 00:25:44.261 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:25:44.261 15:49:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.520 15:49:35 -- host/discovery.sh@74 -- # notification_count=1 00:25:44.520 15:49:35 -- host/discovery.sh@75 -- # notify_id=2 00:25:44.520 15:49:35 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:25:44.520 15:49:35 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:25:44.520 15:49:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.520 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:25:44.520 [2024-11-26 15:49:35.724468] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:44.520 [2024-11-26 15:49:35.725152] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:25:44.520 [2024-11-26 15:49:35.725189] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:44.520 15:49:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.520 15:49:35 -- host/discovery.sh@117 -- # sleep 1 00:25:44.520 [2024-11-26 15:49:35.811441] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:25:44.520 [2024-11-26 15:49:35.914104] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:44.520 [2024-11-26 15:49:35.914129] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:44.520 [2024-11-26 15:49:35.914139] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:45.457 15:49:36 -- host/discovery.sh@118 -- # get_subsystem_names 00:25:45.457 15:49:36 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:45.457 15:49:36 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:45.457 15:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.457 15:49:36 -- common/autotest_common.sh@10 -- # set +x 00:25:45.458 15:49:36 -- host/discovery.sh@59 -- # sort 00:25:45.458 15:49:36 -- host/discovery.sh@59 -- # xargs 00:25:45.458 15:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.458 15:49:36 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:45.458 15:49:36 -- host/discovery.sh@119 -- # get_bdev_list 00:25:45.458 15:49:36 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:45.458 15:49:36 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:45.458 15:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.458 15:49:36 -- host/discovery.sh@55 -- # sort 00:25:45.458 15:49:36 -- common/autotest_common.sh@10 -- # set +x 00:25:45.458 15:49:36 -- host/discovery.sh@55 -- # xargs 00:25:45.458 15:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.458 15:49:36 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:45.458 15:49:36 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:25:45.458 15:49:36 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:45.458 15:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.458 15:49:36 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:45.458 15:49:36 -- common/autotest_common.sh@10 -- # set +x 00:25:45.458 15:49:36 -- host/discovery.sh@63 -- # sort -n 00:25:45.458 15:49:36 -- host/discovery.sh@63 -- # xargs 00:25:45.458 15:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.458 15:49:36 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:25:45.458 15:49:36 -- host/discovery.sh@121 -- # get_notification_count 00:25:45.458 15:49:36 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:45.458 15:49:36 -- host/discovery.sh@74 -- # jq '. | length' 00:25:45.458 15:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.458 15:49:36 -- common/autotest_common.sh@10 -- # set +x 00:25:45.458 15:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.719 15:49:36 -- host/discovery.sh@74 -- # notification_count=0 00:25:45.719 15:49:36 -- host/discovery.sh@75 -- # notify_id=2 00:25:45.719 15:49:36 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:25:45.719 15:49:36 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:45.719 15:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.719 15:49:36 -- common/autotest_common.sh@10 -- # set +x 00:25:45.719 [2024-11-26 15:49:36.912448] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:25:45.719 [2024-11-26 15:49:36.912508] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:45.719 [2024-11-26 15:49:36.912727] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.719 [2024-11-26 15:49:36.912772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.719 [2024-11-26 15:49:36.912790] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.719 [2024-11-26 15:49:36.912804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.719 [2024-11-26 15:49:36.912818] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.719 [2024-11-26 15:49:36.912835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.719 [2024-11-26 15:49:36.912849] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.719 [2024-11-26 15:49:36.912863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.719 [2024-11-26 15:49:36.912876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa7810 is same with the state(5) to be set 00:25:45.719 15:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.719 15:49:36 -- host/discovery.sh@127 -- # sleep 1 00:25:45.719 [2024-11-26 15:49:36.922699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa7810 (9): Bad file descriptor 00:25:45.719 [2024-11-26 15:49:36.932772] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:45.719 [2024-11-26 15:49:36.933117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.719 [2024-11-26 15:49:36.933315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.719 [2024-11-26 15:49:36.933345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa7810 with addr=10.0.0.2, port=4420 00:25:45.719 [2024-11-26 15:49:36.933364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa7810 is same with the state(5) to be set 00:25:45.719 [2024-11-26 15:49:36.933391] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa7810 (9): Bad file descriptor 00:25:45.719 [2024-11-26 15:49:36.933415] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:45.719 [2024-11-26 15:49:36.933431] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:45.719 [2024-11-26 15:49:36.933450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:45.719 [2024-11-26 15:49:36.933472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.719 [2024-11-26 15:49:36.942867] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:45.719 [2024-11-26 15:49:36.943149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.719 [2024-11-26 15:49:36.943307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.719 [2024-11-26 15:49:36.943335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa7810 with addr=10.0.0.2, port=4420 00:25:45.719 [2024-11-26 15:49:36.943361] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa7810 is same with the state(5) to be set 00:25:45.719 [2024-11-26 15:49:36.943386] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa7810 (9): Bad file descriptor 00:25:45.719 [2024-11-26 15:49:36.943408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:45.719 [2024-11-26 15:49:36.943422] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:45.719 [2024-11-26 15:49:36.943437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:45.719 [2024-11-26 15:49:36.943458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.719 [2024-11-26 15:49:36.952951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:45.719 [2024-11-26 15:49:36.953148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.719 [2024-11-26 15:49:36.953275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.719 [2024-11-26 15:49:36.953304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa7810 with addr=10.0.0.2, port=4420 00:25:45.719 [2024-11-26 15:49:36.953321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa7810 is same with the state(5) to be set 00:25:45.719 [2024-11-26 15:49:36.953345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa7810 (9): Bad file descriptor 00:25:45.719 [2024-11-26 15:49:36.953367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:45.719 [2024-11-26 15:49:36.953381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:45.719 [2024-11-26 15:49:36.953395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:45.719 [2024-11-26 15:49:36.953415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.719 [2024-11-26 15:49:36.963039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:45.719 [2024-11-26 15:49:36.963234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.719 [2024-11-26 15:49:36.963411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.719 [2024-11-26 15:49:36.963439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa7810 with addr=10.0.0.2, port=4420 00:25:45.719 [2024-11-26 15:49:36.963456] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa7810 is same with the state(5) to be set 00:25:45.719 [2024-11-26 15:49:36.963480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa7810 (9): Bad file descriptor 00:25:45.719 [2024-11-26 15:49:36.963502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:45.719 [2024-11-26 15:49:36.963516] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:45.719 [2024-11-26 15:49:36.963531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:45.719 [2024-11-26 15:49:36.963553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.719 [2024-11-26 15:49:36.973123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:45.719 [2024-11-26 15:49:36.973302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.719 [2024-11-26 15:49:36.973457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.719 [2024-11-26 15:49:36.973485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa7810 with addr=10.0.0.2, port=4420 00:25:45.719 [2024-11-26 15:49:36.973502] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa7810 is same with the state(5) to be set 00:25:45.719 [2024-11-26 15:49:36.973532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa7810 (9): Bad file descriptor 00:25:45.719 [2024-11-26 15:49:36.973554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:45.719 [2024-11-26 15:49:36.973569] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:45.719 [2024-11-26 15:49:36.973584] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:45.719 [2024-11-26 15:49:36.973604] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.719 [2024-11-26 15:49:36.983201] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:45.720 [2024-11-26 15:49:36.983399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.720 [2024-11-26 15:49:36.983566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.720 [2024-11-26 15:49:36.983591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa7810 with addr=10.0.0.2, port=4420 00:25:45.720 [2024-11-26 15:49:36.983611] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa7810 is same with the state(5) to be set 00:25:45.720 [2024-11-26 15:49:36.983633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa7810 (9): Bad file descriptor 00:25:45.720 [2024-11-26 15:49:36.983652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:45.720 [2024-11-26 15:49:36.983668] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:45.720 [2024-11-26 15:49:36.983681] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:45.720 [2024-11-26 15:49:36.983709] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.720 [2024-11-26 15:49:36.993278] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:45.720 [2024-11-26 15:49:36.993470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.720 [2024-11-26 15:49:36.993621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.720 [2024-11-26 15:49:36.993649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa7810 with addr=10.0.0.2, port=4420 00:25:45.720 [2024-11-26 15:49:36.993666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa7810 is same with the state(5) to be set 00:25:45.720 [2024-11-26 15:49:36.993699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa7810 (9): Bad file descriptor 00:25:45.720 [2024-11-26 15:49:36.993723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:45.720 [2024-11-26 15:49:36.993738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:45.720 [2024-11-26 15:49:36.993766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:45.720 [2024-11-26 15:49:36.993785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.720 [2024-11-26 15:49:37.003356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:45.720 [2024-11-26 15:49:37.003558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.720 [2024-11-26 15:49:37.003735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.720 [2024-11-26 15:49:37.003777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa7810 with addr=10.0.0.2, port=4420 00:25:45.720 [2024-11-26 15:49:37.003793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa7810 is same with the state(5) to be set 00:25:45.720 [2024-11-26 15:49:37.003820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa7810 (9): Bad file descriptor 00:25:45.720 [2024-11-26 15:49:37.003852] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:45.720 [2024-11-26 15:49:37.003869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:45.720 [2024-11-26 15:49:37.003882] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:45.720 [2024-11-26 15:49:37.003901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.720 [2024-11-26 15:49:37.013437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:45.720 [2024-11-26 15:49:37.013614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.720 [2024-11-26 15:49:37.013784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.720 [2024-11-26 15:49:37.013811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa7810 with addr=10.0.0.2, port=4420 00:25:45.720 [2024-11-26 15:49:37.013827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa7810 is same with the state(5) to be set 00:25:45.720 [2024-11-26 15:49:37.013848] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa7810 (9): Bad file descriptor 00:25:45.720 [2024-11-26 15:49:37.013868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:45.720 [2024-11-26 15:49:37.013881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:45.720 [2024-11-26 15:49:37.013894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:45.720 [2024-11-26 15:49:37.013925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.720 [2024-11-26 15:49:37.023514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:45.720 [2024-11-26 15:49:37.023661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.720 [2024-11-26 15:49:37.023855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.720 [2024-11-26 15:49:37.023882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa7810 with addr=10.0.0.2, port=4420 00:25:45.720 [2024-11-26 15:49:37.023897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa7810 is same with the state(5) to be set 00:25:45.720 [2024-11-26 15:49:37.023918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa7810 (9): Bad file descriptor 00:25:45.720 [2024-11-26 15:49:37.023952] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:45.720 [2024-11-26 15:49:37.023969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:45.720 [2024-11-26 15:49:37.023982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:45.720 [2024-11-26 15:49:37.024001] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.720 [2024-11-26 15:49:37.033591] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:45.720 [2024-11-26 15:49:37.033775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.720 [2024-11-26 15:49:37.033942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.720 [2024-11-26 15:49:37.033968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa7810 with addr=10.0.0.2, port=4420 00:25:45.720 [2024-11-26 15:49:37.033983] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa7810 is same with the state(5) to be set 00:25:45.720 [2024-11-26 15:49:37.034005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa7810 (9): Bad file descriptor 00:25:45.720 [2024-11-26 15:49:37.034063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:45.720 [2024-11-26 15:49:37.034082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:45.720 [2024-11-26 15:49:37.034097] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:45.720 [2024-11-26 15:49:37.034133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.720 [2024-11-26 15:49:37.040065] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:25:45.720 [2024-11-26 15:49:37.040093] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:46.658 15:49:37 -- host/discovery.sh@128 -- # get_subsystem_names 00:25:46.658 15:49:37 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:46.658 15:49:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.658 15:49:37 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:46.658 15:49:37 -- common/autotest_common.sh@10 -- # set +x 00:25:46.658 15:49:37 -- host/discovery.sh@59 -- # sort 00:25:46.658 15:49:37 -- host/discovery.sh@59 -- # xargs 00:25:46.658 15:49:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.658 15:49:37 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:46.658 15:49:37 -- host/discovery.sh@129 -- # get_bdev_list 00:25:46.658 15:49:37 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:46.658 15:49:37 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:46.658 15:49:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.658 15:49:37 -- common/autotest_common.sh@10 -- # set +x 00:25:46.658 15:49:37 -- host/discovery.sh@55 -- # sort 00:25:46.658 15:49:37 -- host/discovery.sh@55 -- # xargs 00:25:46.658 15:49:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.658 15:49:37 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:46.658 15:49:37 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:25:46.658 15:49:37 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:46.658 15:49:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.658 15:49:37 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:46.658 15:49:37 -- common/autotest_common.sh@10 -- # set +x 00:25:46.658 15:49:37 -- host/discovery.sh@63 -- # sort -n 00:25:46.658 15:49:37 -- host/discovery.sh@63 -- # xargs 00:25:46.658 15:49:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.658 15:49:38 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:25:46.658 15:49:38 -- host/discovery.sh@131 -- # get_notification_count 00:25:46.658 15:49:38 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:46.658 15:49:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.658 15:49:38 -- host/discovery.sh@74 -- # jq '. | length' 00:25:46.658 15:49:38 -- common/autotest_common.sh@10 -- # set +x 00:25:46.658 15:49:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.658 15:49:38 -- host/discovery.sh@74 -- # notification_count=0 00:25:46.658 15:49:38 -- host/discovery.sh@75 -- # notify_id=2 00:25:46.658 15:49:38 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:25:46.659 15:49:38 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:25:46.659 15:49:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.659 15:49:38 -- common/autotest_common.sh@10 -- # set +x 00:25:46.659 15:49:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.659 15:49:38 -- host/discovery.sh@135 -- # sleep 1 00:25:48.038 15:49:39 -- host/discovery.sh@136 -- # get_subsystem_names 00:25:48.038 15:49:39 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:48.038 15:49:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.038 15:49:39 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:48.038 15:49:39 -- common/autotest_common.sh@10 -- # set +x 00:25:48.038 15:49:39 -- host/discovery.sh@59 -- # sort 00:25:48.038 15:49:39 -- host/discovery.sh@59 -- # xargs 00:25:48.038 15:49:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.038 15:49:39 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:25:48.038 15:49:39 -- host/discovery.sh@137 -- # get_bdev_list 00:25:48.038 15:49:39 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:48.038 15:49:39 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:48.038 15:49:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.038 15:49:39 -- common/autotest_common.sh@10 -- # set +x 00:25:48.038 15:49:39 -- host/discovery.sh@55 -- # sort 00:25:48.038 15:49:39 -- host/discovery.sh@55 -- # xargs 00:25:48.038 15:49:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.038 15:49:39 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:25:48.038 15:49:39 -- host/discovery.sh@138 -- # get_notification_count 00:25:48.038 15:49:39 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:48.038 15:49:39 -- host/discovery.sh@74 -- # jq '. | length' 00:25:48.038 15:49:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.038 15:49:39 -- common/autotest_common.sh@10 -- # set +x 00:25:48.038 15:49:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.038 15:49:39 -- host/discovery.sh@74 -- # notification_count=2 00:25:48.038 15:49:39 -- host/discovery.sh@75 -- # notify_id=4 00:25:48.038 15:49:39 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:25:48.038 15:49:39 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:48.038 15:49:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.038 15:49:39 -- common/autotest_common.sh@10 -- # set +x 00:25:48.974 [2024-11-26 15:49:40.274456] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:48.974 [2024-11-26 15:49:40.274497] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:48.974 [2024-11-26 15:49:40.274522] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:48.974 [2024-11-26 15:49:40.401926] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:25:49.545 [2024-11-26 15:49:40.708957] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:49.545 [2024-11-26 15:49:40.709012] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:49.545 15:49:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:49.545 15:49:40 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:49.545 15:49:40 -- common/autotest_common.sh@650 -- # local es=0 00:25:49.545 15:49:40 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:49.545 15:49:40 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:49.545 15:49:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:49.545 15:49:40 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:49.545 15:49:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:49.545 15:49:40 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:49.545 15:49:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.545 15:49:40 -- common/autotest_common.sh@10 -- # set +x 00:25:49.545 request: 00:25:49.545 { 00:25:49.545 "name": "nvme", 00:25:49.545 "trtype": "tcp", 00:25:49.545 "traddr": "10.0.0.2", 00:25:49.545 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:49.545 "adrfam": "ipv4", 00:25:49.545 "trsvcid": "8009", 00:25:49.545 "wait_for_attach": true, 00:25:49.545 "method": "bdev_nvme_start_discovery", 00:25:49.545 "req_id": 1 00:25:49.545 } 00:25:49.545 Got JSON-RPC error response 00:25:49.545 response: 00:25:49.546 { 00:25:49.546 "code": -17, 00:25:49.546 "message": "File exists" 00:25:49.546 } 00:25:49.546 15:49:40 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:49.546 15:49:40 -- common/autotest_common.sh@653 -- # es=1 00:25:49.546 15:49:40 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:49.546 15:49:40 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:49.546 15:49:40 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:49.546 15:49:40 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:25:49.546 15:49:40 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:49.546 15:49:40 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:49.546 15:49:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.546 15:49:40 -- common/autotest_common.sh@10 -- # set +x 00:25:49.546 15:49:40 -- host/discovery.sh@67 -- # sort 00:25:49.546 15:49:40 -- host/discovery.sh@67 -- # xargs 00:25:49.546 15:49:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:49.546 15:49:40 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:25:49.546 15:49:40 -- host/discovery.sh@147 -- # get_bdev_list 00:25:49.546 15:49:40 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:49.546 15:49:40 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:49.546 15:49:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.546 15:49:40 -- common/autotest_common.sh@10 -- # set +x 00:25:49.546 15:49:40 -- host/discovery.sh@55 -- # sort 00:25:49.546 15:49:40 -- host/discovery.sh@55 -- # xargs 00:25:49.546 15:49:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:49.546 15:49:40 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:49.546 15:49:40 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:49.546 15:49:40 -- common/autotest_common.sh@650 -- # local es=0 00:25:49.546 15:49:40 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:49.546 15:49:40 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:49.546 15:49:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:49.546 15:49:40 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:49.546 15:49:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:49.546 15:49:40 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:49.546 15:49:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.546 15:49:40 -- common/autotest_common.sh@10 -- # set +x 00:25:49.546 request: 00:25:49.546 { 00:25:49.546 "name": "nvme_second", 00:25:49.546 "trtype": "tcp", 00:25:49.546 "traddr": "10.0.0.2", 00:25:49.546 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:49.546 "adrfam": "ipv4", 00:25:49.546 "trsvcid": "8009", 00:25:49.546 "wait_for_attach": true, 00:25:49.546 "method": "bdev_nvme_start_discovery", 00:25:49.546 "req_id": 1 00:25:49.546 } 00:25:49.546 Got JSON-RPC error response 00:25:49.546 response: 00:25:49.546 { 00:25:49.546 "code": -17, 00:25:49.546 "message": "File exists" 00:25:49.546 } 00:25:49.546 15:49:40 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:49.546 15:49:40 -- common/autotest_common.sh@653 -- # es=1 00:25:49.546 15:49:40 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:49.546 15:49:40 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:49.546 15:49:40 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:49.546 15:49:40 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:25:49.546 15:49:40 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:49.546 15:49:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.546 15:49:40 -- common/autotest_common.sh@10 -- # set +x 00:25:49.546 15:49:40 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:49.546 15:49:40 -- host/discovery.sh@67 -- # sort 00:25:49.546 15:49:40 -- host/discovery.sh@67 -- # xargs 00:25:49.546 15:49:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:49.546 15:49:40 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:25:49.546 15:49:40 -- host/discovery.sh@153 -- # get_bdev_list 00:25:49.546 15:49:40 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:49.546 15:49:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.546 15:49:40 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:49.546 15:49:40 -- common/autotest_common.sh@10 -- # set +x 00:25:49.546 15:49:40 -- host/discovery.sh@55 -- # sort 00:25:49.546 15:49:40 -- host/discovery.sh@55 -- # xargs 00:25:49.546 15:49:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:49.546 15:49:40 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:49.546 15:49:40 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:49.546 15:49:40 -- common/autotest_common.sh@650 -- # local es=0 00:25:49.546 15:49:40 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:49.546 15:49:40 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:49.546 15:49:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:49.546 15:49:40 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:49.546 15:49:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:49.546 15:49:40 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:49.546 15:49:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.546 15:49:40 -- common/autotest_common.sh@10 -- # set +x 00:25:50.483 [2024-11-26 15:49:41.916330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:50.483 [2024-11-26 15:49:41.916520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:50.483 [2024-11-26 15:49:41.916550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fcb3d0 with addr=10.0.0.2, port=8010 00:25:50.483 [2024-11-26 15:49:41.916574] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:25:50.483 [2024-11-26 15:49:41.916589] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:50.483 [2024-11-26 15:49:41.916603] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:25:51.864 [2024-11-26 15:49:42.918773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.864 [2024-11-26 15:49:42.918922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.864 [2024-11-26 15:49:42.918948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f97d30 with addr=10.0.0.2, port=8010 00:25:51.864 [2024-11-26 15:49:42.918967] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:25:51.864 [2024-11-26 15:49:42.918980] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:51.864 [2024-11-26 15:49:42.918991] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:25:52.801 [2024-11-26 15:49:43.921025] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:25:52.801 request: 00:25:52.801 { 00:25:52.801 "name": "nvme_second", 00:25:52.801 "trtype": "tcp", 00:25:52.801 "traddr": "10.0.0.2", 00:25:52.801 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:52.801 "adrfam": "ipv4", 00:25:52.801 "trsvcid": "8010", 00:25:52.801 "attach_timeout_ms": 3000, 00:25:52.801 "method": "bdev_nvme_start_discovery", 00:25:52.801 "req_id": 1 00:25:52.801 } 00:25:52.801 Got JSON-RPC error response 00:25:52.801 response: 00:25:52.801 { 00:25:52.801 "code": -110, 00:25:52.801 "message": "Connection timed out" 00:25:52.801 } 00:25:52.801 15:49:43 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:52.801 15:49:43 -- common/autotest_common.sh@653 -- # es=1 00:25:52.801 15:49:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:52.801 15:49:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:52.801 15:49:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:52.801 15:49:43 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:25:52.801 15:49:43 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:52.801 15:49:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.801 15:49:43 -- common/autotest_common.sh@10 -- # set +x 00:25:52.801 15:49:43 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:52.801 15:49:43 -- host/discovery.sh@67 -- # sort 00:25:52.801 15:49:43 -- host/discovery.sh@67 -- # xargs 00:25:52.801 15:49:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.801 15:49:43 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:25:52.801 15:49:43 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:25:52.801 15:49:43 -- host/discovery.sh@162 -- # kill 968298 00:25:52.801 15:49:43 -- host/discovery.sh@163 -- # nvmftestfini 00:25:52.801 15:49:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:52.801 15:49:43 -- nvmf/common.sh@116 -- # sync 00:25:52.801 15:49:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:52.801 15:49:43 -- nvmf/common.sh@119 -- # set +e 00:25:52.801 15:49:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:52.801 15:49:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:52.801 rmmod nvme_tcp 00:25:52.801 rmmod nvme_fabrics 00:25:52.801 rmmod nvme_keyring 00:25:52.801 15:49:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:52.801 15:49:44 -- nvmf/common.sh@123 -- # set -e 00:25:52.801 15:49:44 -- nvmf/common.sh@124 -- # return 0 00:25:52.801 15:49:44 -- nvmf/common.sh@477 -- # '[' -n 968151 ']' 00:25:52.801 15:49:44 -- nvmf/common.sh@478 -- # killprocess 968151 00:25:52.801 15:49:44 -- common/autotest_common.sh@936 -- # '[' -z 968151 ']' 00:25:52.801 15:49:44 -- common/autotest_common.sh@940 -- # kill -0 968151 00:25:52.801 15:49:44 -- common/autotest_common.sh@941 -- # uname 00:25:52.801 15:49:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:52.801 15:49:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 968151 00:25:52.801 15:49:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:52.801 15:49:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:52.801 15:49:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 968151' 00:25:52.801 killing process with pid 968151 00:25:52.801 15:49:44 -- common/autotest_common.sh@955 -- # kill 968151 00:25:52.801 15:49:44 -- common/autotest_common.sh@960 -- # wait 968151 00:25:53.061 15:49:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:53.061 15:49:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:53.061 15:49:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:53.061 15:49:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:53.061 15:49:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:53.061 15:49:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:53.061 15:49:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:53.061 15:49:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:54.967 15:49:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:54.968 00:25:54.968 real 0m17.797s 00:25:54.968 user 0m27.696s 00:25:54.968 sys 0m2.925s 00:25:54.968 15:49:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:54.968 15:49:46 -- common/autotest_common.sh@10 -- # set +x 00:25:54.968 ************************************ 00:25:54.968 END TEST nvmf_discovery 00:25:54.968 ************************************ 00:25:55.229 15:49:46 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:25:55.229 15:49:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:55.229 15:49:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:55.229 15:49:46 -- common/autotest_common.sh@10 -- # set +x 00:25:55.229 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:25:55.229 ************************************ 00:25:55.229 START TEST nvmf_discovery_remove_ifc 00:25:55.229 ************************************ 00:25:55.229 15:49:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:25:55.229 * Looking for test storage... 00:25:55.229 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:55.229 15:49:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:55.229 15:49:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:55.229 15:49:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:55.229 15:49:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:55.229 15:49:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:55.229 15:49:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:55.229 15:49:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:55.229 15:49:46 -- scripts/common.sh@335 -- # IFS=.-: 00:25:55.229 15:49:46 -- scripts/common.sh@335 -- # read -ra ver1 00:25:55.229 15:49:46 -- scripts/common.sh@336 -- # IFS=.-: 00:25:55.229 15:49:46 -- scripts/common.sh@336 -- # read -ra ver2 00:25:55.229 15:49:46 -- scripts/common.sh@337 -- # local 'op=<' 00:25:55.229 15:49:46 -- scripts/common.sh@339 -- # ver1_l=2 00:25:55.229 15:49:46 -- scripts/common.sh@340 -- # ver2_l=1 00:25:55.229 15:49:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:55.229 15:49:46 -- scripts/common.sh@343 -- # case "$op" in 00:25:55.229 15:49:46 -- scripts/common.sh@344 -- # : 1 00:25:55.229 15:49:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:55.229 15:49:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:55.229 15:49:46 -- scripts/common.sh@364 -- # decimal 1 00:25:55.229 15:49:46 -- scripts/common.sh@352 -- # local d=1 00:25:55.229 15:49:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:55.229 15:49:46 -- scripts/common.sh@354 -- # echo 1 00:25:55.229 15:49:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:55.229 15:49:46 -- scripts/common.sh@365 -- # decimal 2 00:25:55.229 15:49:46 -- scripts/common.sh@352 -- # local d=2 00:25:55.229 15:49:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:55.229 15:49:46 -- scripts/common.sh@354 -- # echo 2 00:25:55.229 15:49:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:55.229 15:49:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:55.229 15:49:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:55.229 15:49:46 -- scripts/common.sh@367 -- # return 0 00:25:55.229 15:49:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:55.229 15:49:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:55.229 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:55.229 --rc genhtml_branch_coverage=1 00:25:55.229 --rc genhtml_function_coverage=1 00:25:55.229 --rc genhtml_legend=1 00:25:55.229 --rc geninfo_all_blocks=1 00:25:55.229 --rc geninfo_unexecuted_blocks=1 00:25:55.229 00:25:55.229 ' 00:25:55.229 15:49:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:55.229 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:55.229 --rc genhtml_branch_coverage=1 00:25:55.229 --rc genhtml_function_coverage=1 00:25:55.229 --rc genhtml_legend=1 00:25:55.229 --rc geninfo_all_blocks=1 00:25:55.229 --rc geninfo_unexecuted_blocks=1 00:25:55.229 00:25:55.229 ' 00:25:55.229 15:49:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:55.229 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:55.229 --rc genhtml_branch_coverage=1 00:25:55.229 --rc genhtml_function_coverage=1 00:25:55.229 --rc genhtml_legend=1 00:25:55.229 --rc geninfo_all_blocks=1 00:25:55.229 --rc geninfo_unexecuted_blocks=1 00:25:55.229 00:25:55.229 ' 00:25:55.229 15:49:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:55.229 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:55.229 --rc genhtml_branch_coverage=1 00:25:55.230 --rc genhtml_function_coverage=1 00:25:55.230 --rc genhtml_legend=1 00:25:55.230 --rc geninfo_all_blocks=1 00:25:55.230 --rc geninfo_unexecuted_blocks=1 00:25:55.230 00:25:55.230 ' 00:25:55.230 15:49:46 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:55.230 15:49:46 -- nvmf/common.sh@7 -- # uname -s 00:25:55.230 15:49:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:55.230 15:49:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:55.230 15:49:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:55.230 15:49:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:55.230 15:49:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:55.230 15:49:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:55.230 15:49:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:55.230 15:49:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:55.230 15:49:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:55.230 15:49:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:55.230 15:49:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:55.230 15:49:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:55.230 15:49:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:55.230 15:49:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:55.230 15:49:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:55.230 15:49:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:55.230 15:49:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:55.230 15:49:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:55.230 15:49:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:55.230 15:49:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:55.230 15:49:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:55.230 15:49:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:55.230 15:49:46 -- paths/export.sh@5 -- # export PATH 00:25:55.230 15:49:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:55.230 15:49:46 -- nvmf/common.sh@46 -- # : 0 00:25:55.230 15:49:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:55.230 15:49:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:55.230 15:49:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:55.230 15:49:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:55.230 15:49:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:55.230 15:49:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:55.230 15:49:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:55.230 15:49:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:55.230 15:49:46 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:25:55.230 15:49:46 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:25:55.230 15:49:46 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:25:55.230 15:49:46 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:25:55.230 15:49:46 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:25:55.230 15:49:46 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:25:55.230 15:49:46 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:25:55.230 15:49:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:55.230 15:49:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:55.230 15:49:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:55.230 15:49:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:55.230 15:49:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:55.230 15:49:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:55.230 15:49:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:55.230 15:49:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:55.230 15:49:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:55.230 15:49:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:55.230 15:49:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:55.230 15:49:46 -- common/autotest_common.sh@10 -- # set +x 00:25:57.161 15:49:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:57.161 15:49:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:57.161 15:49:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:57.161 15:49:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:57.161 15:49:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:57.161 15:49:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:57.161 15:49:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:57.161 15:49:48 -- nvmf/common.sh@294 -- # net_devs=() 00:25:57.161 15:49:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:57.161 15:49:48 -- nvmf/common.sh@295 -- # e810=() 00:25:57.161 15:49:48 -- nvmf/common.sh@295 -- # local -ga e810 00:25:57.161 15:49:48 -- nvmf/common.sh@296 -- # x722=() 00:25:57.161 15:49:48 -- nvmf/common.sh@296 -- # local -ga x722 00:25:57.161 15:49:48 -- nvmf/common.sh@297 -- # mlx=() 00:25:57.161 15:49:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:57.161 15:49:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:57.161 15:49:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:57.161 15:49:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:57.161 15:49:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:57.161 15:49:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:57.161 15:49:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:57.161 15:49:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:57.161 15:49:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:57.161 15:49:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:57.161 15:49:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:57.161 15:49:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:57.161 15:49:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:57.161 15:49:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:57.161 15:49:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:57.161 15:49:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:57.161 15:49:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:57.161 15:49:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:57.161 15:49:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:57.161 15:49:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:57.161 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:57.161 15:49:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:57.161 15:49:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:57.161 15:49:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:57.161 15:49:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:57.161 15:49:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:57.161 15:49:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:57.161 15:49:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:57.161 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:57.161 15:49:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:57.161 15:49:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:57.161 15:49:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:57.161 15:49:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:57.161 15:49:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:57.162 15:49:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:57.162 15:49:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:57.162 15:49:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:57.162 15:49:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:57.162 15:49:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:57.162 15:49:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:57.162 15:49:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:57.162 15:49:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:57.162 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:57.162 15:49:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:57.162 15:49:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:57.162 15:49:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:57.162 15:49:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:57.162 15:49:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:57.162 15:49:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:57.162 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:57.162 15:49:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:57.162 15:49:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:57.162 15:49:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:57.162 15:49:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:57.162 15:49:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:57.162 15:49:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:57.162 15:49:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:57.162 15:49:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:57.162 15:49:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:57.162 15:49:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:57.162 15:49:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:57.162 15:49:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:57.162 15:49:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:57.162 15:49:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:57.162 15:49:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:57.162 15:49:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:57.162 15:49:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:57.162 15:49:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:57.162 15:49:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:57.162 15:49:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:57.162 15:49:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:57.162 15:49:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:57.162 15:49:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:57.422 15:49:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:57.422 15:49:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:57.422 15:49:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:57.422 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:57.422 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.349 ms 00:25:57.422 00:25:57.422 --- 10.0.0.2 ping statistics --- 00:25:57.422 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:57.422 rtt min/avg/max/mdev = 0.349/0.349/0.349/0.000 ms 00:25:57.422 15:49:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:57.422 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:57.422 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:25:57.422 00:25:57.422 --- 10.0.0.1 ping statistics --- 00:25:57.422 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:57.422 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:25:57.422 15:49:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:57.422 15:49:48 -- nvmf/common.sh@410 -- # return 0 00:25:57.422 15:49:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:57.422 15:49:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:57.422 15:49:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:57.422 15:49:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:57.422 15:49:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:57.422 15:49:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:57.422 15:49:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:57.422 15:49:48 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:25:57.422 15:49:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:57.422 15:49:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:57.422 15:49:48 -- common/autotest_common.sh@10 -- # set +x 00:25:57.422 15:49:48 -- nvmf/common.sh@469 -- # nvmfpid=971801 00:25:57.422 15:49:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:25:57.422 15:49:48 -- nvmf/common.sh@470 -- # waitforlisten 971801 00:25:57.422 15:49:48 -- common/autotest_common.sh@829 -- # '[' -z 971801 ']' 00:25:57.422 15:49:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:57.422 15:49:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:57.422 15:49:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:57.422 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:57.422 15:49:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:57.422 15:49:48 -- common/autotest_common.sh@10 -- # set +x 00:25:57.422 [2024-11-26 15:49:48.731229] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:57.422 [2024-11-26 15:49:48.731291] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:57.422 EAL: No free 2048 kB hugepages reported on node 1 00:25:57.422 [2024-11-26 15:49:48.793570] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:57.699 [2024-11-26 15:49:48.905713] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:57.699 [2024-11-26 15:49:48.905883] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:57.699 [2024-11-26 15:49:48.905900] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:57.699 [2024-11-26 15:49:48.905912] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:57.699 [2024-11-26 15:49:48.905950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:58.635 15:49:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:58.635 15:49:49 -- common/autotest_common.sh@862 -- # return 0 00:25:58.635 15:49:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:58.635 15:49:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:58.635 15:49:49 -- common/autotest_common.sh@10 -- # set +x 00:25:58.635 15:49:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:58.635 15:49:49 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:25:58.635 15:49:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.635 15:49:49 -- common/autotest_common.sh@10 -- # set +x 00:25:58.635 [2024-11-26 15:49:49.759890] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:58.636 [2024-11-26 15:49:49.768096] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:25:58.636 null0 00:25:58.636 [2024-11-26 15:49:49.800018] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:58.636 15:49:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.636 15:49:49 -- host/discovery_remove_ifc.sh@59 -- # hostpid=971949 00:25:58.636 15:49:49 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:25:58.636 15:49:49 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 971949 /tmp/host.sock 00:25:58.636 15:49:49 -- common/autotest_common.sh@829 -- # '[' -z 971949 ']' 00:25:58.636 15:49:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:25:58.636 15:49:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:58.636 15:49:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:25:58.636 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:25:58.636 15:49:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:58.636 15:49:49 -- common/autotest_common.sh@10 -- # set +x 00:25:58.636 [2024-11-26 15:49:49.863349] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:58.636 [2024-11-26 15:49:49.863425] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid971949 ] 00:25:58.636 EAL: No free 2048 kB hugepages reported on node 1 00:25:58.636 [2024-11-26 15:49:49.929877] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:58.636 [2024-11-26 15:49:50.046892] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:58.636 [2024-11-26 15:49:50.047096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:58.893 15:49:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:58.893 15:49:50 -- common/autotest_common.sh@862 -- # return 0 00:25:58.893 15:49:50 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:58.893 15:49:50 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:25:58.893 15:49:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.893 15:49:50 -- common/autotest_common.sh@10 -- # set +x 00:25:58.893 15:49:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.893 15:49:50 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:25:58.893 15:49:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.893 15:49:50 -- common/autotest_common.sh@10 -- # set +x 00:25:58.893 15:49:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.893 15:49:50 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:25:58.893 15:49:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.893 15:49:50 -- common/autotest_common.sh@10 -- # set +x 00:26:00.270 [2024-11-26 15:49:51.298470] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:00.270 [2024-11-26 15:49:51.298523] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:00.270 [2024-11-26 15:49:51.298547] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:00.270 [2024-11-26 15:49:51.425938] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:00.270 [2024-11-26 15:49:51.488764] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:00.270 [2024-11-26 15:49:51.488820] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:00.270 [2024-11-26 15:49:51.488857] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:00.270 [2024-11-26 15:49:51.488878] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:00.270 [2024-11-26 15:49:51.488907] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:00.270 15:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:00.270 15:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.270 15:49:51 -- common/autotest_common.sh@10 -- # set +x 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:00.270 15:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:00.270 15:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.270 15:49:51 -- common/autotest_common.sh@10 -- # set +x 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:00.270 15:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:00.270 15:49:51 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:01.208 15:49:52 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:01.208 15:49:52 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:01.209 15:49:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.209 15:49:52 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:01.209 15:49:52 -- common/autotest_common.sh@10 -- # set +x 00:26:01.209 15:49:52 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:01.209 15:49:52 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:01.209 15:49:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.467 15:49:52 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:01.467 15:49:52 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:02.402 15:49:53 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:02.402 15:49:53 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:02.402 15:49:53 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:02.402 15:49:53 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:02.402 15:49:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.402 15:49:53 -- common/autotest_common.sh@10 -- # set +x 00:26:02.402 15:49:53 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:02.402 15:49:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.402 15:49:53 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:02.402 15:49:53 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:03.337 15:49:54 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:03.337 15:49:54 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:03.337 15:49:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:03.337 15:49:54 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:03.337 15:49:54 -- common/autotest_common.sh@10 -- # set +x 00:26:03.337 15:49:54 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:03.337 15:49:54 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:03.337 15:49:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:03.337 15:49:54 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:03.337 15:49:54 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:04.716 15:49:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:04.716 15:49:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:04.716 15:49:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:04.716 15:49:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.716 15:49:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:04.716 15:49:55 -- common/autotest_common.sh@10 -- # set +x 00:26:04.716 15:49:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:04.716 15:49:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.716 15:49:55 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:04.716 15:49:55 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:05.655 15:49:56 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:05.655 15:49:56 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:05.655 15:49:56 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:05.655 15:49:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.655 15:49:56 -- common/autotest_common.sh@10 -- # set +x 00:26:05.655 15:49:56 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:05.655 15:49:56 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:05.655 15:49:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.655 15:49:56 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:05.655 15:49:56 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:05.655 [2024-11-26 15:49:56.930676] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:05.655 [2024-11-26 15:49:56.930759] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.655 [2024-11-26 15:49:56.930794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.655 [2024-11-26 15:49:56.930811] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.655 [2024-11-26 15:49:56.930824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.655 [2024-11-26 15:49:56.930837] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.655 [2024-11-26 15:49:56.930849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.655 [2024-11-26 15:49:56.930862] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.655 [2024-11-26 15:49:56.930875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.655 [2024-11-26 15:49:56.930888] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.655 [2024-11-26 15:49:56.930900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.655 [2024-11-26 15:49:56.930913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8e0430 is same with the state(5) to be set 00:26:05.655 [2024-11-26 15:49:56.940701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8e0430 (9): Bad file descriptor 00:26:05.655 [2024-11-26 15:49:56.950803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:0 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.655 [2024-11-26 15:49:56.950828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.655 [2024-11-26 15:49:56.950873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:0 len:64 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.655 [2024-11-26 15:49:56.950890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.655 [2024-11-26 15:49:56.950907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:0 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.655 [2024-11-26 15:49:56.950927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.655 [2024-11-26 15:49:56.951052] bdev_nvme.c:1582:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x919d40 was disconnected and freed in a reset ctrlr sequence. 00:26:05.655 [2024-11-26 15:49:56.951077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:06.599 15:49:57 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:06.599 15:49:57 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:06.599 15:49:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.599 15:49:57 -- common/autotest_common.sh@10 -- # set +x 00:26:06.599 15:49:57 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:06.599 15:49:57 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:06.599 15:49:57 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:06.599 [2024-11-26 15:49:57.953732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:07.542 [2024-11-26 15:49:58.977743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:07.542 [2024-11-26 15:49:58.977832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8e0430 with addr=10.0.0.2, port=4420 00:26:07.542 [2024-11-26 15:49:58.977864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8e0430 is same with the state(5) to be set 00:26:07.542 [2024-11-26 15:49:58.977914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:07.542 [2024-11-26 15:49:58.977935] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:07.542 [2024-11-26 15:49:58.977949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:07.542 [2024-11-26 15:49:58.977967] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:07.542 [2024-11-26 15:49:58.978417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8e0430 (9): Bad file descriptor 00:26:07.542 [2024-11-26 15:49:58.978489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:07.542 [2024-11-26 15:49:58.978533] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:07.542 [2024-11-26 15:49:58.978576] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.542 [2024-11-26 15:49:58.978601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.542 [2024-11-26 15:49:58.978623] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.542 [2024-11-26 15:49:58.978637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.542 [2024-11-26 15:49:58.978652] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.542 [2024-11-26 15:49:58.978667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.542 [2024-11-26 15:49:58.978682] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.542 [2024-11-26 15:49:58.978716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.542 [2024-11-26 15:49:58.978733] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.542 [2024-11-26 15:49:58.978762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.542 [2024-11-26 15:49:58.978788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:07.542 [2024-11-26 15:49:58.978832] bdev.c:4968:_tmp_bdev_event_cb: *NOTICE*: Unexpected event type: 0 00:26:07.542 [2024-11-26 15:49:58.978915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8e0840 (9): Bad file descriptor 00:26:07.542 [2024-11-26 15:49:58.979953] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:07.542 [2024-11-26 15:49:58.979991] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:07.827 15:49:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.827 15:49:58 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:07.827 15:49:58 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:08.791 [2024-11-26 15:49:59.980967] bdev_raid.c:3350:raid_bdev_examine_load_sb_cb: *ERROR*: Failed to examine bdev nvme0n1: Input/output error 00:26:08.791 [2024-11-26 15:49:59.981030] vbdev_gpt.c: 468:gpt_bdev_complete: *ERROR*: Gpt: bdev=nvme0n1 io error status=0 00:26:08.791 15:49:59 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:08.791 15:49:59 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:08.791 15:49:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.791 15:49:59 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:08.791 15:49:59 -- common/autotest_common.sh@10 -- # set +x 00:26:08.791 15:49:59 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:08.791 15:49:59 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:08.791 15:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.791 15:50:00 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:08.791 15:50:00 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:08.791 15:50:00 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:08.791 15:50:00 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:08.791 15:50:00 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:08.791 15:50:00 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:08.791 15:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.791 15:50:00 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:08.791 15:50:00 -- common/autotest_common.sh@10 -- # set +x 00:26:08.791 15:50:00 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:08.791 15:50:00 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:08.791 15:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.791 15:50:00 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:08.791 15:50:00 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:09.732 [2024-11-26 15:50:00.993304] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:09.732 [2024-11-26 15:50:00.993334] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:09.732 [2024-11-26 15:50:00.993363] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:09.732 [2024-11-26 15:50:01.080622] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:09.732 15:50:01 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:09.732 15:50:01 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:09.732 15:50:01 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:09.732 15:50:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.732 15:50:01 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:09.732 15:50:01 -- common/autotest_common.sh@10 -- # set +x 00:26:09.732 15:50:01 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:09.732 15:50:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.732 [2024-11-26 15:50:01.143506] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:09.732 [2024-11-26 15:50:01.143558] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:09.732 [2024-11-26 15:50:01.143596] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:09.732 [2024-11-26 15:50:01.143620] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:09.732 [2024-11-26 15:50:01.143644] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:09.732 [2024-11-26 15:50:01.151782] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x8fe580 was disconnected and freed. delete nvme_qpair. 00:26:09.732 15:50:01 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:09.732 15:50:01 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:11.109 15:50:02 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:11.109 15:50:02 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:11.109 15:50:02 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:11.109 15:50:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.109 15:50:02 -- common/autotest_common.sh@10 -- # set +x 00:26:11.109 15:50:02 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:11.109 15:50:02 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:11.109 15:50:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.109 15:50:02 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:11.109 15:50:02 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:11.109 15:50:02 -- host/discovery_remove_ifc.sh@90 -- # killprocess 971949 00:26:11.109 15:50:02 -- common/autotest_common.sh@936 -- # '[' -z 971949 ']' 00:26:11.109 15:50:02 -- common/autotest_common.sh@940 -- # kill -0 971949 00:26:11.109 15:50:02 -- common/autotest_common.sh@941 -- # uname 00:26:11.109 15:50:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:11.109 15:50:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 971949 00:26:11.109 15:50:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:11.109 15:50:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:11.109 15:50:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 971949' 00:26:11.109 killing process with pid 971949 00:26:11.109 15:50:02 -- common/autotest_common.sh@955 -- # kill 971949 00:26:11.109 15:50:02 -- common/autotest_common.sh@960 -- # wait 971949 00:26:11.109 15:50:02 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:11.109 15:50:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:11.109 15:50:02 -- nvmf/common.sh@116 -- # sync 00:26:11.109 15:50:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:11.109 15:50:02 -- nvmf/common.sh@119 -- # set +e 00:26:11.109 15:50:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:11.109 15:50:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:11.109 rmmod nvme_tcp 00:26:11.109 rmmod nvme_fabrics 00:26:11.109 rmmod nvme_keyring 00:26:11.109 15:50:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:11.109 15:50:02 -- nvmf/common.sh@123 -- # set -e 00:26:11.109 15:50:02 -- nvmf/common.sh@124 -- # return 0 00:26:11.109 15:50:02 -- nvmf/common.sh@477 -- # '[' -n 971801 ']' 00:26:11.109 15:50:02 -- nvmf/common.sh@478 -- # killprocess 971801 00:26:11.109 15:50:02 -- common/autotest_common.sh@936 -- # '[' -z 971801 ']' 00:26:11.109 15:50:02 -- common/autotest_common.sh@940 -- # kill -0 971801 00:26:11.109 15:50:02 -- common/autotest_common.sh@941 -- # uname 00:26:11.109 15:50:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:11.109 15:50:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 971801 00:26:11.369 15:50:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:11.369 15:50:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:11.369 15:50:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 971801' 00:26:11.369 killing process with pid 971801 00:26:11.369 15:50:02 -- common/autotest_common.sh@955 -- # kill 971801 00:26:11.369 15:50:02 -- common/autotest_common.sh@960 -- # wait 971801 00:26:11.369 [2024-11-26 15:50:02.589342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x766b50 is same with the state(5) to be set 00:26:11.369 [2024-11-26 15:50:02.589412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x766b50 is same with the state(5) to be set 00:26:11.629 15:50:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:11.629 15:50:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:11.629 15:50:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:11.629 15:50:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:11.629 15:50:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:11.629 15:50:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:11.629 15:50:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:11.629 15:50:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:13.533 15:50:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:13.533 00:26:13.533 real 0m18.493s 00:26:13.533 user 0m25.574s 00:26:13.533 sys 0m3.122s 00:26:13.533 15:50:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:13.533 15:50:04 -- common/autotest_common.sh@10 -- # set +x 00:26:13.533 ************************************ 00:26:13.533 END TEST nvmf_discovery_remove_ifc 00:26:13.533 ************************************ 00:26:13.533 15:50:04 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:13.533 15:50:04 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:13.533 15:50:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:13.533 15:50:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:13.533 15:50:04 -- common/autotest_common.sh@10 -- # set +x 00:26:13.533 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:26:13.533 ************************************ 00:26:13.533 START TEST nvmf_digest 00:26:13.533 ************************************ 00:26:13.533 15:50:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:13.792 * Looking for test storage... 00:26:13.792 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:13.792 15:50:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:13.792 15:50:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:13.792 15:50:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:13.792 15:50:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:13.792 15:50:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:13.792 15:50:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:13.792 15:50:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:13.792 15:50:05 -- scripts/common.sh@335 -- # IFS=.-: 00:26:13.792 15:50:05 -- scripts/common.sh@335 -- # read -ra ver1 00:26:13.792 15:50:05 -- scripts/common.sh@336 -- # IFS=.-: 00:26:13.792 15:50:05 -- scripts/common.sh@336 -- # read -ra ver2 00:26:13.792 15:50:05 -- scripts/common.sh@337 -- # local 'op=<' 00:26:13.792 15:50:05 -- scripts/common.sh@339 -- # ver1_l=2 00:26:13.792 15:50:05 -- scripts/common.sh@340 -- # ver2_l=1 00:26:13.792 15:50:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:13.792 15:50:05 -- scripts/common.sh@343 -- # case "$op" in 00:26:13.792 15:50:05 -- scripts/common.sh@344 -- # : 1 00:26:13.792 15:50:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:13.792 15:50:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:13.792 15:50:05 -- scripts/common.sh@364 -- # decimal 1 00:26:13.792 15:50:05 -- scripts/common.sh@352 -- # local d=1 00:26:13.792 15:50:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:13.792 15:50:05 -- scripts/common.sh@354 -- # echo 1 00:26:13.792 15:50:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:13.792 15:50:05 -- scripts/common.sh@365 -- # decimal 2 00:26:13.792 15:50:05 -- scripts/common.sh@352 -- # local d=2 00:26:13.792 15:50:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:13.792 15:50:05 -- scripts/common.sh@354 -- # echo 2 00:26:13.792 15:50:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:13.792 15:50:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:13.792 15:50:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:13.792 15:50:05 -- scripts/common.sh@367 -- # return 0 00:26:13.792 15:50:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:13.792 15:50:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:13.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:13.792 --rc genhtml_branch_coverage=1 00:26:13.792 --rc genhtml_function_coverage=1 00:26:13.792 --rc genhtml_legend=1 00:26:13.792 --rc geninfo_all_blocks=1 00:26:13.792 --rc geninfo_unexecuted_blocks=1 00:26:13.792 00:26:13.792 ' 00:26:13.792 15:50:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:13.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:13.792 --rc genhtml_branch_coverage=1 00:26:13.792 --rc genhtml_function_coverage=1 00:26:13.792 --rc genhtml_legend=1 00:26:13.792 --rc geninfo_all_blocks=1 00:26:13.792 --rc geninfo_unexecuted_blocks=1 00:26:13.792 00:26:13.792 ' 00:26:13.792 15:50:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:13.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:13.792 --rc genhtml_branch_coverage=1 00:26:13.792 --rc genhtml_function_coverage=1 00:26:13.792 --rc genhtml_legend=1 00:26:13.792 --rc geninfo_all_blocks=1 00:26:13.792 --rc geninfo_unexecuted_blocks=1 00:26:13.792 00:26:13.792 ' 00:26:13.792 15:50:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:13.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:13.792 --rc genhtml_branch_coverage=1 00:26:13.792 --rc genhtml_function_coverage=1 00:26:13.792 --rc genhtml_legend=1 00:26:13.792 --rc geninfo_all_blocks=1 00:26:13.792 --rc geninfo_unexecuted_blocks=1 00:26:13.792 00:26:13.792 ' 00:26:13.792 15:50:05 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:13.792 15:50:05 -- nvmf/common.sh@7 -- # uname -s 00:26:13.792 15:50:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:13.792 15:50:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:13.792 15:50:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:13.792 15:50:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:13.792 15:50:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:13.792 15:50:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:13.792 15:50:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:13.792 15:50:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:13.792 15:50:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:13.792 15:50:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:13.792 15:50:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:13.792 15:50:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:13.792 15:50:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:13.792 15:50:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:13.792 15:50:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:13.792 15:50:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:13.792 15:50:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:13.792 15:50:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:13.792 15:50:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:13.793 15:50:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:13.793 15:50:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:13.793 15:50:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:13.793 15:50:05 -- paths/export.sh@5 -- # export PATH 00:26:13.793 15:50:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:13.793 15:50:05 -- nvmf/common.sh@46 -- # : 0 00:26:13.793 15:50:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:13.793 15:50:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:13.793 15:50:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:13.793 15:50:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:13.793 15:50:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:13.793 15:50:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:13.793 15:50:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:13.793 15:50:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:13.793 15:50:05 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:13.793 15:50:05 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:13.793 15:50:05 -- host/digest.sh@16 -- # runtime=2 00:26:13.793 15:50:05 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:13.793 15:50:05 -- host/digest.sh@132 -- # nvmftestinit 00:26:13.793 15:50:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:13.793 15:50:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:13.793 15:50:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:13.793 15:50:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:13.793 15:50:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:13.793 15:50:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:13.793 15:50:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:13.793 15:50:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:13.793 15:50:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:13.793 15:50:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:13.793 15:50:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:13.793 15:50:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.695 15:50:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:15.695 15:50:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:15.695 15:50:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:15.695 15:50:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:15.695 15:50:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:15.695 15:50:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:15.695 15:50:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:15.695 15:50:07 -- nvmf/common.sh@294 -- # net_devs=() 00:26:15.695 15:50:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:15.695 15:50:07 -- nvmf/common.sh@295 -- # e810=() 00:26:15.695 15:50:07 -- nvmf/common.sh@295 -- # local -ga e810 00:26:15.695 15:50:07 -- nvmf/common.sh@296 -- # x722=() 00:26:15.695 15:50:07 -- nvmf/common.sh@296 -- # local -ga x722 00:26:15.696 15:50:07 -- nvmf/common.sh@297 -- # mlx=() 00:26:15.696 15:50:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:15.696 15:50:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:15.696 15:50:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:15.696 15:50:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:15.696 15:50:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:15.696 15:50:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:15.696 15:50:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:15.696 15:50:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:15.696 15:50:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:15.696 15:50:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:15.696 15:50:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:15.696 15:50:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:15.696 15:50:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:15.696 15:50:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:15.696 15:50:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:15.696 15:50:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:15.696 15:50:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:15.696 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:15.696 15:50:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:15.696 15:50:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:15.696 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:15.696 15:50:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:15.696 15:50:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:15.696 15:50:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:15.696 15:50:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:15.696 15:50:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:15.696 15:50:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:15.696 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:15.696 15:50:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:15.696 15:50:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:15.696 15:50:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:15.696 15:50:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:15.696 15:50:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:15.696 15:50:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:15.696 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:15.696 15:50:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:15.696 15:50:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:15.696 15:50:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:15.696 15:50:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:15.696 15:50:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:15.696 15:50:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:15.696 15:50:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:15.696 15:50:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:15.696 15:50:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:15.696 15:50:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:15.696 15:50:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:15.696 15:50:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:15.696 15:50:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:15.696 15:50:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:15.696 15:50:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:15.696 15:50:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:15.696 15:50:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:15.696 15:50:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:15.696 15:50:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:15.696 15:50:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:15.696 15:50:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:15.696 15:50:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:15.955 15:50:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:15.955 15:50:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:15.955 15:50:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:15.955 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:15.955 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:26:15.955 00:26:15.955 --- 10.0.0.2 ping statistics --- 00:26:15.955 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:15.955 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:26:15.955 15:50:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:15.955 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:15.955 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:26:15.955 00:26:15.955 --- 10.0.0.1 ping statistics --- 00:26:15.955 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:15.955 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:26:15.955 15:50:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:15.955 15:50:07 -- nvmf/common.sh@410 -- # return 0 00:26:15.955 15:50:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:15.955 15:50:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:15.955 15:50:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:15.955 15:50:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:15.955 15:50:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:15.955 15:50:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:15.955 15:50:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:15.955 15:50:07 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:15.955 15:50:07 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:15.955 15:50:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:15.955 15:50:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:15.955 15:50:07 -- common/autotest_common.sh@10 -- # set +x 00:26:15.955 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:26:15.955 ************************************ 00:26:15.955 START TEST nvmf_digest_clean 00:26:15.955 ************************************ 00:26:15.955 15:50:07 -- common/autotest_common.sh@1114 -- # run_digest 00:26:15.955 15:50:07 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:15.955 15:50:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:15.955 15:50:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:15.955 15:50:07 -- common/autotest_common.sh@10 -- # set +x 00:26:15.955 15:50:07 -- nvmf/common.sh@469 -- # nvmfpid=975375 00:26:15.955 15:50:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:15.955 15:50:07 -- nvmf/common.sh@470 -- # waitforlisten 975375 00:26:15.955 15:50:07 -- common/autotest_common.sh@829 -- # '[' -z 975375 ']' 00:26:15.955 15:50:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:15.955 15:50:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:15.955 15:50:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:15.955 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:15.955 15:50:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:15.955 15:50:07 -- common/autotest_common.sh@10 -- # set +x 00:26:15.955 [2024-11-26 15:50:07.254903] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:15.955 [2024-11-26 15:50:07.254984] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:15.955 EAL: No free 2048 kB hugepages reported on node 1 00:26:15.955 [2024-11-26 15:50:07.323206] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:16.213 [2024-11-26 15:50:07.437589] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:16.213 [2024-11-26 15:50:07.437779] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:16.213 [2024-11-26 15:50:07.437798] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:16.213 [2024-11-26 15:50:07.437811] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:16.213 [2024-11-26 15:50:07.437839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:16.213 15:50:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:16.213 15:50:07 -- common/autotest_common.sh@862 -- # return 0 00:26:16.213 15:50:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:16.213 15:50:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:16.213 15:50:07 -- common/autotest_common.sh@10 -- # set +x 00:26:16.213 15:50:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:16.213 15:50:07 -- host/digest.sh@120 -- # common_target_config 00:26:16.213 15:50:07 -- host/digest.sh@43 -- # rpc_cmd 00:26:16.213 15:50:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.213 15:50:07 -- common/autotest_common.sh@10 -- # set +x 00:26:16.213 null0 00:26:16.213 [2024-11-26 15:50:07.648450] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:16.471 [2024-11-26 15:50:07.672702] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:16.471 15:50:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.471 15:50:07 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:16.471 15:50:07 -- host/digest.sh@77 -- # local rw bs qd 00:26:16.471 15:50:07 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:16.471 15:50:07 -- host/digest.sh@80 -- # rw=randread 00:26:16.471 15:50:07 -- host/digest.sh@80 -- # bs=4096 00:26:16.471 15:50:07 -- host/digest.sh@80 -- # qd=128 00:26:16.471 15:50:07 -- host/digest.sh@82 -- # bperfpid=975429 00:26:16.471 15:50:07 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:16.471 15:50:07 -- host/digest.sh@83 -- # waitforlisten 975429 /var/tmp/bperf.sock 00:26:16.471 15:50:07 -- common/autotest_common.sh@829 -- # '[' -z 975429 ']' 00:26:16.471 15:50:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:16.471 15:50:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:16.471 15:50:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:16.471 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:16.471 15:50:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:16.471 15:50:07 -- common/autotest_common.sh@10 -- # set +x 00:26:16.471 [2024-11-26 15:50:07.720001] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:16.471 [2024-11-26 15:50:07.720102] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid975429 ] 00:26:16.471 EAL: No free 2048 kB hugepages reported on node 1 00:26:16.471 [2024-11-26 15:50:07.787271] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:16.471 [2024-11-26 15:50:07.901048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:16.729 15:50:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:16.729 15:50:07 -- common/autotest_common.sh@862 -- # return 0 00:26:16.729 15:50:07 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:16.729 15:50:07 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:16.729 15:50:07 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:16.987 15:50:08 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:16.987 15:50:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:17.244 nvme0n1 00:26:17.244 15:50:08 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:17.244 15:50:08 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:17.504 Running I/O for 2 seconds... 00:26:19.415 00:26:19.415 Latency(us) 00:26:19.415 [2024-11-26T14:50:10.868Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:19.415 [2024-11-26T14:50:10.868Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:19.415 nvme0n1 : 2.05 15347.81 59.95 0.00 0.00 8167.44 3640.89 48933.55 00:26:19.415 [2024-11-26T14:50:10.868Z] =================================================================================================================== 00:26:19.415 [2024-11-26T14:50:10.868Z] Total : 15347.81 59.95 0.00 0.00 8167.44 3640.89 48933.55 00:26:19.415 0 00:26:19.415 15:50:10 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:19.415 15:50:10 -- host/digest.sh@92 -- # get_accel_stats 00:26:19.415 15:50:10 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:19.415 15:50:10 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:19.415 | select(.opcode=="crc32c") 00:26:19.415 | "\(.module_name) \(.executed)"' 00:26:19.415 15:50:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:19.673 15:50:11 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:19.673 15:50:11 -- host/digest.sh@93 -- # exp_module=software 00:26:19.673 15:50:11 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:19.673 15:50:11 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:19.673 15:50:11 -- host/digest.sh@97 -- # killprocess 975429 00:26:19.673 15:50:11 -- common/autotest_common.sh@936 -- # '[' -z 975429 ']' 00:26:19.673 15:50:11 -- common/autotest_common.sh@940 -- # kill -0 975429 00:26:19.673 15:50:11 -- common/autotest_common.sh@941 -- # uname 00:26:19.673 15:50:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:19.673 15:50:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 975429 00:26:19.931 15:50:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:19.931 15:50:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:19.931 15:50:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 975429' 00:26:19.931 killing process with pid 975429 00:26:19.931 15:50:11 -- common/autotest_common.sh@955 -- # kill 975429 00:26:19.931 Received shutdown signal, test time was about 2.000000 seconds 00:26:19.931 00:26:19.931 Latency(us) 00:26:19.931 [2024-11-26T14:50:11.385Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:19.932 [2024-11-26T14:50:11.385Z] =================================================================================================================== 00:26:19.932 [2024-11-26T14:50:11.385Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:19.932 15:50:11 -- common/autotest_common.sh@960 -- # wait 975429 00:26:20.191 15:50:11 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:20.191 15:50:11 -- host/digest.sh@77 -- # local rw bs qd 00:26:20.191 15:50:11 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:20.191 15:50:11 -- host/digest.sh@80 -- # rw=randread 00:26:20.191 15:50:11 -- host/digest.sh@80 -- # bs=131072 00:26:20.191 15:50:11 -- host/digest.sh@80 -- # qd=16 00:26:20.191 15:50:11 -- host/digest.sh@82 -- # bperfpid=975911 00:26:20.191 15:50:11 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:20.191 15:50:11 -- host/digest.sh@83 -- # waitforlisten 975911 /var/tmp/bperf.sock 00:26:20.191 15:50:11 -- common/autotest_common.sh@829 -- # '[' -z 975911 ']' 00:26:20.191 15:50:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:20.191 15:50:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:20.191 15:50:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:20.191 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:20.191 15:50:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:20.191 15:50:11 -- common/autotest_common.sh@10 -- # set +x 00:26:20.191 [2024-11-26 15:50:11.439013] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:20.191 [2024-11-26 15:50:11.439104] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid975911 ] 00:26:20.191 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:20.191 Zero copy mechanism will not be used. 00:26:20.191 EAL: No free 2048 kB hugepages reported on node 1 00:26:20.191 [2024-11-26 15:50:11.504202] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:20.191 [2024-11-26 15:50:11.618052] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:20.452 15:50:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:20.453 15:50:11 -- common/autotest_common.sh@862 -- # return 0 00:26:20.453 15:50:11 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:20.453 15:50:11 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:20.453 15:50:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:20.712 15:50:11 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:20.713 15:50:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:20.972 nvme0n1 00:26:20.972 15:50:12 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:20.972 15:50:12 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:21.230 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:21.230 Zero copy mechanism will not be used. 00:26:21.230 Running I/O for 2 seconds... 00:26:23.137 00:26:23.137 Latency(us) 00:26:23.137 [2024-11-26T14:50:14.590Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:23.137 [2024-11-26T14:50:14.590Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:23.137 nvme0n1 : 2.00 3928.40 491.05 0.00 0.00 4067.42 1328.92 11990.66 00:26:23.137 [2024-11-26T14:50:14.590Z] =================================================================================================================== 00:26:23.137 [2024-11-26T14:50:14.590Z] Total : 3928.40 491.05 0.00 0.00 4067.42 1328.92 11990.66 00:26:23.137 0 00:26:23.137 15:50:14 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:23.137 15:50:14 -- host/digest.sh@92 -- # get_accel_stats 00:26:23.137 15:50:14 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:23.137 15:50:14 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:23.137 | select(.opcode=="crc32c") 00:26:23.137 | "\(.module_name) \(.executed)"' 00:26:23.137 15:50:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:23.395 15:50:14 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:23.395 15:50:14 -- host/digest.sh@93 -- # exp_module=software 00:26:23.395 15:50:14 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:23.395 15:50:14 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:23.395 15:50:14 -- host/digest.sh@97 -- # killprocess 975911 00:26:23.395 15:50:14 -- common/autotest_common.sh@936 -- # '[' -z 975911 ']' 00:26:23.395 15:50:14 -- common/autotest_common.sh@940 -- # kill -0 975911 00:26:23.395 15:50:14 -- common/autotest_common.sh@941 -- # uname 00:26:23.395 15:50:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:23.395 15:50:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 975911 00:26:23.395 15:50:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:23.395 15:50:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:23.395 15:50:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 975911' 00:26:23.395 killing process with pid 975911 00:26:23.395 15:50:14 -- common/autotest_common.sh@955 -- # kill 975911 00:26:23.395 Received shutdown signal, test time was about 2.000000 seconds 00:26:23.395 00:26:23.395 Latency(us) 00:26:23.395 [2024-11-26T14:50:14.848Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:23.395 [2024-11-26T14:50:14.848Z] =================================================================================================================== 00:26:23.395 [2024-11-26T14:50:14.848Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:23.395 15:50:14 -- common/autotest_common.sh@960 -- # wait 975911 00:26:23.655 15:50:15 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:23.655 15:50:15 -- host/digest.sh@77 -- # local rw bs qd 00:26:23.655 15:50:15 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:23.655 15:50:15 -- host/digest.sh@80 -- # rw=randwrite 00:26:23.655 15:50:15 -- host/digest.sh@80 -- # bs=4096 00:26:23.655 15:50:15 -- host/digest.sh@80 -- # qd=128 00:26:23.655 15:50:15 -- host/digest.sh@82 -- # bperfpid=976313 00:26:23.655 15:50:15 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:23.655 15:50:15 -- host/digest.sh@83 -- # waitforlisten 976313 /var/tmp/bperf.sock 00:26:23.655 15:50:15 -- common/autotest_common.sh@829 -- # '[' -z 976313 ']' 00:26:23.655 15:50:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:23.655 15:50:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:23.655 15:50:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:23.655 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:23.655 15:50:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:23.655 15:50:15 -- common/autotest_common.sh@10 -- # set +x 00:26:23.655 [2024-11-26 15:50:15.066533] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:23.655 [2024-11-26 15:50:15.066607] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid976313 ] 00:26:23.655 EAL: No free 2048 kB hugepages reported on node 1 00:26:23.913 [2024-11-26 15:50:15.132243] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:23.913 [2024-11-26 15:50:15.244897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:23.913 15:50:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:23.913 15:50:15 -- common/autotest_common.sh@862 -- # return 0 00:26:23.913 15:50:15 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:23.913 15:50:15 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:23.913 15:50:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:24.482 15:50:15 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:24.482 15:50:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:24.741 nvme0n1 00:26:24.741 15:50:16 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:24.741 15:50:16 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:24.998 Running I/O for 2 seconds... 00:26:26.904 00:26:26.904 Latency(us) 00:26:26.904 [2024-11-26T14:50:18.357Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:26.904 [2024-11-26T14:50:18.357Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:26.904 nvme0n1 : 2.00 20898.46 81.63 0.00 0.00 6116.54 2754.94 10340.12 00:26:26.904 [2024-11-26T14:50:18.357Z] =================================================================================================================== 00:26:26.904 [2024-11-26T14:50:18.357Z] Total : 20898.46 81.63 0.00 0.00 6116.54 2754.94 10340.12 00:26:26.904 0 00:26:26.904 15:50:18 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:26.904 15:50:18 -- host/digest.sh@92 -- # get_accel_stats 00:26:26.904 15:50:18 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:26.904 15:50:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:26.904 15:50:18 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:26.904 | select(.opcode=="crc32c") 00:26:26.904 | "\(.module_name) \(.executed)"' 00:26:27.162 15:50:18 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:27.162 15:50:18 -- host/digest.sh@93 -- # exp_module=software 00:26:27.162 15:50:18 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:27.162 15:50:18 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:27.162 15:50:18 -- host/digest.sh@97 -- # killprocess 976313 00:26:27.163 15:50:18 -- common/autotest_common.sh@936 -- # '[' -z 976313 ']' 00:26:27.163 15:50:18 -- common/autotest_common.sh@940 -- # kill -0 976313 00:26:27.163 15:50:18 -- common/autotest_common.sh@941 -- # uname 00:26:27.163 15:50:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:27.163 15:50:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 976313 00:26:27.163 15:50:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:27.163 15:50:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:27.163 15:50:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 976313' 00:26:27.163 killing process with pid 976313 00:26:27.163 15:50:18 -- common/autotest_common.sh@955 -- # kill 976313 00:26:27.163 Received shutdown signal, test time was about 2.000000 seconds 00:26:27.163 00:26:27.163 Latency(us) 00:26:27.163 [2024-11-26T14:50:18.616Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:27.163 [2024-11-26T14:50:18.616Z] =================================================================================================================== 00:26:27.163 [2024-11-26T14:50:18.616Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:27.163 15:50:18 -- common/autotest_common.sh@960 -- # wait 976313 00:26:27.421 15:50:18 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:26:27.421 15:50:18 -- host/digest.sh@77 -- # local rw bs qd 00:26:27.421 15:50:18 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:27.421 15:50:18 -- host/digest.sh@80 -- # rw=randwrite 00:26:27.421 15:50:18 -- host/digest.sh@80 -- # bs=131072 00:26:27.421 15:50:18 -- host/digest.sh@80 -- # qd=16 00:26:27.421 15:50:18 -- host/digest.sh@82 -- # bperfpid=976716 00:26:27.421 15:50:18 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:27.421 15:50:18 -- host/digest.sh@83 -- # waitforlisten 976716 /var/tmp/bperf.sock 00:26:27.421 15:50:18 -- common/autotest_common.sh@829 -- # '[' -z 976716 ']' 00:26:27.421 15:50:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:27.421 15:50:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:27.421 15:50:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:27.421 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:27.421 15:50:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:27.421 15:50:18 -- common/autotest_common.sh@10 -- # set +x 00:26:27.421 [2024-11-26 15:50:18.847871] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:27.421 [2024-11-26 15:50:18.847946] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid976716 ] 00:26:27.421 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:27.421 Zero copy mechanism will not be used. 00:26:27.680 EAL: No free 2048 kB hugepages reported on node 1 00:26:27.680 [2024-11-26 15:50:18.913393] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:27.680 [2024-11-26 15:50:19.028453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:27.680 15:50:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:27.680 15:50:19 -- common/autotest_common.sh@862 -- # return 0 00:26:27.680 15:50:19 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:27.680 15:50:19 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:27.680 15:50:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:28.246 15:50:19 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:28.246 15:50:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:28.504 nvme0n1 00:26:28.504 15:50:19 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:28.504 15:50:19 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:28.763 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:28.763 Zero copy mechanism will not be used. 00:26:28.763 Running I/O for 2 seconds... 00:26:30.669 00:26:30.669 Latency(us) 00:26:30.669 [2024-11-26T14:50:22.122Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:30.669 [2024-11-26T14:50:22.122Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:30.669 nvme0n1 : 2.00 6043.27 755.41 0.00 0.00 2640.57 2002.49 12913.02 00:26:30.669 [2024-11-26T14:50:22.122Z] =================================================================================================================== 00:26:30.669 [2024-11-26T14:50:22.122Z] Total : 6043.27 755.41 0.00 0.00 2640.57 2002.49 12913.02 00:26:30.669 0 00:26:30.669 15:50:22 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:30.669 15:50:22 -- host/digest.sh@92 -- # get_accel_stats 00:26:30.669 15:50:22 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:30.669 15:50:22 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:30.669 | select(.opcode=="crc32c") 00:26:30.669 | "\(.module_name) \(.executed)"' 00:26:30.669 15:50:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:30.928 15:50:22 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:30.928 15:50:22 -- host/digest.sh@93 -- # exp_module=software 00:26:30.928 15:50:22 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:30.928 15:50:22 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:30.928 15:50:22 -- host/digest.sh@97 -- # killprocess 976716 00:26:30.928 15:50:22 -- common/autotest_common.sh@936 -- # '[' -z 976716 ']' 00:26:30.928 15:50:22 -- common/autotest_common.sh@940 -- # kill -0 976716 00:26:30.928 15:50:22 -- common/autotest_common.sh@941 -- # uname 00:26:30.928 15:50:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:30.928 15:50:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 976716 00:26:30.928 15:50:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:30.928 15:50:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:30.928 15:50:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 976716' 00:26:30.928 killing process with pid 976716 00:26:30.928 15:50:22 -- common/autotest_common.sh@955 -- # kill 976716 00:26:30.928 Received shutdown signal, test time was about 2.000000 seconds 00:26:30.928 00:26:30.928 Latency(us) 00:26:30.928 [2024-11-26T14:50:22.381Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:30.928 [2024-11-26T14:50:22.381Z] =================================================================================================================== 00:26:30.928 [2024-11-26T14:50:22.381Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:30.928 15:50:22 -- common/autotest_common.sh@960 -- # wait 976716 00:26:31.499 15:50:22 -- host/digest.sh@126 -- # killprocess 975375 00:26:31.499 15:50:22 -- common/autotest_common.sh@936 -- # '[' -z 975375 ']' 00:26:31.499 15:50:22 -- common/autotest_common.sh@940 -- # kill -0 975375 00:26:31.499 15:50:22 -- common/autotest_common.sh@941 -- # uname 00:26:31.499 15:50:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:31.499 15:50:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 975375 00:26:31.499 15:50:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:31.499 15:50:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:31.499 15:50:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 975375' 00:26:31.499 killing process with pid 975375 00:26:31.499 15:50:22 -- common/autotest_common.sh@955 -- # kill 975375 00:26:31.499 15:50:22 -- common/autotest_common.sh@960 -- # wait 975375 00:26:31.757 00:26:31.758 real 0m15.760s 00:26:31.758 user 0m31.320s 00:26:31.758 sys 0m4.288s 00:26:31.758 15:50:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:31.758 15:50:22 -- common/autotest_common.sh@10 -- # set +x 00:26:31.758 ************************************ 00:26:31.758 END TEST nvmf_digest_clean 00:26:31.758 ************************************ 00:26:31.758 15:50:22 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:26:31.758 15:50:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:31.758 15:50:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:31.758 15:50:22 -- common/autotest_common.sh@10 -- # set +x 00:26:31.758 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:26:31.758 ************************************ 00:26:31.758 START TEST nvmf_digest_error 00:26:31.758 ************************************ 00:26:31.758 15:50:23 -- common/autotest_common.sh@1114 -- # run_digest_error 00:26:31.758 15:50:23 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:26:31.758 15:50:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:31.758 15:50:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:31.758 15:50:23 -- common/autotest_common.sh@10 -- # set +x 00:26:31.758 15:50:23 -- nvmf/common.sh@469 -- # nvmfpid=977256 00:26:31.758 15:50:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:31.758 15:50:23 -- nvmf/common.sh@470 -- # waitforlisten 977256 00:26:31.758 15:50:23 -- common/autotest_common.sh@829 -- # '[' -z 977256 ']' 00:26:31.758 15:50:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:31.758 15:50:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:31.758 15:50:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:31.758 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:31.758 15:50:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:31.758 15:50:23 -- common/autotest_common.sh@10 -- # set +x 00:26:31.758 [2024-11-26 15:50:23.051416] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:31.758 [2024-11-26 15:50:23.051491] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:31.758 EAL: No free 2048 kB hugepages reported on node 1 00:26:31.758 [2024-11-26 15:50:23.119917] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:32.017 [2024-11-26 15:50:23.231593] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:32.017 [2024-11-26 15:50:23.231776] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:32.017 [2024-11-26 15:50:23.231796] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:32.017 [2024-11-26 15:50:23.231809] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:32.017 [2024-11-26 15:50:23.231837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:32.017 15:50:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:32.017 15:50:23 -- common/autotest_common.sh@862 -- # return 0 00:26:32.017 15:50:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:32.017 15:50:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:32.017 15:50:23 -- common/autotest_common.sh@10 -- # set +x 00:26:32.017 15:50:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:32.017 15:50:23 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:26:32.017 15:50:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.017 15:50:23 -- common/autotest_common.sh@10 -- # set +x 00:26:32.017 [2024-11-26 15:50:23.292408] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:26:32.017 15:50:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.017 15:50:23 -- host/digest.sh@104 -- # common_target_config 00:26:32.017 15:50:23 -- host/digest.sh@43 -- # rpc_cmd 00:26:32.017 15:50:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.017 15:50:23 -- common/autotest_common.sh@10 -- # set +x 00:26:32.017 null0 00:26:32.017 [2024-11-26 15:50:23.414741] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:32.017 [2024-11-26 15:50:23.438988] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:32.017 15:50:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.017 15:50:23 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:26:32.017 15:50:23 -- host/digest.sh@54 -- # local rw bs qd 00:26:32.017 15:50:23 -- host/digest.sh@56 -- # rw=randread 00:26:32.017 15:50:23 -- host/digest.sh@56 -- # bs=4096 00:26:32.017 15:50:23 -- host/digest.sh@56 -- # qd=128 00:26:32.017 15:50:23 -- host/digest.sh@58 -- # bperfpid=977284 00:26:32.017 15:50:23 -- host/digest.sh@60 -- # waitforlisten 977284 /var/tmp/bperf.sock 00:26:32.017 15:50:23 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:26:32.017 15:50:23 -- common/autotest_common.sh@829 -- # '[' -z 977284 ']' 00:26:32.017 15:50:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:32.017 15:50:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:32.017 15:50:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:32.017 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:32.017 15:50:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:32.017 15:50:23 -- common/autotest_common.sh@10 -- # set +x 00:26:32.275 [2024-11-26 15:50:23.482700] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:32.275 [2024-11-26 15:50:23.482787] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid977284 ] 00:26:32.275 EAL: No free 2048 kB hugepages reported on node 1 00:26:32.275 [2024-11-26 15:50:23.547060] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:32.275 [2024-11-26 15:50:23.668229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:33.255 15:50:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:33.255 15:50:24 -- common/autotest_common.sh@862 -- # return 0 00:26:33.255 15:50:24 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:33.255 15:50:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:33.532 15:50:24 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:33.532 15:50:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.532 15:50:24 -- common/autotest_common.sh@10 -- # set +x 00:26:33.532 15:50:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.532 15:50:24 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:33.532 15:50:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:33.790 nvme0n1 00:26:33.790 15:50:25 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:33.790 15:50:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.790 15:50:25 -- common/autotest_common.sh@10 -- # set +x 00:26:33.791 15:50:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.791 15:50:25 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:33.791 15:50:25 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:34.049 Running I/O for 2 seconds... 00:26:34.050 [2024-11-26 15:50:25.286571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.050 [2024-11-26 15:50:25.286623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17931 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.050 [2024-11-26 15:50:25.286656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.050 [2024-11-26 15:50:25.300072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.050 [2024-11-26 15:50:25.300110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4487 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.050 [2024-11-26 15:50:25.300139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.050 [2024-11-26 15:50:25.320314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.050 [2024-11-26 15:50:25.320351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:5270 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.050 [2024-11-26 15:50:25.320381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.050 [2024-11-26 15:50:25.340038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.050 [2024-11-26 15:50:25.340088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:2791 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.050 [2024-11-26 15:50:25.340118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.050 [2024-11-26 15:50:25.357787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.050 [2024-11-26 15:50:25.357818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:19721 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.050 [2024-11-26 15:50:25.357854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.050 [2024-11-26 15:50:25.378791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.050 [2024-11-26 15:50:25.378821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:1163 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.050 [2024-11-26 15:50:25.378845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.050 [2024-11-26 15:50:25.396931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.050 [2024-11-26 15:50:25.396961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:9213 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.050 [2024-11-26 15:50:25.396986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.050 [2024-11-26 15:50:25.409030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.050 [2024-11-26 15:50:25.409067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:19 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.050 [2024-11-26 15:50:25.409096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.050 [2024-11-26 15:50:25.434873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.050 [2024-11-26 15:50:25.434903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:600 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.050 [2024-11-26 15:50:25.434928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.050 [2024-11-26 15:50:25.453640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.050 [2024-11-26 15:50:25.453676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:24780 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.050 [2024-11-26 15:50:25.453714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.050 [2024-11-26 15:50:25.472224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.050 [2024-11-26 15:50:25.472260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:13513 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.050 [2024-11-26 15:50:25.472290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.050 [2024-11-26 15:50:25.489547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.050 [2024-11-26 15:50:25.489584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:17054 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.050 [2024-11-26 15:50:25.489615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.309 [2024-11-26 15:50:25.502657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.309 [2024-11-26 15:50:25.502708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:24109 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.309 [2024-11-26 15:50:25.502750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.309 [2024-11-26 15:50:25.521917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.309 [2024-11-26 15:50:25.521948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:17403 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.309 [2024-11-26 15:50:25.521978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.309 [2024-11-26 15:50:25.541092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.309 [2024-11-26 15:50:25.541129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:16646 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.309 [2024-11-26 15:50:25.541159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.309 [2024-11-26 15:50:25.560726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.309 [2024-11-26 15:50:25.560773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:10960 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.309 [2024-11-26 15:50:25.560799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.309 [2024-11-26 15:50:25.579530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.309 [2024-11-26 15:50:25.579567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24554 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.309 [2024-11-26 15:50:25.579598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.309 [2024-11-26 15:50:25.598534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.309 [2024-11-26 15:50:25.598571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:19573 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.309 [2024-11-26 15:50:25.598601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.309 [2024-11-26 15:50:25.617414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.309 [2024-11-26 15:50:25.617451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:15598 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.309 [2024-11-26 15:50:25.617488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.309 [2024-11-26 15:50:25.636001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.309 [2024-11-26 15:50:25.636031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:1184 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.309 [2024-11-26 15:50:25.636055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.309 [2024-11-26 15:50:25.655426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.309 [2024-11-26 15:50:25.655463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:14370 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.309 [2024-11-26 15:50:25.655494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.309 [2024-11-26 15:50:25.674206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.309 [2024-11-26 15:50:25.674244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:13132 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.309 [2024-11-26 15:50:25.674281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.309 [2024-11-26 15:50:25.693082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.309 [2024-11-26 15:50:25.693119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:3310 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.309 [2024-11-26 15:50:25.693149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.309 [2024-11-26 15:50:25.711912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.309 [2024-11-26 15:50:25.711942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:18869 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.309 [2024-11-26 15:50:25.711966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.309 [2024-11-26 15:50:25.731530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.309 [2024-11-26 15:50:25.731566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:1688 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.309 [2024-11-26 15:50:25.731596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.309 [2024-11-26 15:50:25.750566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.309 [2024-11-26 15:50:25.750604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:3646 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.309 [2024-11-26 15:50:25.750634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.570 [2024-11-26 15:50:25.769623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.570 [2024-11-26 15:50:25.769661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2978 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.570 [2024-11-26 15:50:25.769712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.570 [2024-11-26 15:50:25.788544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.570 [2024-11-26 15:50:25.788581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11112 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.570 [2024-11-26 15:50:25.788609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.570 [2024-11-26 15:50:25.807757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.570 [2024-11-26 15:50:25.807789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6210 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.570 [2024-11-26 15:50:25.807817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.570 [2024-11-26 15:50:25.826598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.570 [2024-11-26 15:50:25.826635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17852 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.570 [2024-11-26 15:50:25.826664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.570 [2024-11-26 15:50:25.845605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.570 [2024-11-26 15:50:25.845649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19411 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.570 [2024-11-26 15:50:25.845697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.570 [2024-11-26 15:50:25.864595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.570 [2024-11-26 15:50:25.864631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3264 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.570 [2024-11-26 15:50:25.864661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.570 [2024-11-26 15:50:25.882874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.570 [2024-11-26 15:50:25.882904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5443 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.570 [2024-11-26 15:50:25.882928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.570 [2024-11-26 15:50:25.902013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.570 [2024-11-26 15:50:25.902062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:740 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.570 [2024-11-26 15:50:25.902093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.570 [2024-11-26 15:50:25.921166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.570 [2024-11-26 15:50:25.921203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:4735 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.570 [2024-11-26 15:50:25.921233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.570 [2024-11-26 15:50:25.940620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.570 [2024-11-26 15:50:25.940657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:116 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.570 [2024-11-26 15:50:25.940695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.570 [2024-11-26 15:50:25.959556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.570 [2024-11-26 15:50:25.959592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:8940 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.570 [2024-11-26 15:50:25.959622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.570 [2024-11-26 15:50:25.971499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.570 [2024-11-26 15:50:25.971535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:20870 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.570 [2024-11-26 15:50:25.971565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.570 [2024-11-26 15:50:25.989239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.570 [2024-11-26 15:50:25.989275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:20687 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.570 [2024-11-26 15:50:25.989305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.570 [2024-11-26 15:50:26.008439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.570 [2024-11-26 15:50:26.008476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:1772 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.570 [2024-11-26 15:50:26.008506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.831 [2024-11-26 15:50:26.026908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.831 [2024-11-26 15:50:26.026939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:21955 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.831 [2024-11-26 15:50:26.026977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.831 [2024-11-26 15:50:26.045926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.831 [2024-11-26 15:50:26.045958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:2593 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.831 [2024-11-26 15:50:26.045983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.831 [2024-11-26 15:50:26.065776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.831 [2024-11-26 15:50:26.065808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:22049 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.831 [2024-11-26 15:50:26.065834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.831 [2024-11-26 15:50:26.084863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.831 [2024-11-26 15:50:26.084894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:18495 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.831 [2024-11-26 15:50:26.084920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.831 [2024-11-26 15:50:26.104672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.831 [2024-11-26 15:50:26.104732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:22395 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.831 [2024-11-26 15:50:26.104757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.831 [2024-11-26 15:50:26.123807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.831 [2024-11-26 15:50:26.123838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:21478 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.831 [2024-11-26 15:50:26.123863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.831 [2024-11-26 15:50:26.135792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.831 [2024-11-26 15:50:26.135824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:511 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.831 [2024-11-26 15:50:26.135849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.831 [2024-11-26 15:50:26.153434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.831 [2024-11-26 15:50:26.153470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:16949 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.831 [2024-11-26 15:50:26.153507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.831 [2024-11-26 15:50:26.172133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.831 [2024-11-26 15:50:26.172171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:7414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.831 [2024-11-26 15:50:26.172201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.831 [2024-11-26 15:50:26.199222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.831 [2024-11-26 15:50:26.199258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:3764 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.831 [2024-11-26 15:50:26.199289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.831 [2024-11-26 15:50:26.218156] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.831 [2024-11-26 15:50:26.218192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:550 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.831 [2024-11-26 15:50:26.218223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.831 [2024-11-26 15:50:26.236910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.831 [2024-11-26 15:50:26.236940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:8773 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.831 [2024-11-26 15:50:26.236966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.831 [2024-11-26 15:50:26.249277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.831 [2024-11-26 15:50:26.249314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:10314 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.831 [2024-11-26 15:50:26.249344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.831 [2024-11-26 15:50:26.267116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:34.831 [2024-11-26 15:50:26.267152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:16665 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.831 [2024-11-26 15:50:26.267182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.092 [2024-11-26 15:50:26.286317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.092 [2024-11-26 15:50:26.286355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:21631 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.092 [2024-11-26 15:50:26.286386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.092 [2024-11-26 15:50:26.305654] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.092 [2024-11-26 15:50:26.305699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:19351 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.092 [2024-11-26 15:50:26.305743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.092 [2024-11-26 15:50:26.324804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.092 [2024-11-26 15:50:26.324834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:16056 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.092 [2024-11-26 15:50:26.324859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.092 [2024-11-26 15:50:26.343625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.092 [2024-11-26 15:50:26.343662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:18005 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.092 [2024-11-26 15:50:26.343699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.092 [2024-11-26 15:50:26.361902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.092 [2024-11-26 15:50:26.361932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:18728 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.092 [2024-11-26 15:50:26.361955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.092 [2024-11-26 15:50:26.380510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.092 [2024-11-26 15:50:26.380547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:17666 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.092 [2024-11-26 15:50:26.380577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.092 [2024-11-26 15:50:26.399866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.092 [2024-11-26 15:50:26.399896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:8885 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.092 [2024-11-26 15:50:26.399920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.092 [2024-11-26 15:50:26.419040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.092 [2024-11-26 15:50:26.419077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:2137 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.092 [2024-11-26 15:50:26.419107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.092 [2024-11-26 15:50:26.438525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.092 [2024-11-26 15:50:26.438562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:8299 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.092 [2024-11-26 15:50:26.438592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.092 [2024-11-26 15:50:26.457640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.092 [2024-11-26 15:50:26.457678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17166 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.092 [2024-11-26 15:50:26.457716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.092 [2024-11-26 15:50:26.476375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.092 [2024-11-26 15:50:26.476412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12773 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.092 [2024-11-26 15:50:26.476450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.092 [2024-11-26 15:50:26.495785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.092 [2024-11-26 15:50:26.495815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25027 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.092 [2024-11-26 15:50:26.495840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.092 [2024-11-26 15:50:26.514799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.092 [2024-11-26 15:50:26.514829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:22723 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.092 [2024-11-26 15:50:26.514853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.092 [2024-11-26 15:50:26.533555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.092 [2024-11-26 15:50:26.533592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9715 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.092 [2024-11-26 15:50:26.533622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.352 [2024-11-26 15:50:26.552250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.352 [2024-11-26 15:50:26.552287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21273 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.352 [2024-11-26 15:50:26.552318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.352 [2024-11-26 15:50:26.571214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.352 [2024-11-26 15:50:26.571252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25572 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.352 [2024-11-26 15:50:26.571281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.352 [2024-11-26 15:50:26.590015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.352 [2024-11-26 15:50:26.590052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12510 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.352 [2024-11-26 15:50:26.590083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.352 [2024-11-26 15:50:26.608833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.352 [2024-11-26 15:50:26.608864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19352 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.352 [2024-11-26 15:50:26.608889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.352 [2024-11-26 15:50:26.626470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.353 [2024-11-26 15:50:26.626507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:8280 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.353 [2024-11-26 15:50:26.626537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.353 [2024-11-26 15:50:26.639295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.353 [2024-11-26 15:50:26.639338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:12474 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.353 [2024-11-26 15:50:26.639369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.353 [2024-11-26 15:50:26.658119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.353 [2024-11-26 15:50:26.658157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:3477 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.353 [2024-11-26 15:50:26.658186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.353 [2024-11-26 15:50:26.677490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.353 [2024-11-26 15:50:26.677527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:19859 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.353 [2024-11-26 15:50:26.677559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.353 [2024-11-26 15:50:26.697200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.353 [2024-11-26 15:50:26.697238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:12499 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.353 [2024-11-26 15:50:26.697267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.353 [2024-11-26 15:50:26.716505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.353 [2024-11-26 15:50:26.716542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:23797 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.353 [2024-11-26 15:50:26.716572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.353 [2024-11-26 15:50:26.733796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.353 [2024-11-26 15:50:26.733828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:17396 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.353 [2024-11-26 15:50:26.733853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.353 [2024-11-26 15:50:26.748189] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.353 [2024-11-26 15:50:26.748227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:813 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.353 [2024-11-26 15:50:26.748257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.353 [2024-11-26 15:50:26.766279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.353 [2024-11-26 15:50:26.766316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:18158 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.353 [2024-11-26 15:50:26.766345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.353 [2024-11-26 15:50:26.785976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.353 [2024-11-26 15:50:26.786024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:16884 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.353 [2024-11-26 15:50:26.786054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.611 [2024-11-26 15:50:26.805370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:26.805408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9016 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:26.805441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.612 [2024-11-26 15:50:26.817170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:26.817206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:9054 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:26.817236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.612 [2024-11-26 15:50:26.840660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:26.840706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:2620 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:26.840748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.612 [2024-11-26 15:50:26.853803] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:26.853833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:968 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:26.853859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.612 [2024-11-26 15:50:26.873102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:26.873141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:6859 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:26.873170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.612 [2024-11-26 15:50:26.892244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:26.892282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:716 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:26.892312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.612 [2024-11-26 15:50:26.911629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:26.911666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:21890 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:26.911705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.612 [2024-11-26 15:50:26.930921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:26.930982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:24367 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:26.931012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.612 [2024-11-26 15:50:26.950659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:26.950704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19529 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:26.950759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.612 [2024-11-26 15:50:26.962938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:26.962985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:5584 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:26.963010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.612 [2024-11-26 15:50:26.981259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:26.981296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:17587 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:26.981326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.612 [2024-11-26 15:50:27.000715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:27.000767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15258 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:27.000792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.612 [2024-11-26 15:50:27.020124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:27.020161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:4477 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:27.020190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.612 [2024-11-26 15:50:27.038961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:27.039006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:21104 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:27.039030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.612 [2024-11-26 15:50:27.058652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.612 [2024-11-26 15:50:27.058698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:21234 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.612 [2024-11-26 15:50:27.058744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.870 [2024-11-26 15:50:27.077987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.870 [2024-11-26 15:50:27.078018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:18726 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.870 [2024-11-26 15:50:27.078059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.870 [2024-11-26 15:50:27.090240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.870 [2024-11-26 15:50:27.090276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:18019 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.870 [2024-11-26 15:50:27.090307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.870 [2024-11-26 15:50:27.108090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.870 [2024-11-26 15:50:27.108132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:20070 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.870 [2024-11-26 15:50:27.108163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.870 [2024-11-26 15:50:27.127421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.870 [2024-11-26 15:50:27.127457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:4243 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.870 [2024-11-26 15:50:27.127487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.870 [2024-11-26 15:50:27.146557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.870 [2024-11-26 15:50:27.146594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:8869 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.870 [2024-11-26 15:50:27.146624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.870 [2024-11-26 15:50:27.164286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.870 [2024-11-26 15:50:27.164322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:2855 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.870 [2024-11-26 15:50:27.164352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.870 [2024-11-26 15:50:27.177582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.870 [2024-11-26 15:50:27.177619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:23830 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.870 [2024-11-26 15:50:27.177647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.870 [2024-11-26 15:50:27.196721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.870 [2024-11-26 15:50:27.196770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:19736 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.871 [2024-11-26 15:50:27.196794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.871 [2024-11-26 15:50:27.215534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.871 [2024-11-26 15:50:27.215571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:25493 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.871 [2024-11-26 15:50:27.215601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.871 [2024-11-26 15:50:27.234953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.871 [2024-11-26 15:50:27.234983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:9763 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.871 [2024-11-26 15:50:27.235025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.871 [2024-11-26 15:50:27.253830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.871 [2024-11-26 15:50:27.253860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:20891 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.871 [2024-11-26 15:50:27.253884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.871 [2024-11-26 15:50:27.272419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x190dbb0) 00:26:35.871 [2024-11-26 15:50:27.272456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:8503 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.871 [2024-11-26 15:50:27.272485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.871 00:26:35.871 Latency(us) 00:26:35.871 [2024-11-26T14:50:27.324Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:35.871 [2024-11-26T14:50:27.324Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:35.871 nvme0n1 : 2.05 13591.31 53.09 0.00 0.00 9226.16 4077.80 50486.99 00:26:35.871 [2024-11-26T14:50:27.324Z] =================================================================================================================== 00:26:35.871 [2024-11-26T14:50:27.324Z] Total : 13591.31 53.09 0.00 0.00 9226.16 4077.80 50486.99 00:26:35.871 0 00:26:36.129 15:50:27 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:36.129 15:50:27 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:36.129 15:50:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:36.129 15:50:27 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:36.129 | .driver_specific 00:26:36.129 | .nvme_error 00:26:36.129 | .status_code 00:26:36.129 | .command_transient_transport_error' 00:26:36.387 15:50:27 -- host/digest.sh@71 -- # (( 109 > 0 )) 00:26:36.387 15:50:27 -- host/digest.sh@73 -- # killprocess 977284 00:26:36.387 15:50:27 -- common/autotest_common.sh@936 -- # '[' -z 977284 ']' 00:26:36.387 15:50:27 -- common/autotest_common.sh@940 -- # kill -0 977284 00:26:36.387 15:50:27 -- common/autotest_common.sh@941 -- # uname 00:26:36.387 15:50:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:36.387 15:50:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 977284 00:26:36.387 15:50:27 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:36.387 15:50:27 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:36.387 15:50:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 977284' 00:26:36.387 killing process with pid 977284 00:26:36.387 15:50:27 -- common/autotest_common.sh@955 -- # kill 977284 00:26:36.387 Received shutdown signal, test time was about 2.000000 seconds 00:26:36.387 00:26:36.387 Latency(us) 00:26:36.387 [2024-11-26T14:50:27.840Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:36.387 [2024-11-26T14:50:27.840Z] =================================================================================================================== 00:26:36.387 [2024-11-26T14:50:27.840Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:36.387 15:50:27 -- common/autotest_common.sh@960 -- # wait 977284 00:26:36.645 15:50:27 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:26:36.645 15:50:27 -- host/digest.sh@54 -- # local rw bs qd 00:26:36.645 15:50:27 -- host/digest.sh@56 -- # rw=randread 00:26:36.645 15:50:27 -- host/digest.sh@56 -- # bs=131072 00:26:36.645 15:50:27 -- host/digest.sh@56 -- # qd=16 00:26:36.645 15:50:27 -- host/digest.sh@58 -- # bperfpid=977812 00:26:36.645 15:50:27 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:26:36.645 15:50:27 -- host/digest.sh@60 -- # waitforlisten 977812 /var/tmp/bperf.sock 00:26:36.645 15:50:27 -- common/autotest_common.sh@829 -- # '[' -z 977812 ']' 00:26:36.645 15:50:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:36.645 15:50:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:36.645 15:50:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:36.645 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:36.645 15:50:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:36.645 15:50:27 -- common/autotest_common.sh@10 -- # set +x 00:26:36.645 [2024-11-26 15:50:27.912342] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:36.645 [2024-11-26 15:50:27.912414] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid977812 ] 00:26:36.645 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:36.645 Zero copy mechanism will not be used. 00:26:36.645 EAL: No free 2048 kB hugepages reported on node 1 00:26:36.645 [2024-11-26 15:50:27.974150] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:36.645 [2024-11-26 15:50:28.091609] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:37.581 15:50:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:37.581 15:50:28 -- common/autotest_common.sh@862 -- # return 0 00:26:37.581 15:50:28 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:37.581 15:50:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:37.839 15:50:29 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:37.839 15:50:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:37.839 15:50:29 -- common/autotest_common.sh@10 -- # set +x 00:26:37.839 15:50:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:37.839 15:50:29 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:37.839 15:50:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:38.096 nvme0n1 00:26:38.096 15:50:29 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:26:38.096 15:50:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:38.096 15:50:29 -- common/autotest_common.sh@10 -- # set +x 00:26:38.096 15:50:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:38.096 15:50:29 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:38.096 15:50:29 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:38.357 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:38.357 Zero copy mechanism will not be used. 00:26:38.357 Running I/O for 2 seconds... 00:26:38.357 [2024-11-26 15:50:29.655734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.655821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.655855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.663123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.663162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.663196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.670297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.670333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.670365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.677556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.677593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.677637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.684543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.684580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.684611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.692574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.692610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.692641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.701376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.701412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.701443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.709954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.710001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.710027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.717633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.717670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.717710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.724914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.724947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.724991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.731802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.731834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.731861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.738648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.738684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.738737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.745637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.745672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.745727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.752756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.752786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.752812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.759581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.759616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.759647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.766446] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.766481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.766512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.773204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.773238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.773269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.779976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.780011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.780043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.786682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.786739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.786763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.793492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.793527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.793558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.357 [2024-11-26 15:50:29.800268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.357 [2024-11-26 15:50:29.800303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.357 [2024-11-26 15:50:29.800341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.807078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.807114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.807144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.813914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.813945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.813971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.820672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.820716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.820762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.827431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.827466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.827497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.834193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.834228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.834258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.841043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.841078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.841108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.847984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.848015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.848053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.854663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.854705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.854748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.861509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.861551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.861582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.868237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.868272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.868302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.875072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.875107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.875138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.881760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.881790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.881815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.888602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.888637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.888667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.895387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.895423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.895453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.902118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.902153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.902183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.908991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.909041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.909072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.915784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.915815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.915840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.922612] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.922647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.922676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.929441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.929475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.929506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.936388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.936423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.936453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.943138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.943173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.619 [2024-11-26 15:50:29.943203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.619 [2024-11-26 15:50:29.949938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.619 [2024-11-26 15:50:29.949967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:29.949993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:29.956635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:29.956670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:29.956710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:29.963407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:29.963442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:29.963473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:29.970176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:29.970211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:29.970242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:29.977013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:29.977054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:29.977084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:29.983809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:29.983840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:29.983866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:29.990707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:29.990741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:29.990771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:29.997583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:29.997618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:29.997648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:30.004675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:30.004736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:30.004764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:30.011584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:30.011622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:30.011652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:30.018727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:30.018777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:30.018805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:30.025554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:30.025591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:30.025622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:30.032306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:30.032343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:30.032373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:30.039090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:30.039127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:30.039159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:30.045903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:30.045950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:30.045978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:30.053744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:30.053779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:30.053808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.620 [2024-11-26 15:50:30.061512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.620 [2024-11-26 15:50:30.061548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.620 [2024-11-26 15:50:30.061580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.068782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.068815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.068842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.076309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.076345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.076377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.083694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.083743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.083768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.091320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.091356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.091387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.098491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.098527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.098581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.105295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.105330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.105361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.112105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.112140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.112171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.119414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.119448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.119480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.128179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.128215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.128246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.136068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.136105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.136136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.144184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.144221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.144252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.151650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.151695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.151741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.159546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.159582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.159613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.167969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.168025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.168056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.176580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.176617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.176648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.185646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.185683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.185725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.194997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.195027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.195072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.203511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.203548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.203580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.211219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.211255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.211286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.220441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.220477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.220507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.229585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.229622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.229651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.238311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.238348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.238378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.245899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.245933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.245961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.255758] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.255793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.880 [2024-11-26 15:50:30.255822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.880 [2024-11-26 15:50:30.262609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.880 [2024-11-26 15:50:30.262646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.881 [2024-11-26 15:50:30.262678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.881 [2024-11-26 15:50:30.269453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.881 [2024-11-26 15:50:30.269490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.881 [2024-11-26 15:50:30.269520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.881 [2024-11-26 15:50:30.278570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.881 [2024-11-26 15:50:30.278605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.881 [2024-11-26 15:50:30.278646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.881 [2024-11-26 15:50:30.287298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.881 [2024-11-26 15:50:30.287334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.881 [2024-11-26 15:50:30.287366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.881 [2024-11-26 15:50:30.295899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.881 [2024-11-26 15:50:30.295932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.881 [2024-11-26 15:50:30.295959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.881 [2024-11-26 15:50:30.303650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.881 [2024-11-26 15:50:30.303711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.881 [2024-11-26 15:50:30.303741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.881 [2024-11-26 15:50:30.311082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.881 [2024-11-26 15:50:30.311125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.881 [2024-11-26 15:50:30.311156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.881 [2024-11-26 15:50:30.319202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:38.881 [2024-11-26 15:50:30.319239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.881 [2024-11-26 15:50:30.319269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.327601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.327636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.141 [2024-11-26 15:50:30.327664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.336623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.336659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.141 [2024-11-26 15:50:30.336699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.345569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.345605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.141 [2024-11-26 15:50:30.345636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.354404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.354437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.141 [2024-11-26 15:50:30.354482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.363230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.363269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.141 [2024-11-26 15:50:30.363300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.372188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.372225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.141 [2024-11-26 15:50:30.372255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.380608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.380643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.141 [2024-11-26 15:50:30.380675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.389288] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.389325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.141 [2024-11-26 15:50:30.389355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.398047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.398085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.141 [2024-11-26 15:50:30.398117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.406268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.406318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.141 [2024-11-26 15:50:30.406345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.413779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.413812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.141 [2024-11-26 15:50:30.413839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.421306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.421342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.141 [2024-11-26 15:50:30.421372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.428769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.428817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.141 [2024-11-26 15:50:30.428843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.435997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.436029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.141 [2024-11-26 15:50:30.436071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.141 [2024-11-26 15:50:30.443816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.141 [2024-11-26 15:50:30.443848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.443876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.451343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.451378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.451417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.458668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.458711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.458753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.466376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.466412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.466442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.474227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.474263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.474295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.482662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.482707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.482753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.490236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.490286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.490318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.497541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.497577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.497608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.504043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.504080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.504112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.511708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.511756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.511783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.519796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.519834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.519862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.527485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.527521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.527551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.535301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.535351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.535379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.542793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.542838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.542865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.550781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.550813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.550841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.557112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.557148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.557178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.563670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.563729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.563757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.571404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.571436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.571464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.578915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.578946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.578973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.142 [2024-11-26 15:50:30.587169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.142 [2024-11-26 15:50:30.587206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.142 [2024-11-26 15:50:30.587236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.594825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.594858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.594885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.602440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.602476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.602505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.610095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.610131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.610161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.617802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.617834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.617861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.625436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.625472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.625503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.632812] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.632857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.632883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.640170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.640207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.640237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.647699] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.647746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.647780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.655166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.655202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.655233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.663109] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.663146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.663176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.670926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.670958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.671003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.678896] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.678930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.678957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.687069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.687105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.687136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.694543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.694578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.694609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.701787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.701820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.701848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.709335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.709371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.709402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.716907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.716940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.716968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.724157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.724193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.724223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.731634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.731670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.731710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.738831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.738862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.738904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.745890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.745926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.745962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.753590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.753626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.753657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.760865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.760898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.760925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.402 [2024-11-26 15:50:30.767899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.402 [2024-11-26 15:50:30.767930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.402 [2024-11-26 15:50:30.767957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.403 [2024-11-26 15:50:30.775239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.403 [2024-11-26 15:50:30.775275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.403 [2024-11-26 15:50:30.775313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.403 [2024-11-26 15:50:30.782462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.403 [2024-11-26 15:50:30.782496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.403 [2024-11-26 15:50:30.782527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.403 [2024-11-26 15:50:30.789848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.403 [2024-11-26 15:50:30.789881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.403 [2024-11-26 15:50:30.789908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.403 [2024-11-26 15:50:30.797193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.403 [2024-11-26 15:50:30.797229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.403 [2024-11-26 15:50:30.797260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.403 [2024-11-26 15:50:30.804498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.403 [2024-11-26 15:50:30.804545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.403 [2024-11-26 15:50:30.804573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.403 [2024-11-26 15:50:30.811918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.403 [2024-11-26 15:50:30.811949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.403 [2024-11-26 15:50:30.811976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.403 [2024-11-26 15:50:30.819213] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.403 [2024-11-26 15:50:30.819260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.403 [2024-11-26 15:50:30.819288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.403 [2024-11-26 15:50:30.826282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.403 [2024-11-26 15:50:30.826318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.403 [2024-11-26 15:50:30.826349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.403 [2024-11-26 15:50:30.833534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.403 [2024-11-26 15:50:30.833569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.403 [2024-11-26 15:50:30.833599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.403 [2024-11-26 15:50:30.840608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.403 [2024-11-26 15:50:30.840648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.403 [2024-11-26 15:50:30.840679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.403 [2024-11-26 15:50:30.847899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.403 [2024-11-26 15:50:30.847932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.403 [2024-11-26 15:50:30.847959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.855210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.855247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.855278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.862932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.862965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.862992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.870436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.870471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.870502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.877653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.877697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.877731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.885253] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.885290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.885334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.892419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.892455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.892487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.899742] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.899774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.899802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.906946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.906995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.907025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.914170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.914206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.914236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.921629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.921664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.921705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.928633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.928665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.928700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.935826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.935858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.935885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.943361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.943398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.943429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.951166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.951216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.951243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.958790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.958822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.958850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.966242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.966278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.966316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.973430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.973467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.973498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.981184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.981219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.981251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.989820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.989853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.989881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:30.998533] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:30.998568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:30.998598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:31.007651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:31.007694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:31.007728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:31.016900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:31.016931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:31.016958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:31.026422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:31.026458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:31.026502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:31.035709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:31.035741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.662 [2024-11-26 15:50:31.035770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.662 [2024-11-26 15:50:31.045082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.662 [2024-11-26 15:50:31.045125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.663 [2024-11-26 15:50:31.045156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.663 [2024-11-26 15:50:31.053775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.663 [2024-11-26 15:50:31.053808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.663 [2024-11-26 15:50:31.053836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.663 [2024-11-26 15:50:31.062810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.663 [2024-11-26 15:50:31.062842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.663 [2024-11-26 15:50:31.062869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.663 [2024-11-26 15:50:31.070279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.663 [2024-11-26 15:50:31.070314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.663 [2024-11-26 15:50:31.070345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.663 [2024-11-26 15:50:31.077786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.663 [2024-11-26 15:50:31.077818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.663 [2024-11-26 15:50:31.077846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.663 [2024-11-26 15:50:31.085466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.663 [2024-11-26 15:50:31.085501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.663 [2024-11-26 15:50:31.085531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.663 [2024-11-26 15:50:31.093273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.663 [2024-11-26 15:50:31.093310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.663 [2024-11-26 15:50:31.093340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.663 [2024-11-26 15:50:31.100868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.663 [2024-11-26 15:50:31.100901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.663 [2024-11-26 15:50:31.100929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.663 [2024-11-26 15:50:31.108414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.663 [2024-11-26 15:50:31.108451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.663 [2024-11-26 15:50:31.108482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.936 [2024-11-26 15:50:31.116260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.936 [2024-11-26 15:50:31.116297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.936 [2024-11-26 15:50:31.116328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.936 [2024-11-26 15:50:31.123632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.937 [2024-11-26 15:50:31.123667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.937 [2024-11-26 15:50:31.123707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.937 [2024-11-26 15:50:31.131580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.937 [2024-11-26 15:50:31.131616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.937 [2024-11-26 15:50:31.131646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.937 [2024-11-26 15:50:31.139942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.937 [2024-11-26 15:50:31.139974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.937 [2024-11-26 15:50:31.140015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.937 [2024-11-26 15:50:31.147933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.937 [2024-11-26 15:50:31.147965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.937 [2024-11-26 15:50:31.147992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.937 [2024-11-26 15:50:31.155074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.937 [2024-11-26 15:50:31.155111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.937 [2024-11-26 15:50:31.155141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.937 [2024-11-26 15:50:31.161504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.937 [2024-11-26 15:50:31.161540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.937 [2024-11-26 15:50:31.161571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.937 [2024-11-26 15:50:31.166250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.937 [2024-11-26 15:50:31.166287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.937 [2024-11-26 15:50:31.166318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.937 [2024-11-26 15:50:31.174934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.937 [2024-11-26 15:50:31.174964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.937 [2024-11-26 15:50:31.175016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.937 [2024-11-26 15:50:31.182840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.938 [2024-11-26 15:50:31.182885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.938 [2024-11-26 15:50:31.182910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.938 [2024-11-26 15:50:31.188946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.938 [2024-11-26 15:50:31.188994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.938 [2024-11-26 15:50:31.189026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.938 [2024-11-26 15:50:31.194799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.938 [2024-11-26 15:50:31.194831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.938 [2024-11-26 15:50:31.194858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.938 [2024-11-26 15:50:31.200155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.938 [2024-11-26 15:50:31.200190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.938 [2024-11-26 15:50:31.200220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.938 [2024-11-26 15:50:31.205400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.938 [2024-11-26 15:50:31.205435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.938 [2024-11-26 15:50:31.205466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.938 [2024-11-26 15:50:31.210876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.938 [2024-11-26 15:50:31.210906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.938 [2024-11-26 15:50:31.210931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.938 [2024-11-26 15:50:31.217284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.938 [2024-11-26 15:50:31.217319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.939 [2024-11-26 15:50:31.217349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.939 [2024-11-26 15:50:31.224153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.939 [2024-11-26 15:50:31.224189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.939 [2024-11-26 15:50:31.224219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.939 [2024-11-26 15:50:31.231035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.939 [2024-11-26 15:50:31.231069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.939 [2024-11-26 15:50:31.231101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.939 [2024-11-26 15:50:31.238152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.939 [2024-11-26 15:50:31.238189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.939 [2024-11-26 15:50:31.238220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.939 [2024-11-26 15:50:31.244986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.939 [2024-11-26 15:50:31.245036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.939 [2024-11-26 15:50:31.245067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.939 [2024-11-26 15:50:31.251940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.940 [2024-11-26 15:50:31.251969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.940 [2024-11-26 15:50:31.252010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.940 [2024-11-26 15:50:31.258786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.940 [2024-11-26 15:50:31.258831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.940 [2024-11-26 15:50:31.258857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.940 [2024-11-26 15:50:31.265581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.940 [2024-11-26 15:50:31.265615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.940 [2024-11-26 15:50:31.265646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.940 [2024-11-26 15:50:31.272553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.940 [2024-11-26 15:50:31.272589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.940 [2024-11-26 15:50:31.272618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.940 [2024-11-26 15:50:31.279548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.940 [2024-11-26 15:50:31.279584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.940 [2024-11-26 15:50:31.279614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.940 [2024-11-26 15:50:31.286610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.940 [2024-11-26 15:50:31.286645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.940 [2024-11-26 15:50:31.286682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.940 [2024-11-26 15:50:31.293541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.940 [2024-11-26 15:50:31.293576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.940 [2024-11-26 15:50:31.293606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.940 [2024-11-26 15:50:31.300531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.940 [2024-11-26 15:50:31.300566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.940 [2024-11-26 15:50:31.300596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.941 [2024-11-26 15:50:31.307623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.941 [2024-11-26 15:50:31.307658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.941 [2024-11-26 15:50:31.307697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.941 [2024-11-26 15:50:31.314634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.941 [2024-11-26 15:50:31.314669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.941 [2024-11-26 15:50:31.314711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.941 [2024-11-26 15:50:31.321639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.941 [2024-11-26 15:50:31.321673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.941 [2024-11-26 15:50:31.321714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.941 [2024-11-26 15:50:31.328543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.941 [2024-11-26 15:50:31.328578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.941 [2024-11-26 15:50:31.328609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.941 [2024-11-26 15:50:31.335426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.941 [2024-11-26 15:50:31.335461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.941 [2024-11-26 15:50:31.335490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.941 [2024-11-26 15:50:31.342373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.941 [2024-11-26 15:50:31.342408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.941 [2024-11-26 15:50:31.342439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.941 [2024-11-26 15:50:31.349296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.942 [2024-11-26 15:50:31.349337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.942 [2024-11-26 15:50:31.349367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.942 [2024-11-26 15:50:31.356269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.942 [2024-11-26 15:50:31.356303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.942 [2024-11-26 15:50:31.356333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.942 [2024-11-26 15:50:31.363145] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.942 [2024-11-26 15:50:31.363179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.942 [2024-11-26 15:50:31.363209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.942 [2024-11-26 15:50:31.370092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:39.942 [2024-11-26 15:50:31.370128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.942 [2024-11-26 15:50:31.370158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.376954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.210 [2024-11-26 15:50:31.377001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.210 [2024-11-26 15:50:31.377027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.383747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.210 [2024-11-26 15:50:31.383778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.210 [2024-11-26 15:50:31.383804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.390465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.210 [2024-11-26 15:50:31.390503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.210 [2024-11-26 15:50:31.390533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.397438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.210 [2024-11-26 15:50:31.397474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.210 [2024-11-26 15:50:31.397505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.404406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.210 [2024-11-26 15:50:31.404453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.210 [2024-11-26 15:50:31.404484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.411293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.210 [2024-11-26 15:50:31.411327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.210 [2024-11-26 15:50:31.411357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.417888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.210 [2024-11-26 15:50:31.417920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.210 [2024-11-26 15:50:31.417947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.424384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.210 [2024-11-26 15:50:31.424414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.210 [2024-11-26 15:50:31.424441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.430941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.210 [2024-11-26 15:50:31.430988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.210 [2024-11-26 15:50:31.431039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.437419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.210 [2024-11-26 15:50:31.437464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.210 [2024-11-26 15:50:31.437489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.444088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.210 [2024-11-26 15:50:31.444135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.210 [2024-11-26 15:50:31.444161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.450762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.210 [2024-11-26 15:50:31.450794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.210 [2024-11-26 15:50:31.450834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.457356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.210 [2024-11-26 15:50:31.457388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.210 [2024-11-26 15:50:31.457415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.464214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.210 [2024-11-26 15:50:31.464249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.210 [2024-11-26 15:50:31.464290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.210 [2024-11-26 15:50:31.470953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.471016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.471058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.477899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.477931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.477957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.484514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.484550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.484581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.491458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.491495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.491525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.498169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.498204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.498233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.504992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.505040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.505070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.511940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.512005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.512048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.519045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.519081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.519111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.526012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.526071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.526104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.532893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.532925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.532952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.540335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.540370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.540400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.547400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.547435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.547466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.554418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.554454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.554484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.561498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.561533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.561573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.568902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.568933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.568959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.575892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.575923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.575949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.583062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.583098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.583128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.590162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.590198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.590229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.597238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.597273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.597304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.604297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.604332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.604362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.611386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.611421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.611451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.618513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.618548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.618578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.625595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.625630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.625659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.632547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.632582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.632612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.639537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.639572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.639602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.211 [2024-11-26 15:50:31.646550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18e6bb0) 00:26:40.211 [2024-11-26 15:50:31.646592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.211 [2024-11-26 15:50:31.646622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.211 00:26:40.211 Latency(us) 00:26:40.211 [2024-11-26T14:50:31.664Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:40.211 [2024-11-26T14:50:31.664Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:40.212 nvme0n1 : 2.00 4202.26 525.28 0.00 0.00 3802.80 825.27 10388.67 00:26:40.212 [2024-11-26T14:50:31.665Z] =================================================================================================================== 00:26:40.212 [2024-11-26T14:50:31.665Z] Total : 4202.26 525.28 0.00 0.00 3802.80 825.27 10388.67 00:26:40.212 0 00:26:40.471 15:50:31 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:40.471 15:50:31 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:40.471 15:50:31 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:40.471 | .driver_specific 00:26:40.471 | .nvme_error 00:26:40.471 | .status_code 00:26:40.471 | .command_transient_transport_error' 00:26:40.471 15:50:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:40.471 15:50:31 -- host/digest.sh@71 -- # (( 271 > 0 )) 00:26:40.471 15:50:31 -- host/digest.sh@73 -- # killprocess 977812 00:26:40.471 15:50:31 -- common/autotest_common.sh@936 -- # '[' -z 977812 ']' 00:26:40.471 15:50:31 -- common/autotest_common.sh@940 -- # kill -0 977812 00:26:40.471 15:50:31 -- common/autotest_common.sh@941 -- # uname 00:26:40.732 15:50:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:40.732 15:50:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 977812 00:26:40.732 15:50:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:40.732 15:50:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:40.732 15:50:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 977812' 00:26:40.732 killing process with pid 977812 00:26:40.732 15:50:31 -- common/autotest_common.sh@955 -- # kill 977812 00:26:40.732 Received shutdown signal, test time was about 2.000000 seconds 00:26:40.732 00:26:40.732 Latency(us) 00:26:40.732 [2024-11-26T14:50:32.185Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:40.732 [2024-11-26T14:50:32.185Z] =================================================================================================================== 00:26:40.732 [2024-11-26T14:50:32.185Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:40.732 15:50:31 -- common/autotest_common.sh@960 -- # wait 977812 00:26:40.991 15:50:32 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:26:40.991 15:50:32 -- host/digest.sh@54 -- # local rw bs qd 00:26:40.991 15:50:32 -- host/digest.sh@56 -- # rw=randwrite 00:26:40.991 15:50:32 -- host/digest.sh@56 -- # bs=4096 00:26:40.991 15:50:32 -- host/digest.sh@56 -- # qd=128 00:26:40.991 15:50:32 -- host/digest.sh@58 -- # bperfpid=978334 00:26:40.991 15:50:32 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:26:40.991 15:50:32 -- host/digest.sh@60 -- # waitforlisten 978334 /var/tmp/bperf.sock 00:26:40.991 15:50:32 -- common/autotest_common.sh@829 -- # '[' -z 978334 ']' 00:26:40.991 15:50:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:40.991 15:50:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:40.991 15:50:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:40.991 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:40.991 15:50:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:40.991 15:50:32 -- common/autotest_common.sh@10 -- # set +x 00:26:40.991 [2024-11-26 15:50:32.273473] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:40.991 [2024-11-26 15:50:32.273543] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid978334 ] 00:26:40.991 EAL: No free 2048 kB hugepages reported on node 1 00:26:40.991 [2024-11-26 15:50:32.334201] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:41.249 [2024-11-26 15:50:32.444769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:41.815 15:50:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:41.815 15:50:33 -- common/autotest_common.sh@862 -- # return 0 00:26:41.815 15:50:33 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:41.815 15:50:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:42.073 15:50:33 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:42.073 15:50:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:42.073 15:50:33 -- common/autotest_common.sh@10 -- # set +x 00:26:42.073 15:50:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:42.073 15:50:33 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:42.073 15:50:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:42.641 nvme0n1 00:26:42.641 15:50:33 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:42.641 15:50:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:42.641 15:50:33 -- common/autotest_common.sh@10 -- # set +x 00:26:42.641 15:50:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:42.641 15:50:33 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:42.641 15:50:33 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:42.641 Running I/O for 2 seconds... 00:26:42.641 [2024-11-26 15:50:33.947763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.641 [2024-11-26 15:50:33.948271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:23424 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.641 [2024-11-26 15:50:33.948317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.641 [2024-11-26 15:50:33.960890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.641 [2024-11-26 15:50:33.961166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7964 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.641 [2024-11-26 15:50:33.961202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.641 [2024-11-26 15:50:33.974069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.641 [2024-11-26 15:50:33.974385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6086 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.641 [2024-11-26 15:50:33.974420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.641 [2024-11-26 15:50:33.987146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.641 [2024-11-26 15:50:33.987497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:21044 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.641 [2024-11-26 15:50:33.987532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.641 [2024-11-26 15:50:34.000265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.641 [2024-11-26 15:50:34.000542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:23831 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.641 [2024-11-26 15:50:34.000589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.641 [2024-11-26 15:50:34.013438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.641 [2024-11-26 15:50:34.013737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:9209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.641 [2024-11-26 15:50:34.013766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.641 [2024-11-26 15:50:34.026444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.642 [2024-11-26 15:50:34.026731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:18868 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.642 [2024-11-26 15:50:34.026775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.642 [2024-11-26 15:50:34.039442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.642 [2024-11-26 15:50:34.039724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:461 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.642 [2024-11-26 15:50:34.039769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.642 [2024-11-26 15:50:34.052416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.642 [2024-11-26 15:50:34.052704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:16160 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.642 [2024-11-26 15:50:34.052739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.642 [2024-11-26 15:50:34.065459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.642 [2024-11-26 15:50:34.065752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:24882 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.642 [2024-11-26 15:50:34.065781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.642 [2024-11-26 15:50:34.078468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.642 [2024-11-26 15:50:34.078792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:12435 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.642 [2024-11-26 15:50:34.078821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.902 [2024-11-26 15:50:34.091929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.092200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:13744 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.092235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.105029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.105340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:17511 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.105374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.118377] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.118712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13775 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.118757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.131341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.131645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19593 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.131680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.144462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.144755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:3838 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.144784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.157460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.157787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:6633 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.157817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.170540] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.170824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:15497 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.170854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.183433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.183727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:4841 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.183757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.196350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.196634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:6534 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.196668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.209271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.209608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:9424 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.209638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.221483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.221777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:20935 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.221807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.234650] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.235043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:11318 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.235078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.247487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.247785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:3528 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.247814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.260452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.260782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:15479 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.260811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.273421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.273701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3488 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.273735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.286496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.286780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6691 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.286809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.299439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.299718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:22259 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.299753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.312444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.312727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:5228 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.312774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.325409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.325699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:18908 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.325746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:42.903 [2024-11-26 15:50:34.338438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:42.903 [2024-11-26 15:50:34.338717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:8597 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.903 [2024-11-26 15:50:34.338770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.162 [2024-11-26 15:50:34.351508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.162 [2024-11-26 15:50:34.351804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:16614 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.162 [2024-11-26 15:50:34.351834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.162 [2024-11-26 15:50:34.364607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.162 [2024-11-26 15:50:34.364874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:11880 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.364903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.377506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.377789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:13298 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.377819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.390569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.390859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:24734 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.390889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.403416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.403746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:1585 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.403776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.416550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.416855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:20568 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.416884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.429448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.429740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4874 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.429769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.442324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.442602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4227 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.442636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.455289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.455599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:6676 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.455634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.468469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.468812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:598 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.468858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.480794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.481095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:17916 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.481129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.493888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.494154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:4022 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.494189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.506913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.507179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:6781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.507213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.519812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.520083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:15534 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.520117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.532758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.533001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:24911 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.533044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.545742] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.545993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:3036 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.546028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.558811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.559065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:24078 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.559099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.571840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.572122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:5597 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.572156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.585000] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.585276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15673 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.585310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.163 [2024-11-26 15:50:34.597954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.163 [2024-11-26 15:50:34.598216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19399 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.163 [2024-11-26 15:50:34.598250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.423 [2024-11-26 15:50:34.611008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.423 [2024-11-26 15:50:34.611271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:3605 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.423 [2024-11-26 15:50:34.611306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.423 [2024-11-26 15:50:34.624074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.423 [2024-11-26 15:50:34.624336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:18574 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.423 [2024-11-26 15:50:34.624371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.423 [2024-11-26 15:50:34.637237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.423 [2024-11-26 15:50:34.637547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:931 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.423 [2024-11-26 15:50:34.637580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.423 [2024-11-26 15:50:34.650234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.423 [2024-11-26 15:50:34.650504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:24955 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.423 [2024-11-26 15:50:34.650538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.423 [2024-11-26 15:50:34.663261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.423 [2024-11-26 15:50:34.663568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:22672 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.423 [2024-11-26 15:50:34.663603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.423 [2024-11-26 15:50:34.676238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.423 [2024-11-26 15:50:34.676507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:15771 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.423 [2024-11-26 15:50:34.676548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.423 [2024-11-26 15:50:34.689124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.423 [2024-11-26 15:50:34.689432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:17957 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.423 [2024-11-26 15:50:34.689466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.423 [2024-11-26 15:50:34.702082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.423 [2024-11-26 15:50:34.702351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:6188 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.423 [2024-11-26 15:50:34.702386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.423 [2024-11-26 15:50:34.715058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.424 [2024-11-26 15:50:34.715361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:18993 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.424 [2024-11-26 15:50:34.715395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.424 [2024-11-26 15:50:34.728037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.424 [2024-11-26 15:50:34.728321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:10768 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.424 [2024-11-26 15:50:34.728351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.424 [2024-11-26 15:50:34.741014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.424 [2024-11-26 15:50:34.741325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8197 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.424 [2024-11-26 15:50:34.741359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.424 [2024-11-26 15:50:34.753913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.424 [2024-11-26 15:50:34.754196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8765 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.424 [2024-11-26 15:50:34.754231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.424 [2024-11-26 15:50:34.766925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.424 [2024-11-26 15:50:34.767212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:6231 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.424 [2024-11-26 15:50:34.767247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.424 [2024-11-26 15:50:34.779931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.424 [2024-11-26 15:50:34.780212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:1322 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.424 [2024-11-26 15:50:34.780247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.424 [2024-11-26 15:50:34.793389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.424 [2024-11-26 15:50:34.793663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:13372 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.424 [2024-11-26 15:50:34.793735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.424 [2024-11-26 15:50:34.806849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.424 [2024-11-26 15:50:34.807117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:16194 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.424 [2024-11-26 15:50:34.807151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.424 [2024-11-26 15:50:34.820136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.424 [2024-11-26 15:50:34.820412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:22288 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.424 [2024-11-26 15:50:34.820446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.424 [2024-11-26 15:50:34.833410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.424 [2024-11-26 15:50:34.833682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:16978 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.424 [2024-11-26 15:50:34.833725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.424 [2024-11-26 15:50:34.846670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.424 [2024-11-26 15:50:34.846935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:17264 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.424 [2024-11-26 15:50:34.846963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.424 [2024-11-26 15:50:34.859667] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.424 [2024-11-26 15:50:34.859945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:6654 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.424 [2024-11-26 15:50:34.860000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:34.873062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:34.873330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:24349 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.683 [2024-11-26 15:50:34.873365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:34.886324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:34.886593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:10023 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.683 [2024-11-26 15:50:34.886627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:34.899483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:34.899772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11769 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.683 [2024-11-26 15:50:34.899802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:34.912476] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:34.912761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:612 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.683 [2024-11-26 15:50:34.912791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:34.925436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:34.925716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:18414 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.683 [2024-11-26 15:50:34.925760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:34.938379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:34.938649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:16752 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.683 [2024-11-26 15:50:34.938684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:34.951299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:34.951621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:5601 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.683 [2024-11-26 15:50:34.951662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:34.964351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:34.964620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:20377 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.683 [2024-11-26 15:50:34.964655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:34.977307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:34.977575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:16800 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.683 [2024-11-26 15:50:34.977609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:34.990324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:34.990608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:301 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.683 [2024-11-26 15:50:34.990638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:35.003441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:35.003734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:219 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.683 [2024-11-26 15:50:35.003764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:35.016422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:35.016701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:2543 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.683 [2024-11-26 15:50:35.016753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:35.029405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:35.029703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:773 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.683 [2024-11-26 15:50:35.029749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:35.042399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:35.042667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:9863 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.683 [2024-11-26 15:50:35.042712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.683 [2024-11-26 15:50:35.055426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.683 [2024-11-26 15:50:35.055706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14930 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.684 [2024-11-26 15:50:35.055739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.684 [2024-11-26 15:50:35.068430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.684 [2024-11-26 15:50:35.068706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3308 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.684 [2024-11-26 15:50:35.068750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.684 [2024-11-26 15:50:35.081414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.684 [2024-11-26 15:50:35.081682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:20380 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.684 [2024-11-26 15:50:35.081738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.684 [2024-11-26 15:50:35.094456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.684 [2024-11-26 15:50:35.094751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:12249 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.684 [2024-11-26 15:50:35.094781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.684 [2024-11-26 15:50:35.107576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.684 [2024-11-26 15:50:35.107851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:1371 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.684 [2024-11-26 15:50:35.107881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.684 [2024-11-26 15:50:35.120579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.684 [2024-11-26 15:50:35.120850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:9535 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.684 [2024-11-26 15:50:35.120880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.133539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.133823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:1427 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.133868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.146677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.146937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:10160 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.146982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.159749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.159991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:23232 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.160026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.172755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.173111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:10960 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.173144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.185745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.185992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:9163 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.186027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.198700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.198992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:3783 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.199020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.211640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.211909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:759 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.211938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.224607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.224869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:689 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.224897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.237527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.237809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:7123 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.237838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.250461] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.250769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:1545 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.250799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.263776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.264031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:10280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.264070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.276808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.277116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:21796 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.277151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.289762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.290030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:3050 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.290064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.302789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.303041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:9362 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.303076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.315763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.316012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:7210 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.316045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.328825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.329084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:1950 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.329118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.341855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.342125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:4353 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.342159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.944 [2024-11-26 15:50:35.354808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.944 [2024-11-26 15:50:35.355064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:14766 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.944 [2024-11-26 15:50:35.355104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.945 [2024-11-26 15:50:35.367834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.945 [2024-11-26 15:50:35.368090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9861 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.945 [2024-11-26 15:50:35.368124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:43.945 [2024-11-26 15:50:35.380683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:43.945 [2024-11-26 15:50:35.380940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18114 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.945 [2024-11-26 15:50:35.380985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.205 [2024-11-26 15:50:35.393712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.205 [2024-11-26 15:50:35.394019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:21686 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.205 [2024-11-26 15:50:35.394054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.205 [2024-11-26 15:50:35.406763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.205 [2024-11-26 15:50:35.407012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:18136 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.205 [2024-11-26 15:50:35.407047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.205 [2024-11-26 15:50:35.419799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.205 [2024-11-26 15:50:35.420045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:14960 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.205 [2024-11-26 15:50:35.420079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.205 [2024-11-26 15:50:35.432808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.205 [2024-11-26 15:50:35.433060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:2147 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.205 [2024-11-26 15:50:35.433094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.205 [2024-11-26 15:50:35.445753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.205 [2024-11-26 15:50:35.445982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:8025 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.205 [2024-11-26 15:50:35.446024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.205 [2024-11-26 15:50:35.458705] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.205 [2024-11-26 15:50:35.458951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:1467 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.205 [2024-11-26 15:50:35.458995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.205 [2024-11-26 15:50:35.471770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.205 [2024-11-26 15:50:35.472005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:21715 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.206 [2024-11-26 15:50:35.472041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.206 [2024-11-26 15:50:35.484737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.206 [2024-11-26 15:50:35.484967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:4486 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.206 [2024-11-26 15:50:35.484995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.206 [2024-11-26 15:50:35.497640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.206 [2024-11-26 15:50:35.497982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:14827 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.206 [2024-11-26 15:50:35.498010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.206 [2024-11-26 15:50:35.510529] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.206 [2024-11-26 15:50:35.510844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:18995 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.206 [2024-11-26 15:50:35.510874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.206 [2024-11-26 15:50:35.523914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.206 [2024-11-26 15:50:35.524176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8774 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.206 [2024-11-26 15:50:35.524211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.206 [2024-11-26 15:50:35.536967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.206 [2024-11-26 15:50:35.537238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22622 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.206 [2024-11-26 15:50:35.537272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.206 [2024-11-26 15:50:35.550047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.206 [2024-11-26 15:50:35.550308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:22552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.206 [2024-11-26 15:50:35.550342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.206 [2024-11-26 15:50:35.563017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.206 [2024-11-26 15:50:35.563284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:13387 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.206 [2024-11-26 15:50:35.563318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.206 [2024-11-26 15:50:35.575997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.206 [2024-11-26 15:50:35.576264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:12559 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.206 [2024-11-26 15:50:35.576297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.206 [2024-11-26 15:50:35.588988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.206 [2024-11-26 15:50:35.589253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:17998 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.206 [2024-11-26 15:50:35.589287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.206 [2024-11-26 15:50:35.601966] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.206 [2024-11-26 15:50:35.602229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:8770 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.206 [2024-11-26 15:50:35.602263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.206 [2024-11-26 15:50:35.615027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.206 [2024-11-26 15:50:35.615336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:9791 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.206 [2024-11-26 15:50:35.615369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.206 [2024-11-26 15:50:35.628004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.206 [2024-11-26 15:50:35.628265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:10022 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.206 [2024-11-26 15:50:35.628299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.206 [2024-11-26 15:50:35.640961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.206 [2024-11-26 15:50:35.641232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:24042 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.206 [2024-11-26 15:50:35.641266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.465 [2024-11-26 15:50:35.654022] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.465 [2024-11-26 15:50:35.654292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:25465 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.465 [2024-11-26 15:50:35.654326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.465 [2024-11-26 15:50:35.667061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.465 [2024-11-26 15:50:35.667365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:20091 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.465 [2024-11-26 15:50:35.667399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.465 [2024-11-26 15:50:35.680065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.465 [2024-11-26 15:50:35.680322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10291 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.465 [2024-11-26 15:50:35.680356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.465 [2024-11-26 15:50:35.693090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.465 [2024-11-26 15:50:35.693360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13556 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.465 [2024-11-26 15:50:35.693393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.465 [2024-11-26 15:50:35.706038] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.465 [2024-11-26 15:50:35.706296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:18298 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.706330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.718987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.719248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:4506 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.719283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.731875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.732143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:3982 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.732178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.744836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.745089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:6753 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.745124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.757762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.758015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:9400 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.758049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.770663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.770936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:19558 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.770966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.783703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.783950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:13885 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.783979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.796750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.796997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:21589 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.797025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.809777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.810046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:20047 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.810091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.822808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.823064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:5597 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.823098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.835752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.836023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7416 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.836051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.848652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.848915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16930 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.848943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.861681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.861939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:1552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.861982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.874843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.875110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:15657 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.875144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.888048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.888307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:25128 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.888341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.466 [2024-11-26 15:50:35.901088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.466 [2024-11-26 15:50:35.901359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:19020 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.466 [2024-11-26 15:50:35.901393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.725 [2024-11-26 15:50:35.914282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.725 [2024-11-26 15:50:35.914550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:2684 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.725 [2024-11-26 15:50:35.914585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.725 [2024-11-26 15:50:35.927266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8ad0) with pdu=0x2000190fda78 00:26:44.725 [2024-11-26 15:50:35.927543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:1959 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.725 [2024-11-26 15:50:35.927577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.725 00:26:44.725 Latency(us) 00:26:44.725 [2024-11-26T14:50:36.178Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:44.725 [2024-11-26T14:50:36.178Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:44.725 nvme0n1 : 2.01 19556.46 76.39 0.00 0.00 6531.11 5825.42 14660.65 00:26:44.725 [2024-11-26T14:50:36.178Z] =================================================================================================================== 00:26:44.725 [2024-11-26T14:50:36.178Z] Total : 19556.46 76.39 0.00 0.00 6531.11 5825.42 14660.65 00:26:44.725 0 00:26:44.725 15:50:35 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:44.725 15:50:35 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:44.725 15:50:35 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:44.725 | .driver_specific 00:26:44.725 | .nvme_error 00:26:44.725 | .status_code 00:26:44.725 | .command_transient_transport_error' 00:26:44.725 15:50:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:44.985 15:50:36 -- host/digest.sh@71 -- # (( 153 > 0 )) 00:26:44.985 15:50:36 -- host/digest.sh@73 -- # killprocess 978334 00:26:44.985 15:50:36 -- common/autotest_common.sh@936 -- # '[' -z 978334 ']' 00:26:44.985 15:50:36 -- common/autotest_common.sh@940 -- # kill -0 978334 00:26:44.985 15:50:36 -- common/autotest_common.sh@941 -- # uname 00:26:44.985 15:50:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:44.985 15:50:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 978334 00:26:44.985 15:50:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:44.985 15:50:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:44.985 15:50:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 978334' 00:26:44.985 killing process with pid 978334 00:26:44.985 15:50:36 -- common/autotest_common.sh@955 -- # kill 978334 00:26:44.985 Received shutdown signal, test time was about 2.000000 seconds 00:26:44.985 00:26:44.985 Latency(us) 00:26:44.985 [2024-11-26T14:50:36.438Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:44.985 [2024-11-26T14:50:36.438Z] =================================================================================================================== 00:26:44.985 [2024-11-26T14:50:36.438Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:44.985 15:50:36 -- common/autotest_common.sh@960 -- # wait 978334 00:26:45.244 15:50:36 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:26:45.244 15:50:36 -- host/digest.sh@54 -- # local rw bs qd 00:26:45.244 15:50:36 -- host/digest.sh@56 -- # rw=randwrite 00:26:45.244 15:50:36 -- host/digest.sh@56 -- # bs=131072 00:26:45.244 15:50:36 -- host/digest.sh@56 -- # qd=16 00:26:45.244 15:50:36 -- host/digest.sh@58 -- # bperfpid=978862 00:26:45.244 15:50:36 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:26:45.244 15:50:36 -- host/digest.sh@60 -- # waitforlisten 978862 /var/tmp/bperf.sock 00:26:45.244 15:50:36 -- common/autotest_common.sh@829 -- # '[' -z 978862 ']' 00:26:45.244 15:50:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:45.244 15:50:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:45.244 15:50:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:45.244 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:45.244 15:50:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:45.244 15:50:36 -- common/autotest_common.sh@10 -- # set +x 00:26:45.244 [2024-11-26 15:50:36.579348] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:45.244 [2024-11-26 15:50:36.579424] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid978862 ] 00:26:45.244 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:45.244 Zero copy mechanism will not be used. 00:26:45.244 EAL: No free 2048 kB hugepages reported on node 1 00:26:45.244 [2024-11-26 15:50:36.636475] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:45.504 [2024-11-26 15:50:36.743211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:46.438 15:50:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:46.438 15:50:37 -- common/autotest_common.sh@862 -- # return 0 00:26:46.438 15:50:37 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:46.438 15:50:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:46.438 15:50:37 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:46.438 15:50:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:46.438 15:50:37 -- common/autotest_common.sh@10 -- # set +x 00:26:46.438 15:50:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:46.438 15:50:37 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:46.438 15:50:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:47.007 nvme0n1 00:26:47.007 15:50:38 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:26:47.007 15:50:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:47.007 15:50:38 -- common/autotest_common.sh@10 -- # set +x 00:26:47.007 15:50:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:47.007 15:50:38 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:47.007 15:50:38 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:47.007 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:47.007 Zero copy mechanism will not be used. 00:26:47.007 Running I/O for 2 seconds... 00:26:47.007 [2024-11-26 15:50:38.384647] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.007 [2024-11-26 15:50:38.385004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.007 [2024-11-26 15:50:38.385066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.007 [2024-11-26 15:50:38.391103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.007 [2024-11-26 15:50:38.391326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.007 [2024-11-26 15:50:38.391362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.007 [2024-11-26 15:50:38.396868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.007 [2024-11-26 15:50:38.396985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.007 [2024-11-26 15:50:38.397034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.007 [2024-11-26 15:50:38.402747] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.007 [2024-11-26 15:50:38.402920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.007 [2024-11-26 15:50:38.402951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.007 [2024-11-26 15:50:38.407858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.007 [2024-11-26 15:50:38.408076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.007 [2024-11-26 15:50:38.408111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.007 [2024-11-26 15:50:38.413121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.007 [2024-11-26 15:50:38.413295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.007 [2024-11-26 15:50:38.413329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.007 [2024-11-26 15:50:38.419014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.007 [2024-11-26 15:50:38.419151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.007 [2024-11-26 15:50:38.419184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.007 [2024-11-26 15:50:38.424914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.007 [2024-11-26 15:50:38.425209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.007 [2024-11-26 15:50:38.425243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.007 [2024-11-26 15:50:38.432433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.008 [2024-11-26 15:50:38.432720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.008 [2024-11-26 15:50:38.432768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.008 [2024-11-26 15:50:38.439268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.008 [2024-11-26 15:50:38.439552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.008 [2024-11-26 15:50:38.439586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.008 [2024-11-26 15:50:38.446850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.008 [2024-11-26 15:50:38.447087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.008 [2024-11-26 15:50:38.447120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.008 [2024-11-26 15:50:38.454640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.008 [2024-11-26 15:50:38.454902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.454933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.461828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.462072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.462112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.468180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.468349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.468382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.473449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.473639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.473673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.479858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.480029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.480063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.485352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.485648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.485681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.492449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.492723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.492770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.499790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.499940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.499971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.507297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.507538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.507570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.514142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.514284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.514316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.521528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.521793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.521824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.529076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.529316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.529349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.536869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.537073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.537105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.544522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.544754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.544783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.551466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.551594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.551627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.557543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.557755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.557786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.563167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.563352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.563383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.267 [2024-11-26 15:50:38.568148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.267 [2024-11-26 15:50:38.568327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.267 [2024-11-26 15:50:38.568359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.574068] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.574342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.574378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.580752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.580943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.580973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.588288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.588471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.588501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.595794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.596048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.596078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.602731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.602982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.603013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.609886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.610063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.610094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.617351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.617518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.617549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.624741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.624893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.624924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.632150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.632405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.632436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.639897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.640152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.640184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.647768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.647960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.648007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.655474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.655820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.655850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.663125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.663339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.663370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.670806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.670981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.671027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.678378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.678636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.678669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.685905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.686107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.686139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.693366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.693622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.693655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.700668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.700827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.700858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.268 [2024-11-26 15:50:38.707604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.268 [2024-11-26 15:50:38.707833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.268 [2024-11-26 15:50:38.707864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.527 [2024-11-26 15:50:38.715422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.527 [2024-11-26 15:50:38.715616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.527 [2024-11-26 15:50:38.715649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.527 [2024-11-26 15:50:38.722513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.527 [2024-11-26 15:50:38.722706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.527 [2024-11-26 15:50:38.722741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.527 [2024-11-26 15:50:38.728192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.527 [2024-11-26 15:50:38.728361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.527 [2024-11-26 15:50:38.728394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.527 [2024-11-26 15:50:38.733253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.527 [2024-11-26 15:50:38.733441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.527 [2024-11-26 15:50:38.733473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.527 [2024-11-26 15:50:38.738088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.527 [2024-11-26 15:50:38.738240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.527 [2024-11-26 15:50:38.738272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.527 [2024-11-26 15:50:38.743308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.527 [2024-11-26 15:50:38.743513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.527 [2024-11-26 15:50:38.743545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.527 [2024-11-26 15:50:38.748584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.527 [2024-11-26 15:50:38.748696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.748731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.753809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.753957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.753994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.758593] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.758784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.758815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.763170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.763334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.763365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.768230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.768432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.768463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.772967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.773173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.773202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.777533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.777691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.777721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.782168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.782375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.782405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.786864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.787000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.787031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.791371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.791536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.791566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.796010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.796269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.796300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.800857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.801020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.801051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.805378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.805572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.805603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.809922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.810113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.810144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.814497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.814647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.814677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.819076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.819288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.819318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.823893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.824071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.824101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.828398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.828557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.828587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.833191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.833379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.833410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.838424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.838638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.838668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.845266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.845525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.845569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.852480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.852643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.852673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.859617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.859774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.859804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.867172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.867359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.867404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.874280] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.874501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.528 [2024-11-26 15:50:38.874531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.528 [2024-11-26 15:50:38.881729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.528 [2024-11-26 15:50:38.881935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.529 [2024-11-26 15:50:38.881966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.529 [2024-11-26 15:50:38.889007] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.529 [2024-11-26 15:50:38.889189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.529 [2024-11-26 15:50:38.889219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.529 [2024-11-26 15:50:38.896554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.529 [2024-11-26 15:50:38.896789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.529 [2024-11-26 15:50:38.896826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.529 [2024-11-26 15:50:38.903849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.529 [2024-11-26 15:50:38.904047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.529 [2024-11-26 15:50:38.904077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.529 [2024-11-26 15:50:38.911296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.529 [2024-11-26 15:50:38.911473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.529 [2024-11-26 15:50:38.911503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.529 [2024-11-26 15:50:38.918813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.529 [2024-11-26 15:50:38.919009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.529 [2024-11-26 15:50:38.919039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.529 [2024-11-26 15:50:38.926291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.529 [2024-11-26 15:50:38.926490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.529 [2024-11-26 15:50:38.926519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.529 [2024-11-26 15:50:38.932903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.529 [2024-11-26 15:50:38.933137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.529 [2024-11-26 15:50:38.933167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.529 [2024-11-26 15:50:38.940139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.529 [2024-11-26 15:50:38.940392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.529 [2024-11-26 15:50:38.940422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.529 [2024-11-26 15:50:38.947408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.529 [2024-11-26 15:50:38.947607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.529 [2024-11-26 15:50:38.947637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.529 [2024-11-26 15:50:38.954877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.529 [2024-11-26 15:50:38.955114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.529 [2024-11-26 15:50:38.955146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.529 [2024-11-26 15:50:38.962667] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.529 [2024-11-26 15:50:38.962832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.529 [2024-11-26 15:50:38.962862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.529 [2024-11-26 15:50:38.969977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.529 [2024-11-26 15:50:38.970209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.529 [2024-11-26 15:50:38.970240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:38.976572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:38.976790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:38.976820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:38.982184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:38.982369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:38.982401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:38.986987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:38.987159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:38.987191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:38.991823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:38.992007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:38.992036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:38.996467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:38.996653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:38.996684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.001225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.001442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.001473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.005754] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.005918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.005954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.010386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.010519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.010550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.015239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.015397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.015426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.020111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.020302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.020332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.024879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.025027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.025058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.029394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.029566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.029596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.033912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.034122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.034152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.038500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.038696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.038726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.043066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.043233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.043263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.047695] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.047805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.047840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.052516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.052677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.052715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.058379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.058615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.058645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.065061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.065244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.065275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.071372] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.071576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.071606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.078703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.078961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.078991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.085976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.086220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.790 [2024-11-26 15:50:39.086251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.790 [2024-11-26 15:50:39.093445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.790 [2024-11-26 15:50:39.093674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.093712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.100826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.101041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.101071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.108162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.108351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.108381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.114152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.114319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.114350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.119824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.120045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.120076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.125475] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.125642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.125671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.131171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.131350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.131380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.136944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.137113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.137144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.143517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.143764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.143794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.150785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.150967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.150998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.157450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.157578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.157614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.164641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.164865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.164896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.172142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.172386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.172417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.179394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.179621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.179651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.186832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.187017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.187062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.194360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.194587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.194616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.201704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.201866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.201896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.208959] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.209150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.209180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.216346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.216495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.216525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.223833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.224077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.224108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.791 [2024-11-26 15:50:39.231115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:47.791 [2024-11-26 15:50:39.231301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.791 [2024-11-26 15:50:39.231331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.051 [2024-11-26 15:50:39.238236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.238472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.238502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.245731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.245913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.245944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.253107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.253278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.253310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.260702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.260888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.260917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.268251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.268514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.268545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.275912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.276088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.276119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.283483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.283633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.283664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.291072] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.291279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.291311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.298446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.298627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.298660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.305939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.306242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.306275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.312793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.313048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.313080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.318481] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.318664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.318704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.323772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.324028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.324060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.329596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.329724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.329755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.334038] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.334246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.334277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.338744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.338990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.339031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.343467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.343621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.343652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.348203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.348406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.348437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.352764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.352939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.352969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.357475] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.357648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.357679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.362596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.362767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.362798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.367375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.367513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.367543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.373130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.373291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.373321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.377956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.378186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.378217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.382714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.382835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.382866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.387334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.387581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.387616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.391937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.392155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.392186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.396504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.396732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.052 [2024-11-26 15:50:39.396776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.052 [2024-11-26 15:50:39.402204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.052 [2024-11-26 15:50:39.402408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.402439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.407268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.407464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.407495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.411936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.412120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.412165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.416650] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.416839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.416871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.421321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.421534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.421565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.426069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.426262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.426292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.430695] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.430873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.430903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.435147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.435294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.435325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.439929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.440108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.440154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.444403] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.444544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.444588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.448998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.449161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.449192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.453649] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.453842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.453874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.458745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.458911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.458941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.463646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.463872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.463908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.469079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.469262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.469307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.474042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.474179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.474210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.478795] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.478983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.479014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.483433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.483563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.483594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.487909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.488037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.488065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.492566] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.492747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.492774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.053 [2024-11-26 15:50:39.497209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.053 [2024-11-26 15:50:39.497357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.053 [2024-11-26 15:50:39.497385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.501994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.502198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.502225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.506552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.506711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.506739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.511232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.511373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.511400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.515881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.516056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.516097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.520549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.520677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.520712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.525077] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.525220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.525247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.529712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.529915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.529942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.534395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.534536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.534563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.539114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.539299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.539327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.543714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.543851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.543883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.548118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.548251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.548278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.552757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.552910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.552937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.557368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.557517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.557543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.562644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.562753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.562781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.567298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.567433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.567460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.572915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.573035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.573061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.577498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.577651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.577676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.582435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.582553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.582579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.586848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.586980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.587021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.591644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.591810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.591839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.596378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.596522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.596550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.601035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.601199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.601228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.605549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.605765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.605794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.610955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.611044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.611071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.615974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.314 [2024-11-26 15:50:39.616126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.314 [2024-11-26 15:50:39.616155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.314 [2024-11-26 15:50:39.621480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.621633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.621662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.626010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.626171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.626199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.630703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.630873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.630901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.635432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.635579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.635606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.640573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.640758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.640786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.645758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.645932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.645959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.651064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.651264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.651292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.655822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.655978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.656005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.660457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.660651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.660680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.664980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.665154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.665183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.669567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.669751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.669785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.674208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.674340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.674369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.678961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.679083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.679126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.683549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.683729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.683758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.688024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.688195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.688224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.692660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.692824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.692853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.697125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.697281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.697310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.701745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.701881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.701909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.706234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.706436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.706462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.710909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.711028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.711055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.715520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.715642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.715668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.720331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.720515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.720542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.725295] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.725434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.725469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.730032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.730235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.730262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.734580] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.734766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.734794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.739158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.739308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.739335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.743989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.315 [2024-11-26 15:50:39.744150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.315 [2024-11-26 15:50:39.744179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.315 [2024-11-26 15:50:39.748859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.316 [2024-11-26 15:50:39.749015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.316 [2024-11-26 15:50:39.749042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.316 [2024-11-26 15:50:39.753490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.316 [2024-11-26 15:50:39.753626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.316 [2024-11-26 15:50:39.753654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.316 [2024-11-26 15:50:39.758161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.316 [2024-11-26 15:50:39.758338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.316 [2024-11-26 15:50:39.758366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.575 [2024-11-26 15:50:39.763270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.575 [2024-11-26 15:50:39.763447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.575 [2024-11-26 15:50:39.763475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.575 [2024-11-26 15:50:39.768353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.575 [2024-11-26 15:50:39.768575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.575 [2024-11-26 15:50:39.768603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.575 [2024-11-26 15:50:39.773661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.575 [2024-11-26 15:50:39.773841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.575 [2024-11-26 15:50:39.773870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.575 [2024-11-26 15:50:39.778763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.575 [2024-11-26 15:50:39.778925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.575 [2024-11-26 15:50:39.778965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.575 [2024-11-26 15:50:39.783590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.575 [2024-11-26 15:50:39.783784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.783813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.788350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.788531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.788557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.793152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.793288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.793321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.797791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.797953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.797980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.802953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.803076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.803103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.807607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.807786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.807814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.812345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.812500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.812528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.817135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.817265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.817291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.822833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.822989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.823017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.828084] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.828244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.828271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.835178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.835357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.835384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.841622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.841816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.841844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.849095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.849279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.849305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.856560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.856832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.856862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.863727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.863857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.863884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.871181] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.871358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.871385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.878625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.878859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.878889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.885896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.886035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.886061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.893675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.893856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.893883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.901157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.901305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.901337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.908632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.908801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.908829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.916571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.916818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.916846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.923833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.923985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.924025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.931330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.931454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.931481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.937090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.937288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.937316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.942120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.942300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.942343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.947116] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.947302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.576 [2024-11-26 15:50:39.947329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.576 [2024-11-26 15:50:39.951794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.576 [2024-11-26 15:50:39.951921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:39.951948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.577 [2024-11-26 15:50:39.956188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.577 [2024-11-26 15:50:39.956420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:39.956449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.577 [2024-11-26 15:50:39.961498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.577 [2024-11-26 15:50:39.961694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:39.961722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.577 [2024-11-26 15:50:39.967386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.577 [2024-11-26 15:50:39.967507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:39.967532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.577 [2024-11-26 15:50:39.972175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.577 [2024-11-26 15:50:39.972306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:39.972332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.577 [2024-11-26 15:50:39.976708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.577 [2024-11-26 15:50:39.976883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:39.976910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.577 [2024-11-26 15:50:39.981238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.577 [2024-11-26 15:50:39.981405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:39.981432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.577 [2024-11-26 15:50:39.985803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.577 [2024-11-26 15:50:39.986000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:39.986027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.577 [2024-11-26 15:50:39.990334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.577 [2024-11-26 15:50:39.990491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:39.990518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.577 [2024-11-26 15:50:39.994770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.577 [2024-11-26 15:50:39.994888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:39.994914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.577 [2024-11-26 15:50:39.999330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.577 [2024-11-26 15:50:39.999529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:39.999556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.577 [2024-11-26 15:50:40.004092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.577 [2024-11-26 15:50:40.004262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:40.004292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.577 [2024-11-26 15:50:40.008935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.577 [2024-11-26 15:50:40.009074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:40.009104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.577 [2024-11-26 15:50:40.013531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.577 [2024-11-26 15:50:40.013709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:40.013738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.577 [2024-11-26 15:50:40.018112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.577 [2024-11-26 15:50:40.018261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.577 [2024-11-26 15:50:40.018290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.022572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.022772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.022803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.027031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.027185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.027215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.031810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.031966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.031995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.038152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.038331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.038372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.045026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.045309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.045339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.051034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.051260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.051289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.058485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.058761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.058790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.064656] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.064790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.064818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.070322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.070449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.070484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.075271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.075457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.075501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.080050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.080215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.080243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.084632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.084762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.084791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.089466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.089655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.089697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.094147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.094305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.094333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.098750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.098969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.098998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.103567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.103702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.103729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.108319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.108447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.108475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.112993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.113173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.113202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.117577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.117761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.837 [2024-11-26 15:50:40.117790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.837 [2024-11-26 15:50:40.122266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.837 [2024-11-26 15:50:40.122400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.122428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.126832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.127009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.127037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.131638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.131807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.131836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.136213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.136433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.136461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.140794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.140930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.140969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.145432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.145605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.145636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.150227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.150364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.150391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.154999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.155144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.155172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.159601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.159720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.159747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.165023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.165204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.165232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.170200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.170384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.170418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.175429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.175712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.175741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.180889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.181039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.181076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.185653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.185889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.185918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.190299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.190473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.190502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.194826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.195010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.195038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.199354] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.199483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.199511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.204071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.204230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.204259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.208569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.208730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.208759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.213173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.213396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.213424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.217754] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.217904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.217932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.222396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.222551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.222580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.226988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.227142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.227170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.231929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.232078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.232107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.236416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.236545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.236573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.241044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.241221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.241249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.245523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.245724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.838 [2024-11-26 15:50:40.245754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.838 [2024-11-26 15:50:40.249924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.838 [2024-11-26 15:50:40.250108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.839 [2024-11-26 15:50:40.250137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.839 [2024-11-26 15:50:40.254620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.839 [2024-11-26 15:50:40.254827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.839 [2024-11-26 15:50:40.254856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.839 [2024-11-26 15:50:40.259358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.839 [2024-11-26 15:50:40.259482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.839 [2024-11-26 15:50:40.259509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.839 [2024-11-26 15:50:40.263858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.839 [2024-11-26 15:50:40.263989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.839 [2024-11-26 15:50:40.264017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.839 [2024-11-26 15:50:40.268922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.839 [2024-11-26 15:50:40.269052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.839 [2024-11-26 15:50:40.269080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.839 [2024-11-26 15:50:40.275268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.839 [2024-11-26 15:50:40.275460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.839 [2024-11-26 15:50:40.275487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.839 [2024-11-26 15:50:40.281282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:48.839 [2024-11-26 15:50:40.281496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.839 [2024-11-26 15:50:40.281525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.097 [2024-11-26 15:50:40.288156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:49.097 [2024-11-26 15:50:40.288369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.097 [2024-11-26 15:50:40.288413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.097 [2024-11-26 15:50:40.295562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:49.097 [2024-11-26 15:50:40.295851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.097 [2024-11-26 15:50:40.295881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.097 [2024-11-26 15:50:40.302462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:49.097 [2024-11-26 15:50:40.302735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.097 [2024-11-26 15:50:40.302770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.097 [2024-11-26 15:50:40.309802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:49.097 [2024-11-26 15:50:40.310043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.097 [2024-11-26 15:50:40.310071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.097 [2024-11-26 15:50:40.317015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:49.097 [2024-11-26 15:50:40.317211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.097 [2024-11-26 15:50:40.317239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.097 [2024-11-26 15:50:40.324107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:49.097 [2024-11-26 15:50:40.324302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.097 [2024-11-26 15:50:40.324342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.097 [2024-11-26 15:50:40.331394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:49.097 [2024-11-26 15:50:40.331598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.097 [2024-11-26 15:50:40.331626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.097 [2024-11-26 15:50:40.338733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:49.097 [2024-11-26 15:50:40.338938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.097 [2024-11-26 15:50:40.338967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.097 [2024-11-26 15:50:40.346140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:49.097 [2024-11-26 15:50:40.346386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.097 [2024-11-26 15:50:40.346420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.097 [2024-11-26 15:50:40.353805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:49.097 [2024-11-26 15:50:40.354178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.097 [2024-11-26 15:50:40.354217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.097 [2024-11-26 15:50:40.361090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:49.097 [2024-11-26 15:50:40.361283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.097 [2024-11-26 15:50:40.361311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.097 [2024-11-26 15:50:40.368365] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:49.097 [2024-11-26 15:50:40.368558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.097 [2024-11-26 15:50:40.368587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.097 [2024-11-26 15:50:40.375246] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x10d8fb0) with pdu=0x2000190fef90 00:26:49.097 [2024-11-26 15:50:40.375404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.097 [2024-11-26 15:50:40.375434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.097 00:26:49.097 Latency(us) 00:26:49.097 [2024-11-26T14:50:40.550Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:49.097 [2024-11-26T14:50:40.550Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:49.097 nvme0n1 : 2.00 5445.32 680.67 0.00 0.00 2930.30 1905.40 8058.50 00:26:49.098 [2024-11-26T14:50:40.551Z] =================================================================================================================== 00:26:49.098 [2024-11-26T14:50:40.551Z] Total : 5445.32 680.67 0.00 0.00 2930.30 1905.40 8058.50 00:26:49.098 0 00:26:49.098 15:50:40 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:49.098 15:50:40 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:49.098 15:50:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:49.098 15:50:40 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:49.098 | .driver_specific 00:26:49.098 | .nvme_error 00:26:49.098 | .status_code 00:26:49.098 | .command_transient_transport_error' 00:26:49.356 15:50:40 -- host/digest.sh@71 -- # (( 351 > 0 )) 00:26:49.356 15:50:40 -- host/digest.sh@73 -- # killprocess 978862 00:26:49.356 15:50:40 -- common/autotest_common.sh@936 -- # '[' -z 978862 ']' 00:26:49.356 15:50:40 -- common/autotest_common.sh@940 -- # kill -0 978862 00:26:49.356 15:50:40 -- common/autotest_common.sh@941 -- # uname 00:26:49.356 15:50:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:49.356 15:50:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 978862 00:26:49.356 15:50:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:49.356 15:50:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:49.356 15:50:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 978862' 00:26:49.356 killing process with pid 978862 00:26:49.356 15:50:40 -- common/autotest_common.sh@955 -- # kill 978862 00:26:49.356 Received shutdown signal, test time was about 2.000000 seconds 00:26:49.356 00:26:49.356 Latency(us) 00:26:49.356 [2024-11-26T14:50:40.809Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:49.356 [2024-11-26T14:50:40.809Z] =================================================================================================================== 00:26:49.356 [2024-11-26T14:50:40.809Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:49.356 15:50:40 -- common/autotest_common.sh@960 -- # wait 978862 00:26:49.615 15:50:40 -- host/digest.sh@115 -- # killprocess 977256 00:26:49.615 15:50:40 -- common/autotest_common.sh@936 -- # '[' -z 977256 ']' 00:26:49.615 15:50:40 -- common/autotest_common.sh@940 -- # kill -0 977256 00:26:49.615 15:50:40 -- common/autotest_common.sh@941 -- # uname 00:26:49.615 15:50:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:49.615 15:50:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 977256 00:26:49.616 15:50:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:49.616 15:50:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:49.616 15:50:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 977256' 00:26:49.616 killing process with pid 977256 00:26:49.616 15:50:41 -- common/autotest_common.sh@955 -- # kill 977256 00:26:49.616 15:50:41 -- common/autotest_common.sh@960 -- # wait 977256 00:26:49.876 00:26:49.876 real 0m18.301s 00:26:49.876 user 0m36.747s 00:26:49.876 sys 0m4.538s 00:26:49.876 15:50:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:49.876 15:50:41 -- common/autotest_common.sh@10 -- # set +x 00:26:49.876 ************************************ 00:26:49.876 END TEST nvmf_digest_error 00:26:49.876 ************************************ 00:26:50.137 15:50:41 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:26:50.137 15:50:41 -- host/digest.sh@139 -- # nvmftestfini 00:26:50.137 15:50:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:50.137 15:50:41 -- nvmf/common.sh@116 -- # sync 00:26:50.137 15:50:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:50.137 15:50:41 -- nvmf/common.sh@119 -- # set +e 00:26:50.137 15:50:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:50.137 15:50:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:50.137 rmmod nvme_tcp 00:26:50.137 rmmod nvme_fabrics 00:26:50.137 rmmod nvme_keyring 00:26:50.137 15:50:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:50.137 15:50:41 -- nvmf/common.sh@123 -- # set -e 00:26:50.137 15:50:41 -- nvmf/common.sh@124 -- # return 0 00:26:50.137 15:50:41 -- nvmf/common.sh@477 -- # '[' -n 977256 ']' 00:26:50.137 15:50:41 -- nvmf/common.sh@478 -- # killprocess 977256 00:26:50.137 15:50:41 -- common/autotest_common.sh@936 -- # '[' -z 977256 ']' 00:26:50.137 15:50:41 -- common/autotest_common.sh@940 -- # kill -0 977256 00:26:50.137 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (977256) - No such process 00:26:50.137 15:50:41 -- common/autotest_common.sh@963 -- # echo 'Process with pid 977256 is not found' 00:26:50.137 Process with pid 977256 is not found 00:26:50.137 15:50:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:50.137 15:50:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:50.137 15:50:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:50.137 15:50:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:50.138 15:50:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:50.138 15:50:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:50.138 15:50:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:50.138 15:50:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:52.042 15:50:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:52.042 00:26:52.042 real 0m38.475s 00:26:52.042 user 1m8.987s 00:26:52.042 sys 0m10.304s 00:26:52.042 15:50:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:52.042 15:50:43 -- common/autotest_common.sh@10 -- # set +x 00:26:52.042 ************************************ 00:26:52.042 END TEST nvmf_digest 00:26:52.042 ************************************ 00:26:52.042 15:50:43 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:26:52.042 15:50:43 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:26:52.042 15:50:43 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:26:52.042 15:50:43 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:26:52.042 15:50:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:52.042 15:50:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:52.042 15:50:43 -- common/autotest_common.sh@10 -- # set +x 00:26:52.042 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:26:52.042 ************************************ 00:26:52.042 START TEST nvmf_bdevperf 00:26:52.042 ************************************ 00:26:52.042 15:50:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:26:52.301 * Looking for test storage... 00:26:52.301 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:52.301 15:50:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:52.301 15:50:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:52.301 15:50:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:52.301 15:50:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:52.301 15:50:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:52.301 15:50:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:52.301 15:50:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:52.301 15:50:43 -- scripts/common.sh@335 -- # IFS=.-: 00:26:52.301 15:50:43 -- scripts/common.sh@335 -- # read -ra ver1 00:26:52.301 15:50:43 -- scripts/common.sh@336 -- # IFS=.-: 00:26:52.301 15:50:43 -- scripts/common.sh@336 -- # read -ra ver2 00:26:52.301 15:50:43 -- scripts/common.sh@337 -- # local 'op=<' 00:26:52.301 15:50:43 -- scripts/common.sh@339 -- # ver1_l=2 00:26:52.301 15:50:43 -- scripts/common.sh@340 -- # ver2_l=1 00:26:52.301 15:50:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:52.301 15:50:43 -- scripts/common.sh@343 -- # case "$op" in 00:26:52.301 15:50:43 -- scripts/common.sh@344 -- # : 1 00:26:52.301 15:50:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:52.301 15:50:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:52.301 15:50:43 -- scripts/common.sh@364 -- # decimal 1 00:26:52.301 15:50:43 -- scripts/common.sh@352 -- # local d=1 00:26:52.301 15:50:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:52.301 15:50:43 -- scripts/common.sh@354 -- # echo 1 00:26:52.301 15:50:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:52.301 15:50:43 -- scripts/common.sh@365 -- # decimal 2 00:26:52.301 15:50:43 -- scripts/common.sh@352 -- # local d=2 00:26:52.301 15:50:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:52.301 15:50:43 -- scripts/common.sh@354 -- # echo 2 00:26:52.301 15:50:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:52.301 15:50:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:52.301 15:50:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:52.301 15:50:43 -- scripts/common.sh@367 -- # return 0 00:26:52.301 15:50:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:52.301 15:50:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:52.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:52.301 --rc genhtml_branch_coverage=1 00:26:52.301 --rc genhtml_function_coverage=1 00:26:52.301 --rc genhtml_legend=1 00:26:52.301 --rc geninfo_all_blocks=1 00:26:52.301 --rc geninfo_unexecuted_blocks=1 00:26:52.301 00:26:52.301 ' 00:26:52.301 15:50:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:52.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:52.301 --rc genhtml_branch_coverage=1 00:26:52.301 --rc genhtml_function_coverage=1 00:26:52.301 --rc genhtml_legend=1 00:26:52.301 --rc geninfo_all_blocks=1 00:26:52.301 --rc geninfo_unexecuted_blocks=1 00:26:52.301 00:26:52.301 ' 00:26:52.301 15:50:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:52.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:52.301 --rc genhtml_branch_coverage=1 00:26:52.301 --rc genhtml_function_coverage=1 00:26:52.301 --rc genhtml_legend=1 00:26:52.301 --rc geninfo_all_blocks=1 00:26:52.301 --rc geninfo_unexecuted_blocks=1 00:26:52.301 00:26:52.301 ' 00:26:52.301 15:50:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:52.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:52.301 --rc genhtml_branch_coverage=1 00:26:52.301 --rc genhtml_function_coverage=1 00:26:52.301 --rc genhtml_legend=1 00:26:52.301 --rc geninfo_all_blocks=1 00:26:52.301 --rc geninfo_unexecuted_blocks=1 00:26:52.301 00:26:52.301 ' 00:26:52.301 15:50:43 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:52.301 15:50:43 -- nvmf/common.sh@7 -- # uname -s 00:26:52.301 15:50:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:52.301 15:50:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:52.301 15:50:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:52.301 15:50:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:52.301 15:50:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:52.301 15:50:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:52.301 15:50:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:52.301 15:50:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:52.301 15:50:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:52.301 15:50:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:52.301 15:50:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:52.301 15:50:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:52.301 15:50:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:52.301 15:50:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:52.301 15:50:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:52.301 15:50:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:52.301 15:50:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:52.301 15:50:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:52.301 15:50:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:52.302 15:50:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.302 15:50:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.302 15:50:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.302 15:50:43 -- paths/export.sh@5 -- # export PATH 00:26:52.302 15:50:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.302 15:50:43 -- nvmf/common.sh@46 -- # : 0 00:26:52.302 15:50:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:52.302 15:50:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:52.302 15:50:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:52.302 15:50:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:52.302 15:50:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:52.302 15:50:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:52.302 15:50:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:52.302 15:50:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:52.302 15:50:43 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:52.302 15:50:43 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:52.302 15:50:43 -- host/bdevperf.sh@24 -- # nvmftestinit 00:26:52.302 15:50:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:52.302 15:50:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:52.302 15:50:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:52.302 15:50:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:52.302 15:50:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:52.302 15:50:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:52.302 15:50:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:52.302 15:50:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:52.302 15:50:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:52.302 15:50:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:52.302 15:50:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:52.302 15:50:43 -- common/autotest_common.sh@10 -- # set +x 00:26:54.830 15:50:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:54.830 15:50:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:54.830 15:50:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:54.830 15:50:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:54.830 15:50:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:54.830 15:50:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:54.830 15:50:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:54.830 15:50:45 -- nvmf/common.sh@294 -- # net_devs=() 00:26:54.830 15:50:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:54.830 15:50:45 -- nvmf/common.sh@295 -- # e810=() 00:26:54.830 15:50:45 -- nvmf/common.sh@295 -- # local -ga e810 00:26:54.830 15:50:45 -- nvmf/common.sh@296 -- # x722=() 00:26:54.830 15:50:45 -- nvmf/common.sh@296 -- # local -ga x722 00:26:54.830 15:50:45 -- nvmf/common.sh@297 -- # mlx=() 00:26:54.830 15:50:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:54.830 15:50:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:54.830 15:50:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:54.830 15:50:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:54.830 15:50:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:54.830 15:50:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:54.830 15:50:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:54.830 15:50:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:54.830 15:50:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:54.830 15:50:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:54.830 15:50:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:54.830 15:50:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:54.830 15:50:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:54.830 15:50:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:54.830 15:50:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:54.830 15:50:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:54.830 15:50:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:54.830 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:54.830 15:50:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:54.830 15:50:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:54.830 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:54.830 15:50:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:54.830 15:50:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:54.830 15:50:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:54.830 15:50:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:54.830 15:50:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:54.830 15:50:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:54.830 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:54.830 15:50:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:54.830 15:50:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:54.830 15:50:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:54.830 15:50:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:54.830 15:50:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:54.830 15:50:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:54.830 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:54.830 15:50:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:54.830 15:50:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:54.830 15:50:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:54.830 15:50:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:54.830 15:50:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:54.830 15:50:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:54.830 15:50:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:54.830 15:50:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:54.830 15:50:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:54.830 15:50:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:54.830 15:50:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:54.830 15:50:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:54.830 15:50:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:54.830 15:50:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:54.830 15:50:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:54.830 15:50:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:54.830 15:50:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:54.830 15:50:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:54.830 15:50:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:54.830 15:50:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:54.830 15:50:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:54.830 15:50:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:54.830 15:50:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:54.830 15:50:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:54.830 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:54.830 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:26:54.830 00:26:54.830 --- 10.0.0.2 ping statistics --- 00:26:54.830 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:54.830 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:26:54.830 15:50:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:54.830 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:54.830 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.133 ms 00:26:54.830 00:26:54.830 --- 10.0.0.1 ping statistics --- 00:26:54.830 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:54.830 rtt min/avg/max/mdev = 0.133/0.133/0.133/0.000 ms 00:26:54.830 15:50:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:54.830 15:50:45 -- nvmf/common.sh@410 -- # return 0 00:26:54.830 15:50:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:54.830 15:50:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:54.830 15:50:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:54.830 15:50:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:54.830 15:50:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:54.830 15:50:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:54.830 15:50:45 -- host/bdevperf.sh@25 -- # tgt_init 00:26:54.830 15:50:45 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:26:54.830 15:50:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:54.830 15:50:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:54.830 15:50:45 -- common/autotest_common.sh@10 -- # set +x 00:26:54.830 15:50:45 -- nvmf/common.sh@469 -- # nvmfpid=981323 00:26:54.830 15:50:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:26:54.830 15:50:45 -- nvmf/common.sh@470 -- # waitforlisten 981323 00:26:54.830 15:50:45 -- common/autotest_common.sh@829 -- # '[' -z 981323 ']' 00:26:54.830 15:50:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:54.830 15:50:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:54.830 15:50:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:54.830 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:54.830 15:50:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:54.830 15:50:45 -- common/autotest_common.sh@10 -- # set +x 00:26:54.830 [2024-11-26 15:50:45.909226] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:54.830 [2024-11-26 15:50:45.909304] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:54.830 EAL: No free 2048 kB hugepages reported on node 1 00:26:54.830 [2024-11-26 15:50:45.979035] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:26:54.830 [2024-11-26 15:50:46.094662] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:54.830 [2024-11-26 15:50:46.094859] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:54.831 [2024-11-26 15:50:46.094880] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:54.831 [2024-11-26 15:50:46.094893] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:54.831 [2024-11-26 15:50:46.094945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:54.831 [2024-11-26 15:50:46.095002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:54.831 [2024-11-26 15:50:46.095005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:55.769 15:50:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:55.769 15:50:46 -- common/autotest_common.sh@862 -- # return 0 00:26:55.769 15:50:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:55.769 15:50:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:55.769 15:50:46 -- common/autotest_common.sh@10 -- # set +x 00:26:55.769 15:50:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:55.769 15:50:46 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:55.769 15:50:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:55.769 15:50:46 -- common/autotest_common.sh@10 -- # set +x 00:26:55.769 [2024-11-26 15:50:46.946349] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:55.769 15:50:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:55.769 15:50:46 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:55.769 15:50:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:55.769 15:50:46 -- common/autotest_common.sh@10 -- # set +x 00:26:55.769 Malloc0 00:26:55.769 15:50:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:55.769 15:50:46 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:55.769 15:50:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:55.769 15:50:46 -- common/autotest_common.sh@10 -- # set +x 00:26:55.769 15:50:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:55.769 15:50:46 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:55.769 15:50:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:55.769 15:50:46 -- common/autotest_common.sh@10 -- # set +x 00:26:55.769 15:50:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:55.769 15:50:47 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:55.769 15:50:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:55.769 15:50:47 -- common/autotest_common.sh@10 -- # set +x 00:26:55.769 [2024-11-26 15:50:47.010344] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:55.769 15:50:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:55.769 15:50:47 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:26:55.769 15:50:47 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:26:55.769 15:50:47 -- nvmf/common.sh@520 -- # config=() 00:26:55.769 15:50:47 -- nvmf/common.sh@520 -- # local subsystem config 00:26:55.769 15:50:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:55.769 15:50:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:55.769 { 00:26:55.769 "params": { 00:26:55.769 "name": "Nvme$subsystem", 00:26:55.769 "trtype": "$TEST_TRANSPORT", 00:26:55.769 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:55.769 "adrfam": "ipv4", 00:26:55.769 "trsvcid": "$NVMF_PORT", 00:26:55.769 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:55.769 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:55.769 "hdgst": ${hdgst:-false}, 00:26:55.769 "ddgst": ${ddgst:-false} 00:26:55.769 }, 00:26:55.769 "method": "bdev_nvme_attach_controller" 00:26:55.769 } 00:26:55.769 EOF 00:26:55.769 )") 00:26:55.769 15:50:47 -- nvmf/common.sh@542 -- # cat 00:26:55.769 15:50:47 -- nvmf/common.sh@544 -- # jq . 00:26:55.769 15:50:47 -- nvmf/common.sh@545 -- # IFS=, 00:26:55.769 15:50:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:55.769 "params": { 00:26:55.769 "name": "Nvme1", 00:26:55.769 "trtype": "tcp", 00:26:55.769 "traddr": "10.0.0.2", 00:26:55.769 "adrfam": "ipv4", 00:26:55.769 "trsvcid": "4420", 00:26:55.769 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:55.769 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:55.769 "hdgst": false, 00:26:55.769 "ddgst": false 00:26:55.769 }, 00:26:55.769 "method": "bdev_nvme_attach_controller" 00:26:55.769 }' 00:26:55.769 [2024-11-26 15:50:47.054067] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:55.769 [2024-11-26 15:50:47.054144] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid981473 ] 00:26:55.769 EAL: No free 2048 kB hugepages reported on node 1 00:26:55.769 [2024-11-26 15:50:47.113957] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:56.028 [2024-11-26 15:50:47.224313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:56.028 Running I/O for 1 seconds... 00:26:57.403 00:26:57.403 Latency(us) 00:26:57.403 [2024-11-26T14:50:48.856Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:57.403 [2024-11-26T14:50:48.856Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:57.403 Verification LBA range: start 0x0 length 0x4000 00:26:57.403 Nvme1n1 : 1.01 12827.06 50.11 0.00 0.00 9930.38 1268.24 13495.56 00:26:57.403 [2024-11-26T14:50:48.856Z] =================================================================================================================== 00:26:57.403 [2024-11-26T14:50:48.856Z] Total : 12827.06 50.11 0.00 0.00 9930.38 1268.24 13495.56 00:26:57.403 15:50:48 -- host/bdevperf.sh@30 -- # bdevperfpid=981729 00:26:57.403 15:50:48 -- host/bdevperf.sh@32 -- # sleep 3 00:26:57.403 15:50:48 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:26:57.403 15:50:48 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:26:57.403 15:50:48 -- nvmf/common.sh@520 -- # config=() 00:26:57.403 15:50:48 -- nvmf/common.sh@520 -- # local subsystem config 00:26:57.403 15:50:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:57.403 15:50:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:57.403 { 00:26:57.403 "params": { 00:26:57.403 "name": "Nvme$subsystem", 00:26:57.403 "trtype": "$TEST_TRANSPORT", 00:26:57.403 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:57.403 "adrfam": "ipv4", 00:26:57.403 "trsvcid": "$NVMF_PORT", 00:26:57.403 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:57.403 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:57.403 "hdgst": ${hdgst:-false}, 00:26:57.403 "ddgst": ${ddgst:-false} 00:26:57.403 }, 00:26:57.403 "method": "bdev_nvme_attach_controller" 00:26:57.403 } 00:26:57.403 EOF 00:26:57.403 )") 00:26:57.403 15:50:48 -- nvmf/common.sh@542 -- # cat 00:26:57.403 15:50:48 -- nvmf/common.sh@544 -- # jq . 00:26:57.403 15:50:48 -- nvmf/common.sh@545 -- # IFS=, 00:26:57.403 15:50:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:57.403 "params": { 00:26:57.403 "name": "Nvme1", 00:26:57.403 "trtype": "tcp", 00:26:57.403 "traddr": "10.0.0.2", 00:26:57.403 "adrfam": "ipv4", 00:26:57.403 "trsvcid": "4420", 00:26:57.403 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:57.403 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:57.403 "hdgst": false, 00:26:57.403 "ddgst": false 00:26:57.403 }, 00:26:57.403 "method": "bdev_nvme_attach_controller" 00:26:57.403 }' 00:26:57.403 [2024-11-26 15:50:48.763961] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:57.403 [2024-11-26 15:50:48.764040] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid981729 ] 00:26:57.403 EAL: No free 2048 kB hugepages reported on node 1 00:26:57.403 [2024-11-26 15:50:48.822056] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:57.664 [2024-11-26 15:50:48.929213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:57.987 Running I/O for 15 seconds... 00:27:00.539 15:50:51 -- host/bdevperf.sh@33 -- # kill -9 981323 00:27:00.539 15:50:51 -- host/bdevperf.sh@35 -- # sleep 3 00:27:00.539 [2024-11-26 15:50:51.735248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:92344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.539 [2024-11-26 15:50:51.735315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.539 [2024-11-26 15:50:51.735358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:92352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.539 [2024-11-26 15:50:51.735378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.539 [2024-11-26 15:50:51.735397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:92368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.539 [2024-11-26 15:50:51.735426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.539 [2024-11-26 15:50:51.735446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:92384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.539 [2024-11-26 15:50:51.735463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.539 [2024-11-26 15:50:51.735481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:92408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.539 [2024-11-26 15:50:51.735499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.539 [2024-11-26 15:50:51.735517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:92440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.539 [2024-11-26 15:50:51.735535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.539 [2024-11-26 15:50:51.735553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:92472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.539 [2024-11-26 15:50:51.735570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.539 [2024-11-26 15:50:51.735597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:92488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.539 [2024-11-26 15:50:51.735614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.539 [2024-11-26 15:50:51.735631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:92504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.539 [2024-11-26 15:50:51.735647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.539 [2024-11-26 15:50:51.735667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:92520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.539 [2024-11-26 15:50:51.735696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.539 [2024-11-26 15:50:51.735717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:92536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.539 [2024-11-26 15:50:51.735750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.539 [2024-11-26 15:50:51.735769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:92544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.539 [2024-11-26 15:50:51.735784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.539 [2024-11-26 15:50:51.735799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:91848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.539 [2024-11-26 15:50:51.735813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.539 [2024-11-26 15:50:51.735829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:91864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.539 [2024-11-26 15:50:51.735842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.539 [2024-11-26 15:50:51.735857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:91872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.539 [2024-11-26 15:50:51.735871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.735891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:91888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.735906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.735921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:91912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.735935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.735951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:91928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.735974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:91952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:91968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:92552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:92560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.540 [2024-11-26 15:50:51.736122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:92568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:92576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.540 [2024-11-26 15:50:51.736186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:92584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:92592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:92600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:92608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:92616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.540 [2024-11-26 15:50:51.736351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:92624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:92632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:92640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:92648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.540 [2024-11-26 15:50:51.736479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:92656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.540 [2024-11-26 15:50:51.736511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:92664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.540 [2024-11-26 15:50:51.736543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:92672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:92680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.540 [2024-11-26 15:50:51.736606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:92688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:92696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:92704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.540 [2024-11-26 15:50:51.736723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:92712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.540 [2024-11-26 15:50:51.736772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:92720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:92728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.540 [2024-11-26 15:50:51.736830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:92736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:91976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:91984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:91992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.736962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:92000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.736993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.737007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:92016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.737020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.737049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:92040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.737066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.737082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:92048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.737097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.737114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:92056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.737129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.737146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:92744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.737161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.737182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:92752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.540 [2024-11-26 15:50:51.737199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.540 [2024-11-26 15:50:51.737216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:92760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.541 [2024-11-26 15:50:51.737231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:92768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.541 [2024-11-26 15:50:51.737263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:92072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:92088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:92096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:92104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:92128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:92144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:92152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:92176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:92776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:92784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.541 [2024-11-26 15:50:51.737585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:92792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.541 [2024-11-26 15:50:51.737618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:92800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:92808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:92816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:92824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:92832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.541 [2024-11-26 15:50:51.737806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:92840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:92848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:92856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.541 [2024-11-26 15:50:51.737894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:92864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:92872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.737952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.737967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:92880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.738000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:92888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.738035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:92192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.738082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:92200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.738113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:92216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.738145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:92248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.738178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:92272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.738209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:92288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.738241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:92296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.738274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:92320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.738306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:92896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.541 [2024-11-26 15:50:51.738338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:92904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.541 [2024-11-26 15:50:51.738373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:92912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.541 [2024-11-26 15:50:51.738405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:92920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.541 [2024-11-26 15:50:51.738438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:92928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.738475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:92936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.738508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:92944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.541 [2024-11-26 15:50:51.738540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.541 [2024-11-26 15:50:51.738557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:92952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.738572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.738589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:92960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.738605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.738621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:92968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.542 [2024-11-26 15:50:51.738636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.738654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:92976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.738680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.738707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:92984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.738723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.738754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:92992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.542 [2024-11-26 15:50:51.738768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.738783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:93000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.738797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.738813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:93008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.542 [2024-11-26 15:50:51.738826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.738841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:93016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.542 [2024-11-26 15:50:51.738854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.738869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:93024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.738886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.738901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:93032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.542 [2024-11-26 15:50:51.738915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.738930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:93040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.542 [2024-11-26 15:50:51.738944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.738958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:93048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.542 [2024-11-26 15:50:51.738998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:93056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.542 [2024-11-26 15:50:51.739031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:93064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:93072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.542 [2024-11-26 15:50:51.739097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:93080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:93088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:92328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:92336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:92360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:92376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:92392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:92400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:92416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:92424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:92432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:92448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:92456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:92464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:92480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:92496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:92512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.542 [2024-11-26 15:50:51.739656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1766740 is same with the state(5) to be set 00:27:00.542 [2024-11-26 15:50:51.739709] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:00.542 [2024-11-26 15:50:51.739722] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:00.542 [2024-11-26 15:50:51.739750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:92528 len:8 PRP1 0x0 PRP2 0x0 00:27:00.542 [2024-11-26 15:50:51.739769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739833] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1766740 was disconnected and freed. reset controller. 00:27:00.542 [2024-11-26 15:50:51.739903] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:00.542 [2024-11-26 15:50:51.739924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739954] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:00.542 [2024-11-26 15:50:51.739968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.739983] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:00.542 [2024-11-26 15:50:51.739996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.542 [2024-11-26 15:50:51.740025] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:00.543 [2024-11-26 15:50:51.740037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.543 [2024-11-26 15:50:51.740049] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.543 [2024-11-26 15:50:51.742463] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.543 [2024-11-26 15:50:51.742505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.543 [2024-11-26 15:50:51.743023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.743179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.743209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.543 [2024-11-26 15:50:51.743228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.543 [2024-11-26 15:50:51.743358] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.543 [2024-11-26 15:50:51.743545] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.543 [2024-11-26 15:50:51.743571] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.543 [2024-11-26 15:50:51.743591] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.543 [2024-11-26 15:50:51.746007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.543 [2024-11-26 15:50:51.755330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.543 [2024-11-26 15:50:51.755752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.755952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.755979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.543 [2024-11-26 15:50:51.755996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.543 [2024-11-26 15:50:51.756168] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.543 [2024-11-26 15:50:51.756344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.543 [2024-11-26 15:50:51.756375] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.543 [2024-11-26 15:50:51.756392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.543 [2024-11-26 15:50:51.758671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.543 [2024-11-26 15:50:51.767956] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.543 [2024-11-26 15:50:51.768284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.768468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.768497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.543 [2024-11-26 15:50:51.768515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.543 [2024-11-26 15:50:51.768711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.543 [2024-11-26 15:50:51.768899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.543 [2024-11-26 15:50:51.768923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.543 [2024-11-26 15:50:51.768939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.543 [2024-11-26 15:50:51.771198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.543 [2024-11-26 15:50:51.780639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.543 [2024-11-26 15:50:51.780996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.781157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.781186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.543 [2024-11-26 15:50:51.781205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.543 [2024-11-26 15:50:51.781334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.543 [2024-11-26 15:50:51.781485] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.543 [2024-11-26 15:50:51.781509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.543 [2024-11-26 15:50:51.781525] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.543 [2024-11-26 15:50:51.783816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.543 [2024-11-26 15:50:51.793088] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.543 [2024-11-26 15:50:51.793436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.793569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.793598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.543 [2024-11-26 15:50:51.793616] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.543 [2024-11-26 15:50:51.793794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.543 [2024-11-26 15:50:51.793964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.543 [2024-11-26 15:50:51.793988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.543 [2024-11-26 15:50:51.794010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.543 [2024-11-26 15:50:51.796413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.543 [2024-11-26 15:50:51.805756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.543 [2024-11-26 15:50:51.806114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.806296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.806326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.543 [2024-11-26 15:50:51.806344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.543 [2024-11-26 15:50:51.806510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.543 [2024-11-26 15:50:51.806608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.543 [2024-11-26 15:50:51.806640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.543 [2024-11-26 15:50:51.806656] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.543 [2024-11-26 15:50:51.808953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.543 [2024-11-26 15:50:51.818230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.543 [2024-11-26 15:50:51.818573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.818762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.818790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.543 [2024-11-26 15:50:51.818806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.543 [2024-11-26 15:50:51.819001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.543 [2024-11-26 15:50:51.819177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.543 [2024-11-26 15:50:51.819201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.543 [2024-11-26 15:50:51.819221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.543 [2024-11-26 15:50:51.821542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.543 [2024-11-26 15:50:51.830705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.543 [2024-11-26 15:50:51.831115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.831313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.831345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.543 [2024-11-26 15:50:51.831363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.543 [2024-11-26 15:50:51.831532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.543 [2024-11-26 15:50:51.831725] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.543 [2024-11-26 15:50:51.831746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.543 [2024-11-26 15:50:51.831760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.543 [2024-11-26 15:50:51.834198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.543 [2024-11-26 15:50:51.842926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.543 [2024-11-26 15:50:51.843238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.843369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.543 [2024-11-26 15:50:51.843395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.543 [2024-11-26 15:50:51.843429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.543 [2024-11-26 15:50:51.843667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.543 [2024-11-26 15:50:51.843836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.543 [2024-11-26 15:50:51.843858] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.543 [2024-11-26 15:50:51.843872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.543 [2024-11-26 15:50:51.846421] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.543 [2024-11-26 15:50:51.855401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.544 [2024-11-26 15:50:51.855778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.855923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.855950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.544 [2024-11-26 15:50:51.855966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.544 [2024-11-26 15:50:51.856206] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.544 [2024-11-26 15:50:51.856370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.544 [2024-11-26 15:50:51.856391] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.544 [2024-11-26 15:50:51.856413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.544 [2024-11-26 15:50:51.858665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.544 [2024-11-26 15:50:51.867886] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.544 [2024-11-26 15:50:51.868229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.868370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.868398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.544 [2024-11-26 15:50:51.868415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.544 [2024-11-26 15:50:51.868644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.544 [2024-11-26 15:50:51.868820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.544 [2024-11-26 15:50:51.868844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.544 [2024-11-26 15:50:51.868858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.544 [2024-11-26 15:50:51.871107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.544 [2024-11-26 15:50:51.880268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.544 [2024-11-26 15:50:51.880645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.880826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.880870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.544 [2024-11-26 15:50:51.880894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.544 [2024-11-26 15:50:51.881059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.544 [2024-11-26 15:50:51.881248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.544 [2024-11-26 15:50:51.881275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.544 [2024-11-26 15:50:51.881290] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.544 [2024-11-26 15:50:51.883663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.544 [2024-11-26 15:50:51.893007] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.544 [2024-11-26 15:50:51.893375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.893523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.893553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.544 [2024-11-26 15:50:51.893572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.544 [2024-11-26 15:50:51.893746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.544 [2024-11-26 15:50:51.893915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.544 [2024-11-26 15:50:51.893937] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.544 [2024-11-26 15:50:51.893951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.544 [2024-11-26 15:50:51.896296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.544 [2024-11-26 15:50:51.905584] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.544 [2024-11-26 15:50:51.905905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.906020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.906048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.544 [2024-11-26 15:50:51.906065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.544 [2024-11-26 15:50:51.906260] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.544 [2024-11-26 15:50:51.906485] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.544 [2024-11-26 15:50:51.906511] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.544 [2024-11-26 15:50:51.906527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.544 [2024-11-26 15:50:51.908868] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.544 [2024-11-26 15:50:51.917949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.544 [2024-11-26 15:50:51.918285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.918453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.918484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.544 [2024-11-26 15:50:51.918502] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.544 [2024-11-26 15:50:51.918668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.544 [2024-11-26 15:50:51.918820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.544 [2024-11-26 15:50:51.918845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.544 [2024-11-26 15:50:51.918860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.544 [2024-11-26 15:50:51.921211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.544 [2024-11-26 15:50:51.930416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.544 [2024-11-26 15:50:51.930747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.930869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.930896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.544 [2024-11-26 15:50:51.930912] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.544 [2024-11-26 15:50:51.931027] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.544 [2024-11-26 15:50:51.931248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.544 [2024-11-26 15:50:51.931273] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.544 [2024-11-26 15:50:51.931289] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.544 [2024-11-26 15:50:51.933604] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.544 [2024-11-26 15:50:51.943010] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.544 [2024-11-26 15:50:51.943337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.943519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.544 [2024-11-26 15:50:51.943549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.544 [2024-11-26 15:50:51.943567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.544 [2024-11-26 15:50:51.943741] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.544 [2024-11-26 15:50:51.943894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.544 [2024-11-26 15:50:51.943916] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.544 [2024-11-26 15:50:51.943931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.545 [2024-11-26 15:50:51.946281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.545 [2024-11-26 15:50:51.955576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.545 [2024-11-26 15:50:51.955887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.545 [2024-11-26 15:50:51.956101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.545 [2024-11-26 15:50:51.956131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.545 [2024-11-26 15:50:51.956150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.545 [2024-11-26 15:50:51.956352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.545 [2024-11-26 15:50:51.956465] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.545 [2024-11-26 15:50:51.956490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.545 [2024-11-26 15:50:51.956507] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.545 [2024-11-26 15:50:51.958698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.545 [2024-11-26 15:50:51.968242] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.545 [2024-11-26 15:50:51.968577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.545 [2024-11-26 15:50:51.968748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.545 [2024-11-26 15:50:51.968774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.545 [2024-11-26 15:50:51.968790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.545 [2024-11-26 15:50:51.968937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.545 [2024-11-26 15:50:51.969128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.545 [2024-11-26 15:50:51.969154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.545 [2024-11-26 15:50:51.969171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.545 [2024-11-26 15:50:51.971456] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.545 [2024-11-26 15:50:51.980865] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.545 [2024-11-26 15:50:51.981198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.545 [2024-11-26 15:50:51.981412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.545 [2024-11-26 15:50:51.981467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.545 [2024-11-26 15:50:51.981485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.808 [2024-11-26 15:50:51.981701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.808 [2024-11-26 15:50:51.981873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.808 [2024-11-26 15:50:51.981898] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.808 [2024-11-26 15:50:51.981914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.808 [2024-11-26 15:50:51.984268] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.808 [2024-11-26 15:50:51.993422] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.808 [2024-11-26 15:50:51.993787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.808 [2024-11-26 15:50:51.993964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.808 [2024-11-26 15:50:51.993992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.808 [2024-11-26 15:50:51.994034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.808 [2024-11-26 15:50:51.994165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.808 [2024-11-26 15:50:51.994297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.808 [2024-11-26 15:50:51.994322] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.808 [2024-11-26 15:50:51.994339] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.808 [2024-11-26 15:50:51.996586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.808 [2024-11-26 15:50:52.006194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.808 [2024-11-26 15:50:52.006539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.808 [2024-11-26 15:50:52.006730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.808 [2024-11-26 15:50:52.006759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.808 [2024-11-26 15:50:52.006776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.808 [2024-11-26 15:50:52.006910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.808 [2024-11-26 15:50:52.007094] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.808 [2024-11-26 15:50:52.007118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.808 [2024-11-26 15:50:52.007134] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.808 [2024-11-26 15:50:52.009613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.808 [2024-11-26 15:50:52.018883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.809 [2024-11-26 15:50:52.019284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.019437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.019470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.809 [2024-11-26 15:50:52.019489] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.809 [2024-11-26 15:50:52.019674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.809 [2024-11-26 15:50:52.019822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.809 [2024-11-26 15:50:52.019844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.809 [2024-11-26 15:50:52.019873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.809 [2024-11-26 15:50:52.022425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.809 [2024-11-26 15:50:52.031367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.809 [2024-11-26 15:50:52.031676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.031847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.031878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.809 [2024-11-26 15:50:52.031897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.809 [2024-11-26 15:50:52.032069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.809 [2024-11-26 15:50:52.032220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.809 [2024-11-26 15:50:52.032246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.809 [2024-11-26 15:50:52.032262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.809 [2024-11-26 15:50:52.034846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.809 [2024-11-26 15:50:52.044034] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.809 [2024-11-26 15:50:52.044386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.044544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.044573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.809 [2024-11-26 15:50:52.044590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.809 [2024-11-26 15:50:52.044766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.809 [2024-11-26 15:50:52.044937] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.809 [2024-11-26 15:50:52.044963] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.809 [2024-11-26 15:50:52.044979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.809 [2024-11-26 15:50:52.047329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.809 [2024-11-26 15:50:52.056694] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.809 [2024-11-26 15:50:52.057079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.057279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.057310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.809 [2024-11-26 15:50:52.057327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.809 [2024-11-26 15:50:52.057511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.809 [2024-11-26 15:50:52.057662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.809 [2024-11-26 15:50:52.057700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.809 [2024-11-26 15:50:52.057720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.809 [2024-11-26 15:50:52.060125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.809 [2024-11-26 15:50:52.069171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.809 [2024-11-26 15:50:52.069447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.069596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.069627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.809 [2024-11-26 15:50:52.069646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.809 [2024-11-26 15:50:52.069836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.809 [2024-11-26 15:50:52.070024] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.809 [2024-11-26 15:50:52.070049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.809 [2024-11-26 15:50:52.070065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.809 [2024-11-26 15:50:52.072623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.809 [2024-11-26 15:50:52.081714] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.809 [2024-11-26 15:50:52.082086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.082273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.082300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.809 [2024-11-26 15:50:52.082332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.809 [2024-11-26 15:50:52.082502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.809 [2024-11-26 15:50:52.082667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.809 [2024-11-26 15:50:52.082705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.809 [2024-11-26 15:50:52.082724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.809 [2024-11-26 15:50:52.085058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.809 [2024-11-26 15:50:52.094338] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.809 [2024-11-26 15:50:52.094750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.094903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.094931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.809 [2024-11-26 15:50:52.094949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.809 [2024-11-26 15:50:52.095096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.809 [2024-11-26 15:50:52.095228] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.809 [2024-11-26 15:50:52.095251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.809 [2024-11-26 15:50:52.095268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.809 [2024-11-26 15:50:52.097780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.809 [2024-11-26 15:50:52.106931] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.809 [2024-11-26 15:50:52.107301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.107478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.107508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.809 [2024-11-26 15:50:52.107526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.809 [2024-11-26 15:50:52.107742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.809 [2024-11-26 15:50:52.107917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.809 [2024-11-26 15:50:52.107943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.809 [2024-11-26 15:50:52.107960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.809 [2024-11-26 15:50:52.110153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.809 [2024-11-26 15:50:52.119284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.809 [2024-11-26 15:50:52.119627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.119809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.119836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.809 [2024-11-26 15:50:52.119867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.809 [2024-11-26 15:50:52.120022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.809 [2024-11-26 15:50:52.120201] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.809 [2024-11-26 15:50:52.120227] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.809 [2024-11-26 15:50:52.120244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.809 [2024-11-26 15:50:52.122561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.809 [2024-11-26 15:50:52.131902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.809 [2024-11-26 15:50:52.132213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.132392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.809 [2024-11-26 15:50:52.132440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.809 [2024-11-26 15:50:52.132459] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.810 [2024-11-26 15:50:52.132625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.810 [2024-11-26 15:50:52.132789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.810 [2024-11-26 15:50:52.132815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.810 [2024-11-26 15:50:52.132832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.810 [2024-11-26 15:50:52.135202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.810 [2024-11-26 15:50:52.144431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.810 [2024-11-26 15:50:52.144730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.144894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.144921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.810 [2024-11-26 15:50:52.144954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.810 [2024-11-26 15:50:52.145138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.810 [2024-11-26 15:50:52.145271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.810 [2024-11-26 15:50:52.145297] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.810 [2024-11-26 15:50:52.145318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.810 [2024-11-26 15:50:52.147734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.810 [2024-11-26 15:50:52.156997] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.810 [2024-11-26 15:50:52.157349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.157523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.157551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.810 [2024-11-26 15:50:52.157569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.810 [2024-11-26 15:50:52.157751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.810 [2024-11-26 15:50:52.157865] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.810 [2024-11-26 15:50:52.157889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.810 [2024-11-26 15:50:52.157904] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.810 [2024-11-26 15:50:52.160147] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.810 [2024-11-26 15:50:52.169544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.810 [2024-11-26 15:50:52.169869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.169995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.170025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.810 [2024-11-26 15:50:52.170043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.810 [2024-11-26 15:50:52.170209] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.810 [2024-11-26 15:50:52.170359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.810 [2024-11-26 15:50:52.170384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.810 [2024-11-26 15:50:52.170400] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.810 [2024-11-26 15:50:52.172821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.810 [2024-11-26 15:50:52.182143] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.810 [2024-11-26 15:50:52.182530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.182678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.182721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.810 [2024-11-26 15:50:52.182739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.810 [2024-11-26 15:50:52.182905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.810 [2024-11-26 15:50:52.183092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.810 [2024-11-26 15:50:52.183117] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.810 [2024-11-26 15:50:52.183139] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.810 [2024-11-26 15:50:52.185620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.810 [2024-11-26 15:50:52.194818] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.810 [2024-11-26 15:50:52.195258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.195405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.195433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.810 [2024-11-26 15:50:52.195451] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.810 [2024-11-26 15:50:52.195616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.810 [2024-11-26 15:50:52.195762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.810 [2024-11-26 15:50:52.195786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.810 [2024-11-26 15:50:52.195802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.810 [2024-11-26 15:50:52.198115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.810 [2024-11-26 15:50:52.207417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.810 [2024-11-26 15:50:52.207741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.207927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.207979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.810 [2024-11-26 15:50:52.207997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.810 [2024-11-26 15:50:52.208163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.810 [2024-11-26 15:50:52.208387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.810 [2024-11-26 15:50:52.208412] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.810 [2024-11-26 15:50:52.208428] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.810 [2024-11-26 15:50:52.210621] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.810 [2024-11-26 15:50:52.219936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.810 [2024-11-26 15:50:52.220278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.220429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.220457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.810 [2024-11-26 15:50:52.220475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.810 [2024-11-26 15:50:52.220640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.810 [2024-11-26 15:50:52.220823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.810 [2024-11-26 15:50:52.220859] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.810 [2024-11-26 15:50:52.220876] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.810 [2024-11-26 15:50:52.223317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.810 [2024-11-26 15:50:52.232448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.810 [2024-11-26 15:50:52.232818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.233047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.233099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.810 [2024-11-26 15:50:52.233118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.810 [2024-11-26 15:50:52.233284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.810 [2024-11-26 15:50:52.233453] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.810 [2024-11-26 15:50:52.233478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.810 [2024-11-26 15:50:52.233494] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.810 [2024-11-26 15:50:52.235878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.810 [2024-11-26 15:50:52.245188] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.810 [2024-11-26 15:50:52.245518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.245668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.810 [2024-11-26 15:50:52.245711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:00.810 [2024-11-26 15:50:52.245731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:00.810 [2024-11-26 15:50:52.245893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:00.810 [2024-11-26 15:50:52.246078] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.810 [2024-11-26 15:50:52.246104] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.811 [2024-11-26 15:50:52.246120] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.811 [2024-11-26 15:50:52.248434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.073 [2024-11-26 15:50:52.257850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.073 [2024-11-26 15:50:52.258229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.258384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.258412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.073 [2024-11-26 15:50:52.258430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.073 [2024-11-26 15:50:52.258578] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.073 [2024-11-26 15:50:52.258751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.073 [2024-11-26 15:50:52.258772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.073 [2024-11-26 15:50:52.258786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.073 [2024-11-26 15:50:52.261098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.073 [2024-11-26 15:50:52.270440] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.073 [2024-11-26 15:50:52.270779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.270928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.270954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.073 [2024-11-26 15:50:52.270985] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.073 [2024-11-26 15:50:52.271153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.073 [2024-11-26 15:50:52.271357] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.073 [2024-11-26 15:50:52.271381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.073 [2024-11-26 15:50:52.271397] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.073 [2024-11-26 15:50:52.273729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.073 [2024-11-26 15:50:52.282852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.073 [2024-11-26 15:50:52.283179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.283333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.283361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.073 [2024-11-26 15:50:52.283379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.073 [2024-11-26 15:50:52.283545] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.073 [2024-11-26 15:50:52.283678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.073 [2024-11-26 15:50:52.283715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.073 [2024-11-26 15:50:52.283732] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.073 [2024-11-26 15:50:52.286316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.073 [2024-11-26 15:50:52.295421] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.073 [2024-11-26 15:50:52.295766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.295924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.295952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.073 [2024-11-26 15:50:52.295984] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.073 [2024-11-26 15:50:52.296124] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.073 [2024-11-26 15:50:52.296292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.073 [2024-11-26 15:50:52.296317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.073 [2024-11-26 15:50:52.296333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.073 [2024-11-26 15:50:52.298471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.073 [2024-11-26 15:50:52.308061] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.073 [2024-11-26 15:50:52.308366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.308602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.308632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.073 [2024-11-26 15:50:52.308650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.073 [2024-11-26 15:50:52.308849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.073 [2024-11-26 15:50:52.309037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.073 [2024-11-26 15:50:52.309062] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.073 [2024-11-26 15:50:52.309078] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.073 [2024-11-26 15:50:52.311485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.073 [2024-11-26 15:50:52.320602] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.073 [2024-11-26 15:50:52.320941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.321185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.321232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.073 [2024-11-26 15:50:52.321250] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.073 [2024-11-26 15:50:52.321398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.073 [2024-11-26 15:50:52.321548] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.073 [2024-11-26 15:50:52.321571] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.073 [2024-11-26 15:50:52.321586] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.073 [2024-11-26 15:50:52.323878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.073 [2024-11-26 15:50:52.333020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.073 [2024-11-26 15:50:52.333316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.333493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.333524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.073 [2024-11-26 15:50:52.333542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.073 [2024-11-26 15:50:52.333673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.073 [2024-11-26 15:50:52.333874] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.073 [2024-11-26 15:50:52.333900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.073 [2024-11-26 15:50:52.333916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.073 [2024-11-26 15:50:52.336215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.073 [2024-11-26 15:50:52.345549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.073 [2024-11-26 15:50:52.345885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.346112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.346161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.073 [2024-11-26 15:50:52.346185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.073 [2024-11-26 15:50:52.346352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.073 [2024-11-26 15:50:52.346520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.073 [2024-11-26 15:50:52.346543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.073 [2024-11-26 15:50:52.346559] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.073 [2024-11-26 15:50:52.348942] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.073 [2024-11-26 15:50:52.358095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.073 [2024-11-26 15:50:52.358487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.358641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.073 [2024-11-26 15:50:52.358669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.074 [2024-11-26 15:50:52.358701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.074 [2024-11-26 15:50:52.358870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.074 [2024-11-26 15:50:52.359038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.074 [2024-11-26 15:50:52.359062] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.074 [2024-11-26 15:50:52.359077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.074 [2024-11-26 15:50:52.361413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.074 [2024-11-26 15:50:52.370733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.074 [2024-11-26 15:50:52.371079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.371369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.371429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.074 [2024-11-26 15:50:52.371447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.074 [2024-11-26 15:50:52.371649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.074 [2024-11-26 15:50:52.371820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.074 [2024-11-26 15:50:52.371846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.074 [2024-11-26 15:50:52.371862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.074 [2024-11-26 15:50:52.374123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.074 [2024-11-26 15:50:52.383407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.074 [2024-11-26 15:50:52.383773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.383967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.383994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.074 [2024-11-26 15:50:52.384015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.074 [2024-11-26 15:50:52.384213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.074 [2024-11-26 15:50:52.384346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.074 [2024-11-26 15:50:52.384371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.074 [2024-11-26 15:50:52.384387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.074 [2024-11-26 15:50:52.386633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.074 [2024-11-26 15:50:52.396029] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.074 [2024-11-26 15:50:52.396380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.396559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.396587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.074 [2024-11-26 15:50:52.396605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.074 [2024-11-26 15:50:52.396821] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.074 [2024-11-26 15:50:52.396990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.074 [2024-11-26 15:50:52.397015] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.074 [2024-11-26 15:50:52.397032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.074 [2024-11-26 15:50:52.399292] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.074 [2024-11-26 15:50:52.408510] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.074 [2024-11-26 15:50:52.408808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.409053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.409088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.074 [2024-11-26 15:50:52.409123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.074 [2024-11-26 15:50:52.409306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.074 [2024-11-26 15:50:52.409477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.074 [2024-11-26 15:50:52.409501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.074 [2024-11-26 15:50:52.409517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.074 [2024-11-26 15:50:52.411805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.074 [2024-11-26 15:50:52.421136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.074 [2024-11-26 15:50:52.421450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.421600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.421629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.074 [2024-11-26 15:50:52.421648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.074 [2024-11-26 15:50:52.421830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.074 [2024-11-26 15:50:52.422001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.074 [2024-11-26 15:50:52.422025] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.074 [2024-11-26 15:50:52.422042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.074 [2024-11-26 15:50:52.424334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.074 [2024-11-26 15:50:52.433386] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.074 [2024-11-26 15:50:52.433674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.433811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.433842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.074 [2024-11-26 15:50:52.433860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.074 [2024-11-26 15:50:52.434062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.074 [2024-11-26 15:50:52.434251] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.074 [2024-11-26 15:50:52.434275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.074 [2024-11-26 15:50:52.434291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.074 [2024-11-26 15:50:52.436794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.074 [2024-11-26 15:50:52.446069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.074 [2024-11-26 15:50:52.446440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.446578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.446607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.074 [2024-11-26 15:50:52.446625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.074 [2024-11-26 15:50:52.446802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.074 [2024-11-26 15:50:52.446990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.074 [2024-11-26 15:50:52.447015] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.074 [2024-11-26 15:50:52.447032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.074 [2024-11-26 15:50:52.449291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.074 [2024-11-26 15:50:52.458769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.074 [2024-11-26 15:50:52.459110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.459257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.459304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.074 [2024-11-26 15:50:52.459322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.074 [2024-11-26 15:50:52.459505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.074 [2024-11-26 15:50:52.459679] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.074 [2024-11-26 15:50:52.459716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.074 [2024-11-26 15:50:52.459737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.074 [2024-11-26 15:50:52.462087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.074 [2024-11-26 15:50:52.471285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.074 [2024-11-26 15:50:52.471695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.471880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.074 [2024-11-26 15:50:52.471907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.074 [2024-11-26 15:50:52.471925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.074 [2024-11-26 15:50:52.472107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.074 [2024-11-26 15:50:52.472295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.075 [2024-11-26 15:50:52.472321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.075 [2024-11-26 15:50:52.472338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.075 [2024-11-26 15:50:52.474561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.075 [2024-11-26 15:50:52.483891] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.075 [2024-11-26 15:50:52.484255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.075 [2024-11-26 15:50:52.484360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.075 [2024-11-26 15:50:52.484385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.075 [2024-11-26 15:50:52.484400] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.075 [2024-11-26 15:50:52.484589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.075 [2024-11-26 15:50:52.484778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.075 [2024-11-26 15:50:52.484814] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.075 [2024-11-26 15:50:52.484830] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.075 [2024-11-26 15:50:52.487069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.075 [2024-11-26 15:50:52.496534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.075 [2024-11-26 15:50:52.496848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.075 [2024-11-26 15:50:52.496998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.075 [2024-11-26 15:50:52.497026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.075 [2024-11-26 15:50:52.497043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.075 [2024-11-26 15:50:52.497202] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.075 [2024-11-26 15:50:52.497383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.075 [2024-11-26 15:50:52.497414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.075 [2024-11-26 15:50:52.497431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.075 [2024-11-26 15:50:52.499676] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.075 [2024-11-26 15:50:52.509073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.075 [2024-11-26 15:50:52.509461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.075 [2024-11-26 15:50:52.509630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.075 [2024-11-26 15:50:52.509659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.075 [2024-11-26 15:50:52.509677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.075 [2024-11-26 15:50:52.509822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.075 [2024-11-26 15:50:52.509966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.075 [2024-11-26 15:50:52.510005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.075 [2024-11-26 15:50:52.510021] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.075 [2024-11-26 15:50:52.512318] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.338 [2024-11-26 15:50:52.521656] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.338 [2024-11-26 15:50:52.522077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.338 [2024-11-26 15:50:52.522179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.338 [2024-11-26 15:50:52.522204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.338 [2024-11-26 15:50:52.522221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.338 [2024-11-26 15:50:52.522403] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.338 [2024-11-26 15:50:52.522608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.338 [2024-11-26 15:50:52.522634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.338 [2024-11-26 15:50:52.522650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.338 [2024-11-26 15:50:52.524962] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.338 [2024-11-26 15:50:52.533954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.338 [2024-11-26 15:50:52.534370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.338 [2024-11-26 15:50:52.534565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.338 [2024-11-26 15:50:52.534594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.338 [2024-11-26 15:50:52.534612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.338 [2024-11-26 15:50:52.534769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.338 [2024-11-26 15:50:52.534921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.338 [2024-11-26 15:50:52.534944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.338 [2024-11-26 15:50:52.534965] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.338 [2024-11-26 15:50:52.537225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.338 [2024-11-26 15:50:52.546759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.338 [2024-11-26 15:50:52.547162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.338 [2024-11-26 15:50:52.547389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.338 [2024-11-26 15:50:52.547442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.338 [2024-11-26 15:50:52.547460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.338 [2024-11-26 15:50:52.547644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.338 [2024-11-26 15:50:52.547845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.338 [2024-11-26 15:50:52.547871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.338 [2024-11-26 15:50:52.547888] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.338 [2024-11-26 15:50:52.550204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.338 [2024-11-26 15:50:52.559295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.338 [2024-11-26 15:50:52.559644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.338 [2024-11-26 15:50:52.559780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.338 [2024-11-26 15:50:52.559810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.338 [2024-11-26 15:50:52.559828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.338 [2024-11-26 15:50:52.560012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.338 [2024-11-26 15:50:52.560182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.338 [2024-11-26 15:50:52.560207] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.338 [2024-11-26 15:50:52.560223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.338 [2024-11-26 15:50:52.562287] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.338 [2024-11-26 15:50:52.571898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.338 [2024-11-26 15:50:52.572270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.338 [2024-11-26 15:50:52.572455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.338 [2024-11-26 15:50:52.572481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.338 [2024-11-26 15:50:52.572498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.338 [2024-11-26 15:50:52.572700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.338 [2024-11-26 15:50:52.572908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.338 [2024-11-26 15:50:52.572932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.338 [2024-11-26 15:50:52.572948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.338 [2024-11-26 15:50:52.575116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.338 [2024-11-26 15:50:52.584267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.338 [2024-11-26 15:50:52.584667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.338 [2024-11-26 15:50:52.584881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.338 [2024-11-26 15:50:52.584925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.338 [2024-11-26 15:50:52.584943] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.338 [2024-11-26 15:50:52.585091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.338 [2024-11-26 15:50:52.585243] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.338 [2024-11-26 15:50:52.585267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.338 [2024-11-26 15:50:52.585283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.338 [2024-11-26 15:50:52.587505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.338 [2024-11-26 15:50:52.596918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.339 [2024-11-26 15:50:52.597203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.597390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.597418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.339 [2024-11-26 15:50:52.597434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.339 [2024-11-26 15:50:52.597653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.339 [2024-11-26 15:50:52.597849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.339 [2024-11-26 15:50:52.597876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.339 [2024-11-26 15:50:52.597892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.339 [2024-11-26 15:50:52.600280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.339 [2024-11-26 15:50:52.609564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.339 [2024-11-26 15:50:52.609886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.610101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.610151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.339 [2024-11-26 15:50:52.610170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.339 [2024-11-26 15:50:52.610300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.339 [2024-11-26 15:50:52.610450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.339 [2024-11-26 15:50:52.610475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.339 [2024-11-26 15:50:52.610491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.339 [2024-11-26 15:50:52.612857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.339 [2024-11-26 15:50:52.622049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.339 [2024-11-26 15:50:52.622372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.622547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.622576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.339 [2024-11-26 15:50:52.622593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.339 [2024-11-26 15:50:52.622773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.339 [2024-11-26 15:50:52.622942] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.339 [2024-11-26 15:50:52.622967] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.339 [2024-11-26 15:50:52.622983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.339 [2024-11-26 15:50:52.625200] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.339 [2024-11-26 15:50:52.634468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.339 [2024-11-26 15:50:52.634830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.634990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.635018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.339 [2024-11-26 15:50:52.635036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.339 [2024-11-26 15:50:52.635220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.339 [2024-11-26 15:50:52.635406] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.339 [2024-11-26 15:50:52.635432] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.339 [2024-11-26 15:50:52.635448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.339 [2024-11-26 15:50:52.637756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.339 [2024-11-26 15:50:52.647105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.339 [2024-11-26 15:50:52.647492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.647634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.647664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.339 [2024-11-26 15:50:52.647682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.339 [2024-11-26 15:50:52.647824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.339 [2024-11-26 15:50:52.648029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.339 [2024-11-26 15:50:52.648055] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.339 [2024-11-26 15:50:52.648071] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.339 [2024-11-26 15:50:52.650440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.339 [2024-11-26 15:50:52.659727] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.339 [2024-11-26 15:50:52.660155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.660356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.660384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.339 [2024-11-26 15:50:52.660403] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.339 [2024-11-26 15:50:52.660587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.339 [2024-11-26 15:50:52.660768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.339 [2024-11-26 15:50:52.660794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.339 [2024-11-26 15:50:52.660811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.339 [2024-11-26 15:50:52.663086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.339 [2024-11-26 15:50:52.672156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.339 [2024-11-26 15:50:52.672473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.672615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.672642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.339 [2024-11-26 15:50:52.672659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.339 [2024-11-26 15:50:52.672871] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.339 [2024-11-26 15:50:52.673023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.339 [2024-11-26 15:50:52.673048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.339 [2024-11-26 15:50:52.673065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.339 [2024-11-26 15:50:52.675348] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.339 [2024-11-26 15:50:52.684880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.339 [2024-11-26 15:50:52.685213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.685324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.685352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.339 [2024-11-26 15:50:52.685369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.339 [2024-11-26 15:50:52.685516] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.339 [2024-11-26 15:50:52.685699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.339 [2024-11-26 15:50:52.685724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.339 [2024-11-26 15:50:52.685739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.339 [2024-11-26 15:50:52.688091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.339 [2024-11-26 15:50:52.697424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.339 [2024-11-26 15:50:52.697726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.697874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.697932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.339 [2024-11-26 15:50:52.697950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.339 [2024-11-26 15:50:52.698121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.339 [2024-11-26 15:50:52.698304] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.339 [2024-11-26 15:50:52.698329] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.339 [2024-11-26 15:50:52.698344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.339 [2024-11-26 15:50:52.700764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.339 [2024-11-26 15:50:52.710022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.339 [2024-11-26 15:50:52.710482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.710658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.339 [2024-11-26 15:50:52.710707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.340 [2024-11-26 15:50:52.710726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.340 [2024-11-26 15:50:52.710852] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.340 [2024-11-26 15:50:52.711045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.340 [2024-11-26 15:50:52.711069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.340 [2024-11-26 15:50:52.711085] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.340 [2024-11-26 15:50:52.713454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.340 [2024-11-26 15:50:52.722562] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.340 [2024-11-26 15:50:52.722919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.340 [2024-11-26 15:50:52.723082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.340 [2024-11-26 15:50:52.723110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.340 [2024-11-26 15:50:52.723128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.340 [2024-11-26 15:50:52.723329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.340 [2024-11-26 15:50:52.723480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.340 [2024-11-26 15:50:52.723505] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.340 [2024-11-26 15:50:52.723522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.340 [2024-11-26 15:50:52.725902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.340 [2024-11-26 15:50:52.735181] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.340 [2024-11-26 15:50:52.735514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.340 [2024-11-26 15:50:52.735749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.340 [2024-11-26 15:50:52.735779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.340 [2024-11-26 15:50:52.735802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.340 [2024-11-26 15:50:52.735970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.340 [2024-11-26 15:50:52.736084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.340 [2024-11-26 15:50:52.736106] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.340 [2024-11-26 15:50:52.736122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.340 [2024-11-26 15:50:52.738551] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.340 [2024-11-26 15:50:52.747399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.340 [2024-11-26 15:50:52.747729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.340 [2024-11-26 15:50:52.747878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.340 [2024-11-26 15:50:52.747909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.340 [2024-11-26 15:50:52.747927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.340 [2024-11-26 15:50:52.748076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.340 [2024-11-26 15:50:52.748244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.340 [2024-11-26 15:50:52.748270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.340 [2024-11-26 15:50:52.748287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.340 [2024-11-26 15:50:52.750575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.340 [2024-11-26 15:50:52.759747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.340 [2024-11-26 15:50:52.760041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.340 [2024-11-26 15:50:52.760193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.340 [2024-11-26 15:50:52.760220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.340 [2024-11-26 15:50:52.760236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.340 [2024-11-26 15:50:52.760424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.340 [2024-11-26 15:50:52.760606] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.340 [2024-11-26 15:50:52.760631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.340 [2024-11-26 15:50:52.760648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.340 [2024-11-26 15:50:52.762904] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.340 [2024-11-26 15:50:52.772332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.340 [2024-11-26 15:50:52.772718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.340 [2024-11-26 15:50:52.772847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.340 [2024-11-26 15:50:52.772877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.340 [2024-11-26 15:50:52.772896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.340 [2024-11-26 15:50:52.773049] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.340 [2024-11-26 15:50:52.773219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.340 [2024-11-26 15:50:52.773244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.340 [2024-11-26 15:50:52.773260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.340 [2024-11-26 15:50:52.775957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.601 [2024-11-26 15:50:52.784920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.601 [2024-11-26 15:50:52.785239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.601 [2024-11-26 15:50:52.785391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.601 [2024-11-26 15:50:52.785421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.601 [2024-11-26 15:50:52.785439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.601 [2024-11-26 15:50:52.785623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.601 [2024-11-26 15:50:52.785824] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.601 [2024-11-26 15:50:52.785851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.601 [2024-11-26 15:50:52.785867] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.601 [2024-11-26 15:50:52.788400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.601 [2024-11-26 15:50:52.797414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.601 [2024-11-26 15:50:52.797784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.601 [2024-11-26 15:50:52.797958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.601 [2024-11-26 15:50:52.797988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.601 [2024-11-26 15:50:52.798006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.601 [2024-11-26 15:50:52.798136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.601 [2024-11-26 15:50:52.798304] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.601 [2024-11-26 15:50:52.798330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.601 [2024-11-26 15:50:52.798347] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.601 [2024-11-26 15:50:52.800644] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.601 [2024-11-26 15:50:52.809973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.601 [2024-11-26 15:50:52.810308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.601 [2024-11-26 15:50:52.810471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.601 [2024-11-26 15:50:52.810497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.601 [2024-11-26 15:50:52.810527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.601 [2024-11-26 15:50:52.810761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.601 [2024-11-26 15:50:52.810911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.601 [2024-11-26 15:50:52.810938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.601 [2024-11-26 15:50:52.810953] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.601 [2024-11-26 15:50:52.813323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.602 [2024-11-26 15:50:52.822765] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.602 [2024-11-26 15:50:52.823144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.823284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.823310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.602 [2024-11-26 15:50:52.823325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.602 [2024-11-26 15:50:52.823513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.602 [2024-11-26 15:50:52.823665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.602 [2024-11-26 15:50:52.823702] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.602 [2024-11-26 15:50:52.823721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.602 [2024-11-26 15:50:52.826073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.602 [2024-11-26 15:50:52.835238] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.602 [2024-11-26 15:50:52.835583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.835772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.835816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.602 [2024-11-26 15:50:52.835834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.602 [2024-11-26 15:50:52.835963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.602 [2024-11-26 15:50:52.836095] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.602 [2024-11-26 15:50:52.836118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.602 [2024-11-26 15:50:52.836135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.602 [2024-11-26 15:50:52.838520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.602 [2024-11-26 15:50:52.847953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.602 [2024-11-26 15:50:52.848309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.848458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.848486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.602 [2024-11-26 15:50:52.848504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.602 [2024-11-26 15:50:52.848651] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.602 [2024-11-26 15:50:52.848797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.602 [2024-11-26 15:50:52.848827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.602 [2024-11-26 15:50:52.848844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.602 [2024-11-26 15:50:52.851211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.602 [2024-11-26 15:50:52.860622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.602 [2024-11-26 15:50:52.860922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.861124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.861166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.602 [2024-11-26 15:50:52.861183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.602 [2024-11-26 15:50:52.861361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.602 [2024-11-26 15:50:52.861513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.602 [2024-11-26 15:50:52.861538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.602 [2024-11-26 15:50:52.861554] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.602 [2024-11-26 15:50:52.863847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.602 [2024-11-26 15:50:52.873022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.602 [2024-11-26 15:50:52.873397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.873588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.873614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.602 [2024-11-26 15:50:52.873630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.602 [2024-11-26 15:50:52.873864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.602 [2024-11-26 15:50:52.873998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.602 [2024-11-26 15:50:52.874023] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.602 [2024-11-26 15:50:52.874039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.602 [2024-11-26 15:50:52.876389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.602 [2024-11-26 15:50:52.885598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.602 [2024-11-26 15:50:52.885998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.886238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.886303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.602 [2024-11-26 15:50:52.886322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.602 [2024-11-26 15:50:52.886469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.602 [2024-11-26 15:50:52.886657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.602 [2024-11-26 15:50:52.886681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.602 [2024-11-26 15:50:52.886714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.602 [2024-11-26 15:50:52.889120] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.602 [2024-11-26 15:50:52.898206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.602 [2024-11-26 15:50:52.898531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.898694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.898749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.602 [2024-11-26 15:50:52.898767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.602 [2024-11-26 15:50:52.898914] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.602 [2024-11-26 15:50:52.899071] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.602 [2024-11-26 15:50:52.899095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.602 [2024-11-26 15:50:52.899110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.602 [2024-11-26 15:50:52.901408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.602 [2024-11-26 15:50:52.910967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.602 [2024-11-26 15:50:52.911434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.911633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.911662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.602 [2024-11-26 15:50:52.911680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.602 [2024-11-26 15:50:52.911820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.602 [2024-11-26 15:50:52.912025] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.602 [2024-11-26 15:50:52.912049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.602 [2024-11-26 15:50:52.912065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.602 [2024-11-26 15:50:52.914363] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.602 [2024-11-26 15:50:52.923678] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.602 [2024-11-26 15:50:52.923999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.924243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.924294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.602 [2024-11-26 15:50:52.924312] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.602 [2024-11-26 15:50:52.924477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.602 [2024-11-26 15:50:52.924664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.602 [2024-11-26 15:50:52.924700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.602 [2024-11-26 15:50:52.924718] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.602 [2024-11-26 15:50:52.926836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.602 [2024-11-26 15:50:52.936201] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.602 [2024-11-26 15:50:52.936541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.602 [2024-11-26 15:50:52.936741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:52.936771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.603 [2024-11-26 15:50:52.936789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.603 [2024-11-26 15:50:52.936955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.603 [2024-11-26 15:50:52.937126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.603 [2024-11-26 15:50:52.937146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.603 [2024-11-26 15:50:52.937160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.603 [2024-11-26 15:50:52.939332] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.603 [2024-11-26 15:50:52.948696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.603 [2024-11-26 15:50:52.949024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:52.949258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:52.949285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.603 [2024-11-26 15:50:52.949316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.603 [2024-11-26 15:50:52.949448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.603 [2024-11-26 15:50:52.949600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.603 [2024-11-26 15:50:52.949623] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.603 [2024-11-26 15:50:52.949639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.603 [2024-11-26 15:50:52.951924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.603 [2024-11-26 15:50:52.961230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.603 [2024-11-26 15:50:52.961595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:52.961781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:52.961808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.603 [2024-11-26 15:50:52.961825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.603 [2024-11-26 15:50:52.961973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.603 [2024-11-26 15:50:52.962159] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.603 [2024-11-26 15:50:52.962184] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.603 [2024-11-26 15:50:52.962200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.603 [2024-11-26 15:50:52.964717] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.603 [2024-11-26 15:50:52.973977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.603 [2024-11-26 15:50:52.974322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:52.974436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:52.974462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.603 [2024-11-26 15:50:52.974478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.603 [2024-11-26 15:50:52.974699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.603 [2024-11-26 15:50:52.974888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.603 [2024-11-26 15:50:52.974910] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.603 [2024-11-26 15:50:52.974924] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.603 [2024-11-26 15:50:52.977304] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.603 [2024-11-26 15:50:52.986533] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.603 [2024-11-26 15:50:52.986836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:52.986967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:52.986993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.603 [2024-11-26 15:50:52.987010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.603 [2024-11-26 15:50:52.987169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.603 [2024-11-26 15:50:52.987374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.603 [2024-11-26 15:50:52.987399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.603 [2024-11-26 15:50:52.987415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.603 [2024-11-26 15:50:52.989590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.603 [2024-11-26 15:50:52.998870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.603 [2024-11-26 15:50:52.999220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:52.999373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:52.999403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.603 [2024-11-26 15:50:52.999422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.603 [2024-11-26 15:50:52.999569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.603 [2024-11-26 15:50:52.999711] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.603 [2024-11-26 15:50:52.999752] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.603 [2024-11-26 15:50:52.999767] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.603 [2024-11-26 15:50:53.002040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.603 [2024-11-26 15:50:53.011645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.603 [2024-11-26 15:50:53.011964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:53.012131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:53.012162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.603 [2024-11-26 15:50:53.012181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.603 [2024-11-26 15:50:53.012328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.603 [2024-11-26 15:50:53.012516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.603 [2024-11-26 15:50:53.012541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.603 [2024-11-26 15:50:53.012557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.603 [2024-11-26 15:50:53.014931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.603 [2024-11-26 15:50:53.024286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.603 [2024-11-26 15:50:53.024606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:53.024782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:53.024811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.603 [2024-11-26 15:50:53.024828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.603 [2024-11-26 15:50:53.025012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.603 [2024-11-26 15:50:53.025165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.603 [2024-11-26 15:50:53.025189] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.603 [2024-11-26 15:50:53.025205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.603 [2024-11-26 15:50:53.027629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.603 [2024-11-26 15:50:53.037060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.603 [2024-11-26 15:50:53.037368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:53.037535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.603 [2024-11-26 15:50:53.037565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.603 [2024-11-26 15:50:53.037583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.603 [2024-11-26 15:50:53.037789] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.603 [2024-11-26 15:50:53.037943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.603 [2024-11-26 15:50:53.037965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.603 [2024-11-26 15:50:53.037997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.603 [2024-11-26 15:50:53.040310] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.864 [2024-11-26 15:50:53.049591] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.864 [2024-11-26 15:50:53.049879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.864 [2024-11-26 15:50:53.050003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.864 [2024-11-26 15:50:53.050050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.864 [2024-11-26 15:50:53.050068] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.864 [2024-11-26 15:50:53.050227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.864 [2024-11-26 15:50:53.050397] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.864 [2024-11-26 15:50:53.050421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.864 [2024-11-26 15:50:53.050437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.864 [2024-11-26 15:50:53.052787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.864 [2024-11-26 15:50:53.062213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.864 [2024-11-26 15:50:53.062528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.864 [2024-11-26 15:50:53.062705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.864 [2024-11-26 15:50:53.062756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.864 [2024-11-26 15:50:53.062774] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.864 [2024-11-26 15:50:53.062923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.864 [2024-11-26 15:50:53.063110] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.864 [2024-11-26 15:50:53.063134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.864 [2024-11-26 15:50:53.063151] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.864 [2024-11-26 15:50:53.065547] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.864 [2024-11-26 15:50:53.074587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.864 [2024-11-26 15:50:53.074941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.864 [2024-11-26 15:50:53.075094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.864 [2024-11-26 15:50:53.075126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.864 [2024-11-26 15:50:53.075144] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.864 [2024-11-26 15:50:53.075346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.864 [2024-11-26 15:50:53.075480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.864 [2024-11-26 15:50:53.075504] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.864 [2024-11-26 15:50:53.075520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.864 [2024-11-26 15:50:53.077814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.864 [2024-11-26 15:50:53.087155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.864 [2024-11-26 15:50:53.087462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.864 [2024-11-26 15:50:53.087651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.864 [2024-11-26 15:50:53.087678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.864 [2024-11-26 15:50:53.087727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.864 [2024-11-26 15:50:53.087912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.864 [2024-11-26 15:50:53.088099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.864 [2024-11-26 15:50:53.088124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.864 [2024-11-26 15:50:53.088140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.864 [2024-11-26 15:50:53.090403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.864 [2024-11-26 15:50:53.099858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.864 [2024-11-26 15:50:53.100155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.864 [2024-11-26 15:50:53.100303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.864 [2024-11-26 15:50:53.100333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.864 [2024-11-26 15:50:53.100351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.864 [2024-11-26 15:50:53.100498] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.864 [2024-11-26 15:50:53.100649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.864 [2024-11-26 15:50:53.100674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.864 [2024-11-26 15:50:53.100704] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.864 [2024-11-26 15:50:53.103063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.864 [2024-11-26 15:50:53.112229] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.864 [2024-11-26 15:50:53.112630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.864 [2024-11-26 15:50:53.112804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.864 [2024-11-26 15:50:53.112835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.865 [2024-11-26 15:50:53.112853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.865 [2024-11-26 15:50:53.113019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.865 [2024-11-26 15:50:53.113152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.865 [2024-11-26 15:50:53.113177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.865 [2024-11-26 15:50:53.113193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.865 [2024-11-26 15:50:53.115615] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.865 [2024-11-26 15:50:53.124794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.865 [2024-11-26 15:50:53.125217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.125472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.125497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.865 [2024-11-26 15:50:53.125512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.865 [2024-11-26 15:50:53.125751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.865 [2024-11-26 15:50:53.125941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.865 [2024-11-26 15:50:53.125965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.865 [2024-11-26 15:50:53.125981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.865 [2024-11-26 15:50:53.128347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.865 [2024-11-26 15:50:53.137453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.865 [2024-11-26 15:50:53.137788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.138026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.138075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.865 [2024-11-26 15:50:53.138094] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.865 [2024-11-26 15:50:53.138313] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.865 [2024-11-26 15:50:53.138519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.865 [2024-11-26 15:50:53.138543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.865 [2024-11-26 15:50:53.138558] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.865 [2024-11-26 15:50:53.140922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.865 [2024-11-26 15:50:53.149947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.865 [2024-11-26 15:50:53.150308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.150462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.150492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.865 [2024-11-26 15:50:53.150510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.865 [2024-11-26 15:50:53.150708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.865 [2024-11-26 15:50:53.150882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.865 [2024-11-26 15:50:53.150907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.865 [2024-11-26 15:50:53.150923] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.865 [2024-11-26 15:50:53.153271] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.865 [2024-11-26 15:50:53.162612] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.865 [2024-11-26 15:50:53.162994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.163233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.163281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.865 [2024-11-26 15:50:53.163299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.865 [2024-11-26 15:50:53.163482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.865 [2024-11-26 15:50:53.163640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.865 [2024-11-26 15:50:53.163664] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.865 [2024-11-26 15:50:53.163680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.865 [2024-11-26 15:50:53.165956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.865 [2024-11-26 15:50:53.175422] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.865 [2024-11-26 15:50:53.175755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.175906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.175937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.865 [2024-11-26 15:50:53.175955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.865 [2024-11-26 15:50:53.176157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.865 [2024-11-26 15:50:53.176345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.865 [2024-11-26 15:50:53.176370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.865 [2024-11-26 15:50:53.176386] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.865 [2024-11-26 15:50:53.178843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.865 [2024-11-26 15:50:53.188049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.865 [2024-11-26 15:50:53.188392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.188547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.188574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.865 [2024-11-26 15:50:53.188591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.865 [2024-11-26 15:50:53.188783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.865 [2024-11-26 15:50:53.188947] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.865 [2024-11-26 15:50:53.188972] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.865 [2024-11-26 15:50:53.188988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.865 [2024-11-26 15:50:53.191425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.865 [2024-11-26 15:50:53.200658] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.865 [2024-11-26 15:50:53.201023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.201165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.201191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.865 [2024-11-26 15:50:53.201222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.865 [2024-11-26 15:50:53.201394] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.865 [2024-11-26 15:50:53.201561] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.865 [2024-11-26 15:50:53.201590] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.865 [2024-11-26 15:50:53.201607] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.865 [2024-11-26 15:50:53.203901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.865 [2024-11-26 15:50:53.213267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.865 [2024-11-26 15:50:53.213602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.213841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.213869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.865 [2024-11-26 15:50:53.213900] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.865 [2024-11-26 15:50:53.214072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.865 [2024-11-26 15:50:53.214260] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.865 [2024-11-26 15:50:53.214284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.865 [2024-11-26 15:50:53.214300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.865 [2024-11-26 15:50:53.216595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.865 [2024-11-26 15:50:53.225861] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.865 [2024-11-26 15:50:53.226208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.226425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.865 [2024-11-26 15:50:53.226455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.865 [2024-11-26 15:50:53.226473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.865 [2024-11-26 15:50:53.226656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.865 [2024-11-26 15:50:53.226878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.865 [2024-11-26 15:50:53.226904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.866 [2024-11-26 15:50:53.226920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.866 [2024-11-26 15:50:53.229269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.866 [2024-11-26 15:50:53.238257] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.866 [2024-11-26 15:50:53.238586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.866 [2024-11-26 15:50:53.238740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.866 [2024-11-26 15:50:53.238771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.866 [2024-11-26 15:50:53.238789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.866 [2024-11-26 15:50:53.238938] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.866 [2024-11-26 15:50:53.239108] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.866 [2024-11-26 15:50:53.239132] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.866 [2024-11-26 15:50:53.239157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.866 [2024-11-26 15:50:53.241452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.866 [2024-11-26 15:50:53.250848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.866 [2024-11-26 15:50:53.251228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.866 [2024-11-26 15:50:53.251415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.866 [2024-11-26 15:50:53.251465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.866 [2024-11-26 15:50:53.251485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.866 [2024-11-26 15:50:53.251644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.866 [2024-11-26 15:50:53.251865] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.866 [2024-11-26 15:50:53.251898] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.866 [2024-11-26 15:50:53.251918] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.866 [2024-11-26 15:50:53.254472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.866 [2024-11-26 15:50:53.263539] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.866 [2024-11-26 15:50:53.263894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.866 [2024-11-26 15:50:53.264024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.866 [2024-11-26 15:50:53.264055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.866 [2024-11-26 15:50:53.264074] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.866 [2024-11-26 15:50:53.264276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.866 [2024-11-26 15:50:53.264500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.866 [2024-11-26 15:50:53.264524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.866 [2024-11-26 15:50:53.264540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.866 [2024-11-26 15:50:53.266729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.866 [2024-11-26 15:50:53.276140] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.866 [2024-11-26 15:50:53.276472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.866 [2024-11-26 15:50:53.276627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.866 [2024-11-26 15:50:53.276653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.866 [2024-11-26 15:50:53.276692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.866 [2024-11-26 15:50:53.276840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.866 [2024-11-26 15:50:53.276989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.866 [2024-11-26 15:50:53.277013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.866 [2024-11-26 15:50:53.277029] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.866 [2024-11-26 15:50:53.279392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.866 [2024-11-26 15:50:53.288556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.866 [2024-11-26 15:50:53.288871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.866 [2024-11-26 15:50:53.289023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.866 [2024-11-26 15:50:53.289053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.866 [2024-11-26 15:50:53.289071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.866 [2024-11-26 15:50:53.289292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.866 [2024-11-26 15:50:53.289515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.866 [2024-11-26 15:50:53.289539] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.866 [2024-11-26 15:50:53.289555] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.866 [2024-11-26 15:50:53.291714] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.866 [2024-11-26 15:50:53.301134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.866 [2024-11-26 15:50:53.301485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.866 [2024-11-26 15:50:53.301629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.866 [2024-11-26 15:50:53.301658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:01.866 [2024-11-26 15:50:53.301677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:01.866 [2024-11-26 15:50:53.301873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:01.866 [2024-11-26 15:50:53.302060] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.866 [2024-11-26 15:50:53.302084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.866 [2024-11-26 15:50:53.302100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.866 [2024-11-26 15:50:53.304433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.127 [2024-11-26 15:50:53.313621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.127 [2024-11-26 15:50:53.313971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.127 [2024-11-26 15:50:53.314135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.127 [2024-11-26 15:50:53.314185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.127 [2024-11-26 15:50:53.314205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.127 [2024-11-26 15:50:53.314406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.127 [2024-11-26 15:50:53.314594] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.127 [2024-11-26 15:50:53.314618] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.127 [2024-11-26 15:50:53.314634] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.127 [2024-11-26 15:50:53.317031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.127 [2024-11-26 15:50:53.326236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.127 [2024-11-26 15:50:53.326548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.127 [2024-11-26 15:50:53.326707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.127 [2024-11-26 15:50:53.326735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.127 [2024-11-26 15:50:53.326752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.127 [2024-11-26 15:50:53.326865] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.127 [2024-11-26 15:50:53.327066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.127 [2024-11-26 15:50:53.327090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.127 [2024-11-26 15:50:53.327107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.127 [2024-11-26 15:50:53.329347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.127 [2024-11-26 15:50:53.338858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.127 [2024-11-26 15:50:53.339248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.127 [2024-11-26 15:50:53.339439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.127 [2024-11-26 15:50:53.339488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.127 [2024-11-26 15:50:53.339506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.127 [2024-11-26 15:50:53.339635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.127 [2024-11-26 15:50:53.339850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.127 [2024-11-26 15:50:53.339875] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.127 [2024-11-26 15:50:53.339891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.127 [2024-11-26 15:50:53.342147] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.127 [2024-11-26 15:50:53.351705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.127 [2024-11-26 15:50:53.352001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.127 [2024-11-26 15:50:53.352251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.127 [2024-11-26 15:50:53.352286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.127 [2024-11-26 15:50:53.352321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.127 [2024-11-26 15:50:53.352487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.127 [2024-11-26 15:50:53.352656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.127 [2024-11-26 15:50:53.352680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.127 [2024-11-26 15:50:53.352708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.127 [2024-11-26 15:50:53.355150] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.127 [2024-11-26 15:50:53.364142] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.127 [2024-11-26 15:50:53.364501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.127 [2024-11-26 15:50:53.364693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.364723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.128 [2024-11-26 15:50:53.364742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.128 [2024-11-26 15:50:53.364925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.128 [2024-11-26 15:50:53.365077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.128 [2024-11-26 15:50:53.365101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.128 [2024-11-26 15:50:53.365118] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.128 [2024-11-26 15:50:53.367413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.128 [2024-11-26 15:50:53.376785] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.128 [2024-11-26 15:50:53.377158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.377332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.377362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.128 [2024-11-26 15:50:53.377381] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.128 [2024-11-26 15:50:53.377546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.128 [2024-11-26 15:50:53.377679] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.128 [2024-11-26 15:50:53.377714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.128 [2024-11-26 15:50:53.377731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.128 [2024-11-26 15:50:53.380080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.128 [2024-11-26 15:50:53.389454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.128 [2024-11-26 15:50:53.389803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.390043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.390104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.128 [2024-11-26 15:50:53.390122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.128 [2024-11-26 15:50:53.390288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.128 [2024-11-26 15:50:53.390475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.128 [2024-11-26 15:50:53.390499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.128 [2024-11-26 15:50:53.390515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.128 [2024-11-26 15:50:53.392628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.128 [2024-11-26 15:50:53.402136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.128 [2024-11-26 15:50:53.402458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.402658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.402712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.128 [2024-11-26 15:50:53.402730] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.128 [2024-11-26 15:50:53.402885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.128 [2024-11-26 15:50:53.403047] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.128 [2024-11-26 15:50:53.403071] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.128 [2024-11-26 15:50:53.403088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.128 [2024-11-26 15:50:53.405436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.128 [2024-11-26 15:50:53.414617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.128 [2024-11-26 15:50:53.414912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.415058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.415087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.128 [2024-11-26 15:50:53.415105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.128 [2024-11-26 15:50:53.415306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.128 [2024-11-26 15:50:53.415494] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.128 [2024-11-26 15:50:53.415518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.128 [2024-11-26 15:50:53.415535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.128 [2024-11-26 15:50:53.417841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.128 [2024-11-26 15:50:53.427282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.128 [2024-11-26 15:50:53.427690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.427881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.427907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.128 [2024-11-26 15:50:53.427924] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.128 [2024-11-26 15:50:53.428113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.128 [2024-11-26 15:50:53.428301] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.128 [2024-11-26 15:50:53.428324] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.128 [2024-11-26 15:50:53.428341] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.128 [2024-11-26 15:50:53.430770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.128 [2024-11-26 15:50:53.440042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.128 [2024-11-26 15:50:53.440373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.440564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.440593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.128 [2024-11-26 15:50:53.440617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.128 [2024-11-26 15:50:53.440851] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.128 [2024-11-26 15:50:53.441021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.128 [2024-11-26 15:50:53.441044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.128 [2024-11-26 15:50:53.441061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.128 [2024-11-26 15:50:53.443592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.128 [2024-11-26 15:50:53.452566] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.128 [2024-11-26 15:50:53.452927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.453102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.453131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.128 [2024-11-26 15:50:53.453149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.128 [2024-11-26 15:50:53.453296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.128 [2024-11-26 15:50:53.453430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.128 [2024-11-26 15:50:53.453454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.128 [2024-11-26 15:50:53.453470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.128 [2024-11-26 15:50:53.455657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.128 [2024-11-26 15:50:53.465261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.128 [2024-11-26 15:50:53.465661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.465838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.465867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.128 [2024-11-26 15:50:53.465885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.128 [2024-11-26 15:50:53.466068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.128 [2024-11-26 15:50:53.466238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.128 [2024-11-26 15:50:53.466262] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.128 [2024-11-26 15:50:53.466279] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.128 [2024-11-26 15:50:53.468430] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.128 [2024-11-26 15:50:53.477827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.128 [2024-11-26 15:50:53.478185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.478332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.128 [2024-11-26 15:50:53.478362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.128 [2024-11-26 15:50:53.478380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.128 [2024-11-26 15:50:53.478515] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.129 [2024-11-26 15:50:53.478695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.129 [2024-11-26 15:50:53.478720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.129 [2024-11-26 15:50:53.478736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.129 [2024-11-26 15:50:53.481120] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.129 [2024-11-26 15:50:53.490267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.129 [2024-11-26 15:50:53.490705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.129 [2024-11-26 15:50:53.490893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.129 [2024-11-26 15:50:53.490940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.129 [2024-11-26 15:50:53.490959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.129 [2024-11-26 15:50:53.491160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.129 [2024-11-26 15:50:53.491347] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.129 [2024-11-26 15:50:53.491372] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.129 [2024-11-26 15:50:53.491388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.129 [2024-11-26 15:50:53.493797] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.129 [2024-11-26 15:50:53.502678] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.129 [2024-11-26 15:50:53.503002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.129 [2024-11-26 15:50:53.503179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.129 [2024-11-26 15:50:53.503215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.129 [2024-11-26 15:50:53.503235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.129 [2024-11-26 15:50:53.503366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.129 [2024-11-26 15:50:53.503569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.129 [2024-11-26 15:50:53.503596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.129 [2024-11-26 15:50:53.503612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.129 [2024-11-26 15:50:53.506059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.129 [2024-11-26 15:50:53.515266] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.129 [2024-11-26 15:50:53.515706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.129 [2024-11-26 15:50:53.515878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.129 [2024-11-26 15:50:53.515908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.129 [2024-11-26 15:50:53.515926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.129 [2024-11-26 15:50:53.516091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.129 [2024-11-26 15:50:53.516286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.129 [2024-11-26 15:50:53.516311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.129 [2024-11-26 15:50:53.516327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.129 [2024-11-26 15:50:53.518788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.129 [2024-11-26 15:50:53.527725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.129 [2024-11-26 15:50:53.527995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.129 [2024-11-26 15:50:53.528152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.129 [2024-11-26 15:50:53.528182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.129 [2024-11-26 15:50:53.528200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.129 [2024-11-26 15:50:53.528365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.129 [2024-11-26 15:50:53.528553] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.129 [2024-11-26 15:50:53.528578] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.129 [2024-11-26 15:50:53.528594] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.129 [2024-11-26 15:50:53.530807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.129 [2024-11-26 15:50:53.540483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.129 [2024-11-26 15:50:53.540804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.129 [2024-11-26 15:50:53.541020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.129 [2024-11-26 15:50:53.541067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.129 [2024-11-26 15:50:53.541086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.129 [2024-11-26 15:50:53.541251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.129 [2024-11-26 15:50:53.541384] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.129 [2024-11-26 15:50:53.541409] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.129 [2024-11-26 15:50:53.541424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.129 [2024-11-26 15:50:53.543574] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.129 [2024-11-26 15:50:53.553011] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.129 [2024-11-26 15:50:53.553394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.129 [2024-11-26 15:50:53.553544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.129 [2024-11-26 15:50:53.553574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.129 [2024-11-26 15:50:53.553592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.129 [2024-11-26 15:50:53.553750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.129 [2024-11-26 15:50:53.553920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.129 [2024-11-26 15:50:53.553950] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.129 [2024-11-26 15:50:53.553967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.129 [2024-11-26 15:50:53.556188] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.129 [2024-11-26 15:50:53.565428] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.129 [2024-11-26 15:50:53.565745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.129 [2024-11-26 15:50:53.565897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.129 [2024-11-26 15:50:53.565927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.129 [2024-11-26 15:50:53.565944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.129 [2024-11-26 15:50:53.566128] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.129 [2024-11-26 15:50:53.566333] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.129 [2024-11-26 15:50:53.566357] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.129 [2024-11-26 15:50:53.566373] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.129 [2024-11-26 15:50:53.568710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.392 [2024-11-26 15:50:53.578194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.392 [2024-11-26 15:50:53.578531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.392 [2024-11-26 15:50:53.578675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.392 [2024-11-26 15:50:53.578714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.392 [2024-11-26 15:50:53.578732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.392 [2024-11-26 15:50:53.578880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.392 [2024-11-26 15:50:53.579086] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.392 [2024-11-26 15:50:53.579110] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.392 [2024-11-26 15:50:53.579126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.392 [2024-11-26 15:50:53.581401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.392 [2024-11-26 15:50:53.590703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.392 [2024-11-26 15:50:53.591093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.392 [2024-11-26 15:50:53.591298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.392 [2024-11-26 15:50:53.591329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.392 [2024-11-26 15:50:53.591347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.392 [2024-11-26 15:50:53.591477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.392 [2024-11-26 15:50:53.591664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.392 [2024-11-26 15:50:53.591698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.392 [2024-11-26 15:50:53.591723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.392 [2024-11-26 15:50:53.593964] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.392 [2024-11-26 15:50:53.603138] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.392 [2024-11-26 15:50:53.603618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.392 [2024-11-26 15:50:53.603856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.392 [2024-11-26 15:50:53.603886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.392 [2024-11-26 15:50:53.603904] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.392 [2024-11-26 15:50:53.604088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.392 [2024-11-26 15:50:53.604275] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.392 [2024-11-26 15:50:53.604299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.392 [2024-11-26 15:50:53.604315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.392 [2024-11-26 15:50:53.606646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.392 [2024-11-26 15:50:53.615747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.392 [2024-11-26 15:50:53.616042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.392 [2024-11-26 15:50:53.616302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.392 [2024-11-26 15:50:53.616329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.392 [2024-11-26 15:50:53.616344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.392 [2024-11-26 15:50:53.616519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.392 [2024-11-26 15:50:53.616723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.392 [2024-11-26 15:50:53.616748] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.392 [2024-11-26 15:50:53.616763] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.392 [2024-11-26 15:50:53.619040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.392 [2024-11-26 15:50:53.628290] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.392 [2024-11-26 15:50:53.628653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.392 [2024-11-26 15:50:53.628864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.392 [2024-11-26 15:50:53.628909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.392 [2024-11-26 15:50:53.628928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.392 [2024-11-26 15:50:53.629093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.392 [2024-11-26 15:50:53.629226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.392 [2024-11-26 15:50:53.629250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.392 [2024-11-26 15:50:53.629266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.392 [2024-11-26 15:50:53.631602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.392 [2024-11-26 15:50:53.640732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.392 [2024-11-26 15:50:53.641079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.392 [2024-11-26 15:50:53.641256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.392 [2024-11-26 15:50:53.641285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.392 [2024-11-26 15:50:53.641304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.392 [2024-11-26 15:50:53.641451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.392 [2024-11-26 15:50:53.641674] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.393 [2024-11-26 15:50:53.641707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.393 [2024-11-26 15:50:53.641724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.393 [2024-11-26 15:50:53.644107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.393 [2024-11-26 15:50:53.653348] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.393 [2024-11-26 15:50:53.653658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.653849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.653878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.393 [2024-11-26 15:50:53.653895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.393 [2024-11-26 15:50:53.654056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.393 [2024-11-26 15:50:53.654190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.393 [2024-11-26 15:50:53.654214] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.393 [2024-11-26 15:50:53.654231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.393 [2024-11-26 15:50:53.656349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.393 [2024-11-26 15:50:53.665880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.393 [2024-11-26 15:50:53.666214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.666403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.666430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.393 [2024-11-26 15:50:53.666446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.393 [2024-11-26 15:50:53.666642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.393 [2024-11-26 15:50:53.666859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.393 [2024-11-26 15:50:53.666885] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.393 [2024-11-26 15:50:53.666900] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.393 [2024-11-26 15:50:53.669141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.393 [2024-11-26 15:50:53.678438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.393 [2024-11-26 15:50:53.678764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.678909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.678936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.393 [2024-11-26 15:50:53.678969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.393 [2024-11-26 15:50:53.679099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.393 [2024-11-26 15:50:53.679286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.393 [2024-11-26 15:50:53.679309] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.393 [2024-11-26 15:50:53.679325] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.393 [2024-11-26 15:50:53.681639] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.393 [2024-11-26 15:50:53.690999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.393 [2024-11-26 15:50:53.691388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.691555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.691582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.393 [2024-11-26 15:50:53.691597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.393 [2024-11-26 15:50:53.691768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.393 [2024-11-26 15:50:53.691884] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.393 [2024-11-26 15:50:53.691908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.393 [2024-11-26 15:50:53.691925] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.393 [2024-11-26 15:50:53.694280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.393 [2024-11-26 15:50:53.703486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.393 [2024-11-26 15:50:53.703779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.703907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.703933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.393 [2024-11-26 15:50:53.703949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.393 [2024-11-26 15:50:53.704126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.393 [2024-11-26 15:50:53.704350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.393 [2024-11-26 15:50:53.704374] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.393 [2024-11-26 15:50:53.704391] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.393 [2024-11-26 15:50:53.706859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.393 [2024-11-26 15:50:53.716081] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.393 [2024-11-26 15:50:53.716401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.716526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.716555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.393 [2024-11-26 15:50:53.716573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.393 [2024-11-26 15:50:53.716720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.393 [2024-11-26 15:50:53.716854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.393 [2024-11-26 15:50:53.716879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.393 [2024-11-26 15:50:53.716895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.393 [2024-11-26 15:50:53.719070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.393 [2024-11-26 15:50:53.728598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.393 [2024-11-26 15:50:53.728919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.729077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.729108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.393 [2024-11-26 15:50:53.729126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.393 [2024-11-26 15:50:53.729292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.393 [2024-11-26 15:50:53.729479] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.393 [2024-11-26 15:50:53.729503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.393 [2024-11-26 15:50:53.729519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.393 [2024-11-26 15:50:53.731874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.393 [2024-11-26 15:50:53.741217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.393 [2024-11-26 15:50:53.741550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.741729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.741759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.393 [2024-11-26 15:50:53.741776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.393 [2024-11-26 15:50:53.741959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.393 [2024-11-26 15:50:53.742129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.393 [2024-11-26 15:50:53.742153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.393 [2024-11-26 15:50:53.742169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.393 [2024-11-26 15:50:53.744614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.393 [2024-11-26 15:50:53.753788] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.393 [2024-11-26 15:50:53.754257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.754487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.393 [2024-11-26 15:50:53.754523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.393 [2024-11-26 15:50:53.754546] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.393 [2024-11-26 15:50:53.754803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.393 [2024-11-26 15:50:53.755043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.393 [2024-11-26 15:50:53.755074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.393 [2024-11-26 15:50:53.755101] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.393 [2024-11-26 15:50:53.757680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.393 [2024-11-26 15:50:53.766417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.394 [2024-11-26 15:50:53.766742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.394 [2024-11-26 15:50:53.766895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.394 [2024-11-26 15:50:53.766926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.394 [2024-11-26 15:50:53.766944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.394 [2024-11-26 15:50:53.767164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.394 [2024-11-26 15:50:53.767369] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.394 [2024-11-26 15:50:53.767398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.394 [2024-11-26 15:50:53.767415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.394 [2024-11-26 15:50:53.769590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.394 [2024-11-26 15:50:53.779052] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.394 [2024-11-26 15:50:53.779424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.394 [2024-11-26 15:50:53.779573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.394 [2024-11-26 15:50:53.779603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.394 [2024-11-26 15:50:53.779621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.394 [2024-11-26 15:50:53.779866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.394 [2024-11-26 15:50:53.780026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.394 [2024-11-26 15:50:53.780064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.394 [2024-11-26 15:50:53.780080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.394 [2024-11-26 15:50:53.782297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.394 [2024-11-26 15:50:53.791710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.394 [2024-11-26 15:50:53.792017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.394 [2024-11-26 15:50:53.792183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.394 [2024-11-26 15:50:53.792230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.394 [2024-11-26 15:50:53.792256] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.394 [2024-11-26 15:50:53.792404] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.394 [2024-11-26 15:50:53.792610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.394 [2024-11-26 15:50:53.792634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.394 [2024-11-26 15:50:53.792650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.394 [2024-11-26 15:50:53.795026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.394 [2024-11-26 15:50:53.804491] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.394 [2024-11-26 15:50:53.804839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.394 [2024-11-26 15:50:53.805030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.394 [2024-11-26 15:50:53.805066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.394 [2024-11-26 15:50:53.805099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.394 [2024-11-26 15:50:53.805265] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.394 [2024-11-26 15:50:53.805399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.394 [2024-11-26 15:50:53.805424] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.394 [2024-11-26 15:50:53.805440] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.394 [2024-11-26 15:50:53.807872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.394 [2024-11-26 15:50:53.817044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.394 [2024-11-26 15:50:53.817464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.394 [2024-11-26 15:50:53.817581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.394 [2024-11-26 15:50:53.817612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.394 [2024-11-26 15:50:53.817630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.394 [2024-11-26 15:50:53.817805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.394 [2024-11-26 15:50:53.817994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.394 [2024-11-26 15:50:53.818019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.394 [2024-11-26 15:50:53.818036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.394 [2024-11-26 15:50:53.820497] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.394 [2024-11-26 15:50:53.829824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.394 [2024-11-26 15:50:53.830255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.394 [2024-11-26 15:50:53.830366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.394 [2024-11-26 15:50:53.830391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.394 [2024-11-26 15:50:53.830407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.394 [2024-11-26 15:50:53.830602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.394 [2024-11-26 15:50:53.830810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.394 [2024-11-26 15:50:53.830837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.394 [2024-11-26 15:50:53.830853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.394 [2024-11-26 15:50:53.833296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.655 [2024-11-26 15:50:53.842453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.655 [2024-11-26 15:50:53.842776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.655 [2024-11-26 15:50:53.842952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.655 [2024-11-26 15:50:53.842982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.655 [2024-11-26 15:50:53.843000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.655 [2024-11-26 15:50:53.843185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.655 [2024-11-26 15:50:53.843389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.655 [2024-11-26 15:50:53.843414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.655 [2024-11-26 15:50:53.843431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.655 [2024-11-26 15:50:53.845816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.655 [2024-11-26 15:50:53.854905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.655 [2024-11-26 15:50:53.855275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.655 [2024-11-26 15:50:53.855403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.655 [2024-11-26 15:50:53.855432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.655 [2024-11-26 15:50:53.855450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.655 [2024-11-26 15:50:53.855634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.655 [2024-11-26 15:50:53.855854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.655 [2024-11-26 15:50:53.855880] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.655 [2024-11-26 15:50:53.855897] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.655 [2024-11-26 15:50:53.858301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.655 [2024-11-26 15:50:53.867462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.655 [2024-11-26 15:50:53.867767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.655 [2024-11-26 15:50:53.867913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.655 [2024-11-26 15:50:53.867943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.655 [2024-11-26 15:50:53.867962] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.655 [2024-11-26 15:50:53.868129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.655 [2024-11-26 15:50:53.868304] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.655 [2024-11-26 15:50:53.868330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.655 [2024-11-26 15:50:53.868346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.655 [2024-11-26 15:50:53.870555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.655 [2024-11-26 15:50:53.880222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.655 [2024-11-26 15:50:53.880557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.655 [2024-11-26 15:50:53.880732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.655 [2024-11-26 15:50:53.880761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.655 [2024-11-26 15:50:53.880779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.655 [2024-11-26 15:50:53.880962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.655 [2024-11-26 15:50:53.881166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.655 [2024-11-26 15:50:53.881192] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.655 [2024-11-26 15:50:53.881208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.655 [2024-11-26 15:50:53.883327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.655 [2024-11-26 15:50:53.892958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.655 [2024-11-26 15:50:53.893322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.655 [2024-11-26 15:50:53.893470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.893501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.656 [2024-11-26 15:50:53.893519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.656 [2024-11-26 15:50:53.893696] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.656 [2024-11-26 15:50:53.893830] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.656 [2024-11-26 15:50:53.893863] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.656 [2024-11-26 15:50:53.893879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.656 [2024-11-26 15:50:53.896123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.656 [2024-11-26 15:50:53.905575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.656 [2024-11-26 15:50:53.905902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.906034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.906082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.656 [2024-11-26 15:50:53.906102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.656 [2024-11-26 15:50:53.906286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.656 [2024-11-26 15:50:53.906472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.656 [2024-11-26 15:50:53.906503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.656 [2024-11-26 15:50:53.906520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.656 [2024-11-26 15:50:53.908938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.656 [2024-11-26 15:50:53.917864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.656 [2024-11-26 15:50:53.918236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.918464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.918494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.656 [2024-11-26 15:50:53.918513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.656 [2024-11-26 15:50:53.918711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.656 [2024-11-26 15:50:53.918935] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.656 [2024-11-26 15:50:53.918960] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.656 [2024-11-26 15:50:53.918976] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.656 [2024-11-26 15:50:53.921345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.656 [2024-11-26 15:50:53.930450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.656 [2024-11-26 15:50:53.930802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.930953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.930981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.656 [2024-11-26 15:50:53.931000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.656 [2024-11-26 15:50:53.931147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.656 [2024-11-26 15:50:53.931297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.656 [2024-11-26 15:50:53.931321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.656 [2024-11-26 15:50:53.931336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.656 [2024-11-26 15:50:53.933674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.656 [2024-11-26 15:50:53.942973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.656 [2024-11-26 15:50:53.943264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.943413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.943444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.656 [2024-11-26 15:50:53.943463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.656 [2024-11-26 15:50:53.943593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.656 [2024-11-26 15:50:53.943777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.656 [2024-11-26 15:50:53.943801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.656 [2024-11-26 15:50:53.943823] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.656 [2024-11-26 15:50:53.946214] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.656 [2024-11-26 15:50:53.955683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.656 [2024-11-26 15:50:53.955981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.956127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.956157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.656 [2024-11-26 15:50:53.956176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.656 [2024-11-26 15:50:53.956324] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.656 [2024-11-26 15:50:53.956419] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.656 [2024-11-26 15:50:53.956442] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.656 [2024-11-26 15:50:53.956457] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.656 [2024-11-26 15:50:53.958614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.656 [2024-11-26 15:50:53.968368] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.656 [2024-11-26 15:50:53.968714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.968892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.968920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.656 [2024-11-26 15:50:53.968938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.656 [2024-11-26 15:50:53.969140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.656 [2024-11-26 15:50:53.969327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.656 [2024-11-26 15:50:53.969352] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.656 [2024-11-26 15:50:53.969368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.656 [2024-11-26 15:50:53.971632] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.656 [2024-11-26 15:50:53.980838] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.656 [2024-11-26 15:50:53.981166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.981288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.981317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.656 [2024-11-26 15:50:53.981335] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.656 [2024-11-26 15:50:53.981483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.656 [2024-11-26 15:50:53.981651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.656 [2024-11-26 15:50:53.981674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.656 [2024-11-26 15:50:53.981705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.656 [2024-11-26 15:50:53.984066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.656 [2024-11-26 15:50:53.993486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.656 [2024-11-26 15:50:53.993828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.994009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:53.994036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.656 [2024-11-26 15:50:53.994067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.656 [2024-11-26 15:50:53.994225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.656 [2024-11-26 15:50:53.994387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.656 [2024-11-26 15:50:53.994413] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.656 [2024-11-26 15:50:53.994430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.656 [2024-11-26 15:50:53.996827] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.656 [2024-11-26 15:50:54.005894] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.656 [2024-11-26 15:50:54.006276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:54.006407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.656 [2024-11-26 15:50:54.006442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.656 [2024-11-26 15:50:54.006466] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.656 [2024-11-26 15:50:54.006633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.656 [2024-11-26 15:50:54.006847] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.657 [2024-11-26 15:50:54.006879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.657 [2024-11-26 15:50:54.006897] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.657 [2024-11-26 15:50:54.009318] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.657 [2024-11-26 15:50:54.018549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.657 [2024-11-26 15:50:54.018888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.657 [2024-11-26 15:50:54.019155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.657 [2024-11-26 15:50:54.019186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.657 [2024-11-26 15:50:54.019205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.657 [2024-11-26 15:50:54.019407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.657 [2024-11-26 15:50:54.019576] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.657 [2024-11-26 15:50:54.019602] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.657 [2024-11-26 15:50:54.019619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.657 [2024-11-26 15:50:54.022032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.657 [2024-11-26 15:50:54.031331] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.657 [2024-11-26 15:50:54.031644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.657 [2024-11-26 15:50:54.031838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.657 [2024-11-26 15:50:54.031870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.657 [2024-11-26 15:50:54.031888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.657 [2024-11-26 15:50:54.032073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.657 [2024-11-26 15:50:54.032242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.657 [2024-11-26 15:50:54.032268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.657 [2024-11-26 15:50:54.032284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.657 [2024-11-26 15:50:54.034636] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.657 [2024-11-26 15:50:54.043713] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.657 [2024-11-26 15:50:54.044073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.657 [2024-11-26 15:50:54.044225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.657 [2024-11-26 15:50:54.044253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.657 [2024-11-26 15:50:54.044271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.657 [2024-11-26 15:50:54.044436] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.657 [2024-11-26 15:50:54.044605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.657 [2024-11-26 15:50:54.044630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.657 [2024-11-26 15:50:54.044647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.657 [2024-11-26 15:50:54.046903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.657 [2024-11-26 15:50:54.056148] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.657 [2024-11-26 15:50:54.056457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.657 [2024-11-26 15:50:54.056652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.657 [2024-11-26 15:50:54.056694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.657 [2024-11-26 15:50:54.056712] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.657 [2024-11-26 15:50:54.056845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.657 [2024-11-26 15:50:54.057015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.657 [2024-11-26 15:50:54.057039] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.657 [2024-11-26 15:50:54.057055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.657 [2024-11-26 15:50:54.059333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.657 [2024-11-26 15:50:54.068564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.657 [2024-11-26 15:50:54.068865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.657 [2024-11-26 15:50:54.069004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.657 [2024-11-26 15:50:54.069035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.657 [2024-11-26 15:50:54.069053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.657 [2024-11-26 15:50:54.069219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.657 [2024-11-26 15:50:54.069405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.657 [2024-11-26 15:50:54.069429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.657 [2024-11-26 15:50:54.069445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.657 [2024-11-26 15:50:54.071584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.657 [2024-11-26 15:50:54.081365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.657 [2024-11-26 15:50:54.081749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.657 [2024-11-26 15:50:54.081868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.657 [2024-11-26 15:50:54.081895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.657 [2024-11-26 15:50:54.081911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.657 [2024-11-26 15:50:54.082074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.657 [2024-11-26 15:50:54.082276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.657 [2024-11-26 15:50:54.082301] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.657 [2024-11-26 15:50:54.082316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.657 [2024-11-26 15:50:54.084630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.657 [2024-11-26 15:50:54.093898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.657 [2024-11-26 15:50:54.094227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.657 [2024-11-26 15:50:54.094404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.657 [2024-11-26 15:50:54.094433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.657 [2024-11-26 15:50:54.094451] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.657 [2024-11-26 15:50:54.094598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.657 [2024-11-26 15:50:54.094822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.657 [2024-11-26 15:50:54.094845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.657 [2024-11-26 15:50:54.094859] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.657 [2024-11-26 15:50:54.097214] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.920 [2024-11-26 15:50:54.106433] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.920 [2024-11-26 15:50:54.106796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.106933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.106982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.920 [2024-11-26 15:50:54.107001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.920 [2024-11-26 15:50:54.107184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.920 [2024-11-26 15:50:54.107370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.920 [2024-11-26 15:50:54.107393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.920 [2024-11-26 15:50:54.107408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.920 [2024-11-26 15:50:54.109896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.920 [2024-11-26 15:50:54.118981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.920 [2024-11-26 15:50:54.119269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.119407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.119432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.920 [2024-11-26 15:50:54.119448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.920 [2024-11-26 15:50:54.119593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.920 [2024-11-26 15:50:54.119738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.920 [2024-11-26 15:50:54.119760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.920 [2024-11-26 15:50:54.119774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.920 [2024-11-26 15:50:54.122103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.920 [2024-11-26 15:50:54.131571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.920 [2024-11-26 15:50:54.131914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.132021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.132047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.920 [2024-11-26 15:50:54.132063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.920 [2024-11-26 15:50:54.132259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.920 [2024-11-26 15:50:54.132412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.920 [2024-11-26 15:50:54.132431] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.920 [2024-11-26 15:50:54.132443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.920 [2024-11-26 15:50:54.134654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.920 [2024-11-26 15:50:54.144411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.920 [2024-11-26 15:50:54.144787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.148885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.148926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.920 [2024-11-26 15:50:54.148950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.920 [2024-11-26 15:50:54.149087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.920 [2024-11-26 15:50:54.149240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.920 [2024-11-26 15:50:54.149259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.920 [2024-11-26 15:50:54.149271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.920 [2024-11-26 15:50:54.151464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.920 [2024-11-26 15:50:54.156841] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.920 [2024-11-26 15:50:54.157268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.157512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.157553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.920 [2024-11-26 15:50:54.157569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.920 [2024-11-26 15:50:54.157737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.920 [2024-11-26 15:50:54.157891] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.920 [2024-11-26 15:50:54.157910] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.920 [2024-11-26 15:50:54.157923] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.920 [2024-11-26 15:50:54.160282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.920 [2024-11-26 15:50:54.169376] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.920 [2024-11-26 15:50:54.169702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.169878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.169905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.920 [2024-11-26 15:50:54.169920] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.920 [2024-11-26 15:50:54.170073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.920 [2024-11-26 15:50:54.170242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.920 [2024-11-26 15:50:54.170261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.920 [2024-11-26 15:50:54.170273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.920 [2024-11-26 15:50:54.172739] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.920 [2024-11-26 15:50:54.181863] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.920 [2024-11-26 15:50:54.182302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.182413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.182439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.920 [2024-11-26 15:50:54.182454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.920 [2024-11-26 15:50:54.182615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.920 [2024-11-26 15:50:54.182808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.920 [2024-11-26 15:50:54.182829] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.920 [2024-11-26 15:50:54.182841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.920 [2024-11-26 15:50:54.185025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.920 [2024-11-26 15:50:54.194484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.920 [2024-11-26 15:50:54.194848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.194992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.195017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.920 [2024-11-26 15:50:54.195033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.920 [2024-11-26 15:50:54.195198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.920 [2024-11-26 15:50:54.195381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.920 [2024-11-26 15:50:54.195400] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.920 [2024-11-26 15:50:54.195412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.920 [2024-11-26 15:50:54.197751] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.920 [2024-11-26 15:50:54.207223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.920 [2024-11-26 15:50:54.207583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.207733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.920 [2024-11-26 15:50:54.207759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.920 [2024-11-26 15:50:54.207775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.920 [2024-11-26 15:50:54.207925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.920 [2024-11-26 15:50:54.208095] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.920 [2024-11-26 15:50:54.208114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.920 [2024-11-26 15:50:54.208127] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.920 [2024-11-26 15:50:54.210260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.920 [2024-11-26 15:50:54.219990] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.920 [2024-11-26 15:50:54.220334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.220465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.220492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.921 [2024-11-26 15:50:54.220507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.921 [2024-11-26 15:50:54.220759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.921 [2024-11-26 15:50:54.220898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.921 [2024-11-26 15:50:54.220919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.921 [2024-11-26 15:50:54.220932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.921 [2024-11-26 15:50:54.223362] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.921 [2024-11-26 15:50:54.232620] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.921 [2024-11-26 15:50:54.232957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.233176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.233202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.921 [2024-11-26 15:50:54.233217] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.921 [2024-11-26 15:50:54.233403] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.921 [2024-11-26 15:50:54.233568] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.921 [2024-11-26 15:50:54.233586] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.921 [2024-11-26 15:50:54.233598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.921 [2024-11-26 15:50:54.235728] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.921 [2024-11-26 15:50:54.245185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.921 [2024-11-26 15:50:54.245621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.245782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.245810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.921 [2024-11-26 15:50:54.245826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.921 [2024-11-26 15:50:54.245984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.921 [2024-11-26 15:50:54.246163] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.921 [2024-11-26 15:50:54.246182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.921 [2024-11-26 15:50:54.246194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.921 [2024-11-26 15:50:54.248478] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.921 [2024-11-26 15:50:54.257707] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.921 [2024-11-26 15:50:54.258076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.258183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.258210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.921 [2024-11-26 15:50:54.258226] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.921 [2024-11-26 15:50:54.258374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.921 [2024-11-26 15:50:54.258541] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.921 [2024-11-26 15:50:54.258567] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.921 [2024-11-26 15:50:54.258581] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.921 [2024-11-26 15:50:54.261159] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.921 [2024-11-26 15:50:54.270231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.921 [2024-11-26 15:50:54.270618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.270775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.270803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.921 [2024-11-26 15:50:54.270818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.921 [2024-11-26 15:50:54.270951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.921 [2024-11-26 15:50:54.271128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.921 [2024-11-26 15:50:54.271147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.921 [2024-11-26 15:50:54.271160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.921 [2024-11-26 15:50:54.273421] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.921 [2024-11-26 15:50:54.282737] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.921 [2024-11-26 15:50:54.283172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.283332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.283358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.921 [2024-11-26 15:50:54.283374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.921 [2024-11-26 15:50:54.283520] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.921 [2024-11-26 15:50:54.283736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.921 [2024-11-26 15:50:54.283757] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.921 [2024-11-26 15:50:54.283770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.921 [2024-11-26 15:50:54.285956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.921 [2024-11-26 15:50:54.295268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.921 [2024-11-26 15:50:54.295670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.295854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.295881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.921 [2024-11-26 15:50:54.295897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.921 [2024-11-26 15:50:54.296046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.921 [2024-11-26 15:50:54.296201] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.921 [2024-11-26 15:50:54.296220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.921 [2024-11-26 15:50:54.296237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.921 [2024-11-26 15:50:54.298231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.921 [2024-11-26 15:50:54.307911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.921 [2024-11-26 15:50:54.308270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.308435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.308461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.921 [2024-11-26 15:50:54.308476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.921 [2024-11-26 15:50:54.308606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.921 [2024-11-26 15:50:54.308762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.921 [2024-11-26 15:50:54.308783] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.921 [2024-11-26 15:50:54.308796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.921 [2024-11-26 15:50:54.311123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.921 [2024-11-26 15:50:54.320595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.921 [2024-11-26 15:50:54.321001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.321183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.321208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.921 [2024-11-26 15:50:54.321224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.921 [2024-11-26 15:50:54.321415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.921 [2024-11-26 15:50:54.321566] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.921 [2024-11-26 15:50:54.321585] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.921 [2024-11-26 15:50:54.321597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.921 [2024-11-26 15:50:54.323831] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.921 [2024-11-26 15:50:54.333104] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.921 [2024-11-26 15:50:54.333481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.333709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.921 [2024-11-26 15:50:54.333736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.921 [2024-11-26 15:50:54.333751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.922 [2024-11-26 15:50:54.333900] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.922 [2024-11-26 15:50:54.334076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.922 [2024-11-26 15:50:54.334095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.922 [2024-11-26 15:50:54.334107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.922 [2024-11-26 15:50:54.336192] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.922 [2024-11-26 15:50:54.345434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.922 [2024-11-26 15:50:54.345723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.922 [2024-11-26 15:50:54.345877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.922 [2024-11-26 15:50:54.345903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.922 [2024-11-26 15:50:54.345918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.922 [2024-11-26 15:50:54.346121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.922 [2024-11-26 15:50:54.346287] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.922 [2024-11-26 15:50:54.346306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.922 [2024-11-26 15:50:54.346318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.922 [2024-11-26 15:50:54.348648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.922 [2024-11-26 15:50:54.357840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.922 [2024-11-26 15:50:54.358194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.922 [2024-11-26 15:50:54.358337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.922 [2024-11-26 15:50:54.358363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:02.922 [2024-11-26 15:50:54.358378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:02.922 [2024-11-26 15:50:54.358573] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:02.922 [2024-11-26 15:50:54.358771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.922 [2024-11-26 15:50:54.358792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.922 [2024-11-26 15:50:54.358805] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.922 [2024-11-26 15:50:54.361173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.185 [2024-11-26 15:50:54.370448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.185 [2024-11-26 15:50:54.370873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.185 [2024-11-26 15:50:54.371033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.185 [2024-11-26 15:50:54.371059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.185 [2024-11-26 15:50:54.371075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.185 [2024-11-26 15:50:54.371265] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.185 [2024-11-26 15:50:54.371463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.185 [2024-11-26 15:50:54.371496] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.185 [2024-11-26 15:50:54.371509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.185 [2024-11-26 15:50:54.373771] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.185 [2024-11-26 15:50:54.382998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.185 [2024-11-26 15:50:54.383309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.185 [2024-11-26 15:50:54.383465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.185 [2024-11-26 15:50:54.383491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.185 [2024-11-26 15:50:54.383506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.185 [2024-11-26 15:50:54.383636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.185 [2024-11-26 15:50:54.383789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.185 [2024-11-26 15:50:54.383810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.185 [2024-11-26 15:50:54.383823] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.185 [2024-11-26 15:50:54.386348] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.185 [2024-11-26 15:50:54.395584] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.185 [2024-11-26 15:50:54.395973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.185 [2024-11-26 15:50:54.396189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.185 [2024-11-26 15:50:54.396215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.185 [2024-11-26 15:50:54.396230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.185 [2024-11-26 15:50:54.396401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.185 [2024-11-26 15:50:54.396554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.185 [2024-11-26 15:50:54.396573] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.185 [2024-11-26 15:50:54.396585] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.185 [2024-11-26 15:50:54.398885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.185 [2024-11-26 15:50:54.408167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.185 [2024-11-26 15:50:54.408483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.185 [2024-11-26 15:50:54.408644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.185 [2024-11-26 15:50:54.408670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.185 [2024-11-26 15:50:54.408695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.186 [2024-11-26 15:50:54.408863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.186 [2024-11-26 15:50:54.409067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.186 [2024-11-26 15:50:54.409086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.186 [2024-11-26 15:50:54.409098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.186 [2024-11-26 15:50:54.411320] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.186 [2024-11-26 15:50:54.420728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.186 [2024-11-26 15:50:54.421028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.421185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.421213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.186 [2024-11-26 15:50:54.421228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.186 [2024-11-26 15:50:54.421405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.186 [2024-11-26 15:50:54.421558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.186 [2024-11-26 15:50:54.421576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.186 [2024-11-26 15:50:54.421588] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.186 [2024-11-26 15:50:54.423556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.186 [2024-11-26 15:50:54.433261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.186 [2024-11-26 15:50:54.433586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.433746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.433773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.186 [2024-11-26 15:50:54.433788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.186 [2024-11-26 15:50:54.433936] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.186 [2024-11-26 15:50:54.434092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.186 [2024-11-26 15:50:54.434111] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.186 [2024-11-26 15:50:54.434123] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.186 [2024-11-26 15:50:54.436473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.186 [2024-11-26 15:50:54.445854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.186 [2024-11-26 15:50:54.446192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.446382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.446407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.186 [2024-11-26 15:50:54.446423] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.186 [2024-11-26 15:50:54.446626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.186 [2024-11-26 15:50:54.446836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.186 [2024-11-26 15:50:54.446857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.186 [2024-11-26 15:50:54.446869] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.186 [2024-11-26 15:50:54.449189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.186 [2024-11-26 15:50:54.458261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.186 [2024-11-26 15:50:54.458664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.458847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.458878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.186 [2024-11-26 15:50:54.458895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.186 [2024-11-26 15:50:54.459087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.186 [2024-11-26 15:50:54.459237] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.186 [2024-11-26 15:50:54.459256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.186 [2024-11-26 15:50:54.459268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.186 [2024-11-26 15:50:54.461459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.186 [2024-11-26 15:50:54.470845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.186 [2024-11-26 15:50:54.471268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.471444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.471470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.186 [2024-11-26 15:50:54.471485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.186 [2024-11-26 15:50:54.471716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.186 [2024-11-26 15:50:54.471829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.186 [2024-11-26 15:50:54.471848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.186 [2024-11-26 15:50:54.471861] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.186 [2024-11-26 15:50:54.474301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.186 [2024-11-26 15:50:54.483408] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.186 [2024-11-26 15:50:54.483735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.483883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.483910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.186 [2024-11-26 15:50:54.483925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.186 [2024-11-26 15:50:54.484117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.186 [2024-11-26 15:50:54.484282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.186 [2024-11-26 15:50:54.484300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.186 [2024-11-26 15:50:54.484312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.186 [2024-11-26 15:50:54.486501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.186 [2024-11-26 15:50:54.496102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.186 [2024-11-26 15:50:54.496498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.496716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.496758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.186 [2024-11-26 15:50:54.496778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.186 [2024-11-26 15:50:54.496923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.186 [2024-11-26 15:50:54.497092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.186 [2024-11-26 15:50:54.497111] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.186 [2024-11-26 15:50:54.497123] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.186 [2024-11-26 15:50:54.499551] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.186 [2024-11-26 15:50:54.508662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.186 [2024-11-26 15:50:54.508975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.509129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.509154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.186 [2024-11-26 15:50:54.509171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.186 [2024-11-26 15:50:54.509349] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.186 [2024-11-26 15:50:54.509539] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.186 [2024-11-26 15:50:54.509563] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.186 [2024-11-26 15:50:54.509576] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.186 [2024-11-26 15:50:54.511775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.186 [2024-11-26 15:50:54.521434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.186 [2024-11-26 15:50:54.521798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.521949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.186 [2024-11-26 15:50:54.521976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.186 [2024-11-26 15:50:54.521993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.186 [2024-11-26 15:50:54.522142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.186 [2024-11-26 15:50:54.522329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.186 [2024-11-26 15:50:54.522348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.187 [2024-11-26 15:50:54.522361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.187 [2024-11-26 15:50:54.524571] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.187 [2024-11-26 15:50:54.534071] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.187 [2024-11-26 15:50:54.534451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.534620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.534647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.187 [2024-11-26 15:50:54.534662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.187 [2024-11-26 15:50:54.534829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.187 [2024-11-26 15:50:54.535006] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.187 [2024-11-26 15:50:54.535025] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.187 [2024-11-26 15:50:54.535037] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.187 [2024-11-26 15:50:54.537252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.187 [2024-11-26 15:50:54.546385] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.187 [2024-11-26 15:50:54.546695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.546871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.546896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.187 [2024-11-26 15:50:54.546912] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.187 [2024-11-26 15:50:54.547038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.187 [2024-11-26 15:50:54.547190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.187 [2024-11-26 15:50:54.547209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.187 [2024-11-26 15:50:54.547221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.187 [2024-11-26 15:50:54.549519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.187 [2024-11-26 15:50:54.558981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.187 [2024-11-26 15:50:54.559352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.559519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.559545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.187 [2024-11-26 15:50:54.559560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.187 [2024-11-26 15:50:54.559719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.187 [2024-11-26 15:50:54.559859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.187 [2024-11-26 15:50:54.559879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.187 [2024-11-26 15:50:54.559892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.187 [2024-11-26 15:50:54.562271] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.187 [2024-11-26 15:50:54.571437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.187 [2024-11-26 15:50:54.571859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.571997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.572023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.187 [2024-11-26 15:50:54.572039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.187 [2024-11-26 15:50:54.572276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.187 [2024-11-26 15:50:54.572387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.187 [2024-11-26 15:50:54.572406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.187 [2024-11-26 15:50:54.572418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.187 [2024-11-26 15:50:54.574664] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.187 [2024-11-26 15:50:54.583963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.187 [2024-11-26 15:50:54.584356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.584511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.584537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.187 [2024-11-26 15:50:54.584552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.187 [2024-11-26 15:50:54.584743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.187 [2024-11-26 15:50:54.584919] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.187 [2024-11-26 15:50:54.584939] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.187 [2024-11-26 15:50:54.584951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.187 [2024-11-26 15:50:54.587316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.187 [2024-11-26 15:50:54.596420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.187 [2024-11-26 15:50:54.596764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.596954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.596980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.187 [2024-11-26 15:50:54.597010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.187 [2024-11-26 15:50:54.597197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.187 [2024-11-26 15:50:54.597361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.187 [2024-11-26 15:50:54.597379] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.187 [2024-11-26 15:50:54.597392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.187 [2024-11-26 15:50:54.599471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.187 [2024-11-26 15:50:54.609073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.187 [2024-11-26 15:50:54.609439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.609585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.609609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.187 [2024-11-26 15:50:54.609624] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.187 [2024-11-26 15:50:54.609788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.187 [2024-11-26 15:50:54.609931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.187 [2024-11-26 15:50:54.609955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.187 [2024-11-26 15:50:54.609983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.187 [2024-11-26 15:50:54.612206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.187 [2024-11-26 15:50:54.621567] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.187 [2024-11-26 15:50:54.621871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.622027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.187 [2024-11-26 15:50:54.622053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.187 [2024-11-26 15:50:54.622068] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.187 [2024-11-26 15:50:54.622258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.187 [2024-11-26 15:50:54.622439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.187 [2024-11-26 15:50:54.622458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.187 [2024-11-26 15:50:54.622470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.187 [2024-11-26 15:50:54.624769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.449 [2024-11-26 15:50:54.634251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.449 [2024-11-26 15:50:54.634575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.449 [2024-11-26 15:50:54.634730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.634756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.450 [2024-11-26 15:50:54.634772] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.450 [2024-11-26 15:50:54.634953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.450 [2024-11-26 15:50:54.635122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.450 [2024-11-26 15:50:54.635140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.450 [2024-11-26 15:50:54.635153] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.450 [2024-11-26 15:50:54.637487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.450 [2024-11-26 15:50:54.646853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.450 [2024-11-26 15:50:54.647210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.647372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.647397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.450 [2024-11-26 15:50:54.647413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.450 [2024-11-26 15:50:54.647528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.450 [2024-11-26 15:50:54.647731] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.450 [2024-11-26 15:50:54.647752] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.450 [2024-11-26 15:50:54.647770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.450 [2024-11-26 15:50:54.650121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.450 [2024-11-26 15:50:54.659466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.450 [2024-11-26 15:50:54.659798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.659931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.659957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.450 [2024-11-26 15:50:54.659972] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.450 [2024-11-26 15:50:54.660088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.450 [2024-11-26 15:50:54.660264] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.450 [2024-11-26 15:50:54.660284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.450 [2024-11-26 15:50:54.660296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.450 [2024-11-26 15:50:54.662495] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.450 [2024-11-26 15:50:54.671972] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.450 [2024-11-26 15:50:54.672392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.672547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.672573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.450 [2024-11-26 15:50:54.672589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.450 [2024-11-26 15:50:54.672733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.450 [2024-11-26 15:50:54.672926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.450 [2024-11-26 15:50:54.672947] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.450 [2024-11-26 15:50:54.672960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.450 [2024-11-26 15:50:54.674967] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.450 [2024-11-26 15:50:54.684485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.450 [2024-11-26 15:50:54.684867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.685125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.685149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.450 [2024-11-26 15:50:54.685163] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.450 [2024-11-26 15:50:54.685286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.450 [2024-11-26 15:50:54.685408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.450 [2024-11-26 15:50:54.685427] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.450 [2024-11-26 15:50:54.685439] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.450 [2024-11-26 15:50:54.687801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.450 [2024-11-26 15:50:54.697182] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.450 [2024-11-26 15:50:54.697494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.697667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.697700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.450 [2024-11-26 15:50:54.697717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.450 [2024-11-26 15:50:54.697865] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.450 [2024-11-26 15:50:54.698070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.450 [2024-11-26 15:50:54.698088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.450 [2024-11-26 15:50:54.698100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.450 [2024-11-26 15:50:54.700434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.450 [2024-11-26 15:50:54.709868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.450 [2024-11-26 15:50:54.710235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.710344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.710369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.450 [2024-11-26 15:50:54.710385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.450 [2024-11-26 15:50:54.710572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.450 [2024-11-26 15:50:54.710736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.450 [2024-11-26 15:50:54.710757] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.450 [2024-11-26 15:50:54.710769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.450 [2024-11-26 15:50:54.713068] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.450 [2024-11-26 15:50:54.722462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.450 [2024-11-26 15:50:54.722803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.722939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.722965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.450 [2024-11-26 15:50:54.722981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.450 [2024-11-26 15:50:54.723127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.450 [2024-11-26 15:50:54.723294] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.450 [2024-11-26 15:50:54.723313] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.450 [2024-11-26 15:50:54.723325] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.450 [2024-11-26 15:50:54.725584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.450 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 981323 Killed "${NVMF_APP[@]}" "$@" 00:27:03.450 15:50:54 -- host/bdevperf.sh@36 -- # tgt_init 00:27:03.450 15:50:54 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:03.450 15:50:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:03.450 15:50:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:03.450 15:50:54 -- common/autotest_common.sh@10 -- # set +x 00:27:03.450 [2024-11-26 15:50:54.735120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.450 [2024-11-26 15:50:54.735508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.735654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.450 [2024-11-26 15:50:54.735680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.450 [2024-11-26 15:50:54.735705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.450 [2024-11-26 15:50:54.735881] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.450 15:50:54 -- nvmf/common.sh@469 -- # nvmfpid=982382 00:27:03.450 [2024-11-26 15:50:54.736038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.450 [2024-11-26 15:50:54.736059] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.450 [2024-11-26 15:50:54.736071] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.450 15:50:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:03.451 15:50:54 -- nvmf/common.sh@470 -- # waitforlisten 982382 00:27:03.451 15:50:54 -- common/autotest_common.sh@829 -- # '[' -z 982382 ']' 00:27:03.451 15:50:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:03.451 15:50:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:03.451 15:50:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:03.451 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:03.451 15:50:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:03.451 15:50:54 -- common/autotest_common.sh@10 -- # set +x 00:27:03.451 [2024-11-26 15:50:54.738133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.451 [2024-11-26 15:50:54.747882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.451 [2024-11-26 15:50:54.748272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.748415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.748441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.451 [2024-11-26 15:50:54.748456] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.451 [2024-11-26 15:50:54.748606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.451 [2024-11-26 15:50:54.748799] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.451 [2024-11-26 15:50:54.748820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.451 [2024-11-26 15:50:54.748833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.451 [2024-11-26 15:50:54.750934] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.451 [2024-11-26 15:50:54.760488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.451 [2024-11-26 15:50:54.760910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.761053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.761079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.451 [2024-11-26 15:50:54.761095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.451 [2024-11-26 15:50:54.761221] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.451 [2024-11-26 15:50:54.761460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.451 [2024-11-26 15:50:54.761482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.451 [2024-11-26 15:50:54.761495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.451 [2024-11-26 15:50:54.764076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.451 [2024-11-26 15:50:54.773166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.451 [2024-11-26 15:50:54.773528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.773658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.773708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.451 [2024-11-26 15:50:54.773728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.451 [2024-11-26 15:50:54.773925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.451 [2024-11-26 15:50:54.774099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.451 [2024-11-26 15:50:54.774118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.451 [2024-11-26 15:50:54.774130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.451 [2024-11-26 15:50:54.776380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.451 [2024-11-26 15:50:54.779044] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:03.451 [2024-11-26 15:50:54.779114] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:03.451 [2024-11-26 15:50:54.785783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.451 [2024-11-26 15:50:54.786068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.786217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.786245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.451 [2024-11-26 15:50:54.786261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.451 [2024-11-26 15:50:54.786480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.451 [2024-11-26 15:50:54.786629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.451 [2024-11-26 15:50:54.786647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.451 [2024-11-26 15:50:54.786659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.451 [2024-11-26 15:50:54.789012] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.451 [2024-11-26 15:50:54.798347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.451 [2024-11-26 15:50:54.798700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.798828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.798854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.451 [2024-11-26 15:50:54.798870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.451 [2024-11-26 15:50:54.799035] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.451 [2024-11-26 15:50:54.799229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.451 [2024-11-26 15:50:54.799253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.451 [2024-11-26 15:50:54.799268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.451 [2024-11-26 15:50:54.801771] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.451 [2024-11-26 15:50:54.811110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.451 [2024-11-26 15:50:54.811432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.811556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.811585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.451 [2024-11-26 15:50:54.811602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.451 [2024-11-26 15:50:54.811778] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.451 [2024-11-26 15:50:54.811973] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.451 [2024-11-26 15:50:54.811993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.451 [2024-11-26 15:50:54.812005] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.451 EAL: No free 2048 kB hugepages reported on node 1 00:27:03.451 [2024-11-26 15:50:54.814289] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.451 [2024-11-26 15:50:54.823618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.451 [2024-11-26 15:50:54.823937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.824089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.824116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.451 [2024-11-26 15:50:54.824131] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.451 [2024-11-26 15:50:54.824312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.451 [2024-11-26 15:50:54.824456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.451 [2024-11-26 15:50:54.824476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.451 [2024-11-26 15:50:54.824490] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.451 [2024-11-26 15:50:54.826777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.451 [2024-11-26 15:50:54.836561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.451 [2024-11-26 15:50:54.836943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.837063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.837089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.451 [2024-11-26 15:50:54.837105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.451 [2024-11-26 15:50:54.837285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.451 [2024-11-26 15:50:54.837486] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.451 [2024-11-26 15:50:54.837506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.451 [2024-11-26 15:50:54.837518] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.451 [2024-11-26 15:50:54.839844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.451 [2024-11-26 15:50:54.849100] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.451 [2024-11-26 15:50:54.849498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.849579] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:03.451 [2024-11-26 15:50:54.849676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.451 [2024-11-26 15:50:54.849709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.452 [2024-11-26 15:50:54.849726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.452 [2024-11-26 15:50:54.849916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.452 [2024-11-26 15:50:54.850073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.452 [2024-11-26 15:50:54.850092] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.452 [2024-11-26 15:50:54.850105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.452 [2024-11-26 15:50:54.852232] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.452 [2024-11-26 15:50:54.861566] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.452 [2024-11-26 15:50:54.862035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.452 [2024-11-26 15:50:54.862202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.452 [2024-11-26 15:50:54.862228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.452 [2024-11-26 15:50:54.862248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.452 [2024-11-26 15:50:54.862438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.452 [2024-11-26 15:50:54.862681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.452 [2024-11-26 15:50:54.862715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.452 [2024-11-26 15:50:54.862750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.452 [2024-11-26 15:50:54.865089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.452 [2024-11-26 15:50:54.874243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.452 [2024-11-26 15:50:54.874657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.452 [2024-11-26 15:50:54.874828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.452 [2024-11-26 15:50:54.874854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.452 [2024-11-26 15:50:54.874870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.452 [2024-11-26 15:50:54.875005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.452 [2024-11-26 15:50:54.875180] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.452 [2024-11-26 15:50:54.875199] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.452 [2024-11-26 15:50:54.875212] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.452 [2024-11-26 15:50:54.877473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.452 [2024-11-26 15:50:54.886721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.452 [2024-11-26 15:50:54.887077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.452 [2024-11-26 15:50:54.887187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.452 [2024-11-26 15:50:54.887213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.452 [2024-11-26 15:50:54.887229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.452 [2024-11-26 15:50:54.887416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.452 [2024-11-26 15:50:54.887588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.452 [2024-11-26 15:50:54.887612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.452 [2024-11-26 15:50:54.887628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.452 [2024-11-26 15:50:54.889944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.713 [2024-11-26 15:50:54.899048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.713 [2024-11-26 15:50:54.899399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.713 [2024-11-26 15:50:54.899560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.713 [2024-11-26 15:50:54.899589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.713 [2024-11-26 15:50:54.899607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.713 [2024-11-26 15:50:54.899845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.713 [2024-11-26 15:50:54.899978] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.713 [2024-11-26 15:50:54.900018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.713 [2024-11-26 15:50:54.900032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.713 [2024-11-26 15:50:54.902335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.713 [2024-11-26 15:50:54.911702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.713 [2024-11-26 15:50:54.912162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.713 [2024-11-26 15:50:54.912336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.713 [2024-11-26 15:50:54.912371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.713 [2024-11-26 15:50:54.912388] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.713 [2024-11-26 15:50:54.912570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.713 [2024-11-26 15:50:54.912779] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.713 [2024-11-26 15:50:54.912800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.713 [2024-11-26 15:50:54.912815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.713 [2024-11-26 15:50:54.914867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.713 [2024-11-26 15:50:54.924369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.713 [2024-11-26 15:50:54.924908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.713 [2024-11-26 15:50:54.925066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.713 [2024-11-26 15:50:54.925092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.713 [2024-11-26 15:50:54.925112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.713 [2024-11-26 15:50:54.925332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.713 [2024-11-26 15:50:54.925476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.713 [2024-11-26 15:50:54.925497] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.713 [2024-11-26 15:50:54.925512] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.713 [2024-11-26 15:50:54.927773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.713 [2024-11-26 15:50:54.937203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.713 [2024-11-26 15:50:54.937578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.713 [2024-11-26 15:50:54.937789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.713 [2024-11-26 15:50:54.937816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.713 [2024-11-26 15:50:54.937831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.713 [2024-11-26 15:50:54.937980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.713 [2024-11-26 15:50:54.938126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.713 [2024-11-26 15:50:54.938145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.713 [2024-11-26 15:50:54.938159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.713 [2024-11-26 15:50:54.940463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.713 [2024-11-26 15:50:54.949781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.713 [2024-11-26 15:50:54.950119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.713 [2024-11-26 15:50:54.950300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.713 [2024-11-26 15:50:54.950328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.713 [2024-11-26 15:50:54.950355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.713 [2024-11-26 15:50:54.950513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.713 [2024-11-26 15:50:54.950723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.713 [2024-11-26 15:50:54.950744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.713 [2024-11-26 15:50:54.950757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.713 [2024-11-26 15:50:54.952927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.713 [2024-11-26 15:50:54.962260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.713 [2024-11-26 15:50:54.962622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.713 [2024-11-26 15:50:54.962751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.713 [2024-11-26 15:50:54.962779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.713 [2024-11-26 15:50:54.962794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.713 [2024-11-26 15:50:54.962975] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.713 [2024-11-26 15:50:54.963134] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.713 [2024-11-26 15:50:54.963154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.713 [2024-11-26 15:50:54.963166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.713 [2024-11-26 15:50:54.965502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.713 [2024-11-26 15:50:54.966284] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:03.713 [2024-11-26 15:50:54.966404] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:03.713 [2024-11-26 15:50:54.966421] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:03.713 [2024-11-26 15:50:54.966434] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:03.713 [2024-11-26 15:50:54.966533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:03.713 [2024-11-26 15:50:54.966598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:03.713 [2024-11-26 15:50:54.966595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:03.713 [2024-11-26 15:50:54.974603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.713 [2024-11-26 15:50:54.975030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.713 [2024-11-26 15:50:54.975182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.713 [2024-11-26 15:50:54.975209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.713 [2024-11-26 15:50:54.975228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.713 [2024-11-26 15:50:54.975386] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.713 [2024-11-26 15:50:54.975555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.713 [2024-11-26 15:50:54.975576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.713 [2024-11-26 15:50:54.975593] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.713 [2024-11-26 15:50:54.977775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.713 [2024-11-26 15:50:54.986928] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.713 [2024-11-26 15:50:54.987402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:54.987529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:54.987556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.714 [2024-11-26 15:50:54.987576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.714 [2024-11-26 15:50:54.987737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.714 [2024-11-26 15:50:54.987908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.714 [2024-11-26 15:50:54.987929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.714 [2024-11-26 15:50:54.987946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.714 [2024-11-26 15:50:54.990057] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.714 [2024-11-26 15:50:54.999465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.714 [2024-11-26 15:50:54.999984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.000132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.000158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.714 [2024-11-26 15:50:55.000179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.714 [2024-11-26 15:50:55.000368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.714 [2024-11-26 15:50:55.000475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.714 [2024-11-26 15:50:55.000496] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.714 [2024-11-26 15:50:55.000513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.714 [2024-11-26 15:50:55.002607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.714 [2024-11-26 15:50:55.011998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.714 [2024-11-26 15:50:55.012527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.012716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.012745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.714 [2024-11-26 15:50:55.012777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.714 [2024-11-26 15:50:55.012944] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.714 [2024-11-26 15:50:55.013089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.714 [2024-11-26 15:50:55.013126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.714 [2024-11-26 15:50:55.013146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.714 [2024-11-26 15:50:55.015500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.714 [2024-11-26 15:50:55.024587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.714 [2024-11-26 15:50:55.024966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.025106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.025133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.714 [2024-11-26 15:50:55.025152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.714 [2024-11-26 15:50:55.025338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.714 [2024-11-26 15:50:55.025506] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.714 [2024-11-26 15:50:55.025527] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.714 [2024-11-26 15:50:55.025543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.714 [2024-11-26 15:50:55.027677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.714 [2024-11-26 15:50:55.036868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.714 [2024-11-26 15:50:55.037382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.037497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.037524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.714 [2024-11-26 15:50:55.037544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.714 [2024-11-26 15:50:55.037736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.714 [2024-11-26 15:50:55.037911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.714 [2024-11-26 15:50:55.037933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.714 [2024-11-26 15:50:55.037951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.714 [2024-11-26 15:50:55.040112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.714 [2024-11-26 15:50:55.049236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.714 [2024-11-26 15:50:55.049509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.049684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.049716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.714 [2024-11-26 15:50:55.049733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.714 [2024-11-26 15:50:55.049883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.714 [2024-11-26 15:50:55.050049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.714 [2024-11-26 15:50:55.050070] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.714 [2024-11-26 15:50:55.050085] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.714 [2024-11-26 15:50:55.052112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.714 [2024-11-26 15:50:55.061282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.714 [2024-11-26 15:50:55.061634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.061761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.061788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.714 [2024-11-26 15:50:55.061804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.714 [2024-11-26 15:50:55.061952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.714 [2024-11-26 15:50:55.062134] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.714 [2024-11-26 15:50:55.062154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.714 [2024-11-26 15:50:55.062169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.714 [2024-11-26 15:50:55.064226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.714 [2024-11-26 15:50:55.073707] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.714 [2024-11-26 15:50:55.073967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.074111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.074137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.714 [2024-11-26 15:50:55.074152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.714 [2024-11-26 15:50:55.074365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.714 [2024-11-26 15:50:55.074498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.714 [2024-11-26 15:50:55.074518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.714 [2024-11-26 15:50:55.074532] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.714 [2024-11-26 15:50:55.076524] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.714 [2024-11-26 15:50:55.085826] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.714 [2024-11-26 15:50:55.086168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.086280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.086306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.714 [2024-11-26 15:50:55.086322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.714 [2024-11-26 15:50:55.086470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.714 [2024-11-26 15:50:55.086617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.714 [2024-11-26 15:50:55.086638] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.714 [2024-11-26 15:50:55.086651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.714 [2024-11-26 15:50:55.088876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.714 [2024-11-26 15:50:55.098133] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.714 [2024-11-26 15:50:55.098452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.098578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.714 [2024-11-26 15:50:55.098604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.714 [2024-11-26 15:50:55.098620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.715 [2024-11-26 15:50:55.098777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.715 [2024-11-26 15:50:55.098913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.715 [2024-11-26 15:50:55.098934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.715 [2024-11-26 15:50:55.098948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.715 [2024-11-26 15:50:55.100883] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.715 [2024-11-26 15:50:55.110468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.715 [2024-11-26 15:50:55.110807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.715 [2024-11-26 15:50:55.110959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.715 [2024-11-26 15:50:55.110985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.715 [2024-11-26 15:50:55.111001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.715 [2024-11-26 15:50:55.111149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.715 [2024-11-26 15:50:55.111311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.715 [2024-11-26 15:50:55.111331] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.715 [2024-11-26 15:50:55.111344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.715 [2024-11-26 15:50:55.113342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.715 [2024-11-26 15:50:55.122719] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.715 [2024-11-26 15:50:55.123029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.715 [2024-11-26 15:50:55.123129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.715 [2024-11-26 15:50:55.123155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.715 [2024-11-26 15:50:55.123171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.715 [2024-11-26 15:50:55.123366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.715 [2024-11-26 15:50:55.123498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.715 [2024-11-26 15:50:55.123518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.715 [2024-11-26 15:50:55.123531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.715 [2024-11-26 15:50:55.125633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.715 [2024-11-26 15:50:55.135111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.715 [2024-11-26 15:50:55.135418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.715 [2024-11-26 15:50:55.135580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.715 [2024-11-26 15:50:55.135605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.715 [2024-11-26 15:50:55.135626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.715 [2024-11-26 15:50:55.135815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.715 [2024-11-26 15:50:55.135918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.715 [2024-11-26 15:50:55.135939] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.715 [2024-11-26 15:50:55.135952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.715 [2024-11-26 15:50:55.138073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.715 [2024-11-26 15:50:55.147509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.715 [2024-11-26 15:50:55.147804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.715 [2024-11-26 15:50:55.147950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.715 [2024-11-26 15:50:55.147975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.715 [2024-11-26 15:50:55.147991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.715 [2024-11-26 15:50:55.148139] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.715 [2024-11-26 15:50:55.148350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.715 [2024-11-26 15:50:55.148371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.715 [2024-11-26 15:50:55.148384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.715 [2024-11-26 15:50:55.150377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.975 [2024-11-26 15:50:55.159799] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.976 [2024-11-26 15:50:55.160136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.160297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.160322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.976 [2024-11-26 15:50:55.160338] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.976 [2024-11-26 15:50:55.160470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.976 [2024-11-26 15:50:55.160651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.976 [2024-11-26 15:50:55.160672] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.976 [2024-11-26 15:50:55.160709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.976 [2024-11-26 15:50:55.162727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.976 [2024-11-26 15:50:55.172074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.976 [2024-11-26 15:50:55.172385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.172532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.172557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.976 [2024-11-26 15:50:55.172572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.976 [2024-11-26 15:50:55.172753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.976 [2024-11-26 15:50:55.172964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.976 [2024-11-26 15:50:55.172984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.976 [2024-11-26 15:50:55.172998] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.976 [2024-11-26 15:50:55.175030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.976 [2024-11-26 15:50:55.184469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.976 [2024-11-26 15:50:55.184766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.184914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.184939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.976 [2024-11-26 15:50:55.184955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.976 [2024-11-26 15:50:55.185120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.976 [2024-11-26 15:50:55.185267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.976 [2024-11-26 15:50:55.185288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.976 [2024-11-26 15:50:55.185302] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.976 [2024-11-26 15:50:55.187451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.976 [2024-11-26 15:50:55.196700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.976 [2024-11-26 15:50:55.197015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.197123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.197149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.976 [2024-11-26 15:50:55.197165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.976 [2024-11-26 15:50:55.197296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.976 [2024-11-26 15:50:55.197460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.976 [2024-11-26 15:50:55.197482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.976 [2024-11-26 15:50:55.197495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.976 [2024-11-26 15:50:55.199502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.976 [2024-11-26 15:50:55.208934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.976 [2024-11-26 15:50:55.209242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.209392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.209419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.976 [2024-11-26 15:50:55.209434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.976 [2024-11-26 15:50:55.209555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.976 [2024-11-26 15:50:55.209717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.976 [2024-11-26 15:50:55.209740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.976 [2024-11-26 15:50:55.209753] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.976 [2024-11-26 15:50:55.211884] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.976 [2024-11-26 15:50:55.221253] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.976 [2024-11-26 15:50:55.221584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.221737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.221763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.976 [2024-11-26 15:50:55.221779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.976 [2024-11-26 15:50:55.221943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.976 [2024-11-26 15:50:55.222146] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.976 [2024-11-26 15:50:55.222167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.976 [2024-11-26 15:50:55.222180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.976 [2024-11-26 15:50:55.224380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.976 [2024-11-26 15:50:55.233605] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.976 [2024-11-26 15:50:55.233927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.234063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.234089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.976 [2024-11-26 15:50:55.234104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.976 [2024-11-26 15:50:55.234236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.976 [2024-11-26 15:50:55.234401] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.976 [2024-11-26 15:50:55.234422] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.976 [2024-11-26 15:50:55.234435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.976 [2024-11-26 15:50:55.236382] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.976 [2024-11-26 15:50:55.246062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.976 [2024-11-26 15:50:55.246355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.246495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.246521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.976 [2024-11-26 15:50:55.246536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.976 [2024-11-26 15:50:55.246693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.976 [2024-11-26 15:50:55.246909] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.976 [2024-11-26 15:50:55.246930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.976 [2024-11-26 15:50:55.246944] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.976 [2024-11-26 15:50:55.248915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.976 [2024-11-26 15:50:55.258325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.976 [2024-11-26 15:50:55.258616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.258738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.976 [2024-11-26 15:50:55.258766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.976 [2024-11-26 15:50:55.258783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.976 [2024-11-26 15:50:55.258932] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.976 [2024-11-26 15:50:55.259096] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.976 [2024-11-26 15:50:55.259117] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.976 [2024-11-26 15:50:55.259130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.976 [2024-11-26 15:50:55.261296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.976 [2024-11-26 15:50:55.270569] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.977 [2024-11-26 15:50:55.270920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.271046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.271074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.977 [2024-11-26 15:50:55.271089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.977 [2024-11-26 15:50:55.271267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.977 [2024-11-26 15:50:55.271405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.977 [2024-11-26 15:50:55.271426] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.977 [2024-11-26 15:50:55.271442] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.977 [2024-11-26 15:50:55.273647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.977 [2024-11-26 15:50:55.283292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.977 [2024-11-26 15:50:55.283628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.283753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.283780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.977 [2024-11-26 15:50:55.283797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.977 [2024-11-26 15:50:55.283913] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.977 [2024-11-26 15:50:55.284064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.977 [2024-11-26 15:50:55.284084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.977 [2024-11-26 15:50:55.284103] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.977 [2024-11-26 15:50:55.286136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.977 [2024-11-26 15:50:55.295629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.977 [2024-11-26 15:50:55.295952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.296104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.296130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.977 [2024-11-26 15:50:55.296145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.977 [2024-11-26 15:50:55.296294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.977 [2024-11-26 15:50:55.296491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.977 [2024-11-26 15:50:55.296511] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.977 [2024-11-26 15:50:55.296524] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.977 [2024-11-26 15:50:55.298651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.977 [2024-11-26 15:50:55.307866] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.977 [2024-11-26 15:50:55.308151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.308282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.308307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.977 [2024-11-26 15:50:55.308323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.977 [2024-11-26 15:50:55.308487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.977 [2024-11-26 15:50:55.308652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.977 [2024-11-26 15:50:55.308672] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.977 [2024-11-26 15:50:55.308695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.977 [2024-11-26 15:50:55.310586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.977 [2024-11-26 15:50:55.320146] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.977 [2024-11-26 15:50:55.320393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.320556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.320582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.977 [2024-11-26 15:50:55.320597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.977 [2024-11-26 15:50:55.320738] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.977 [2024-11-26 15:50:55.320904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.977 [2024-11-26 15:50:55.320924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.977 [2024-11-26 15:50:55.320943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.977 [2024-11-26 15:50:55.322984] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.977 [2024-11-26 15:50:55.332523] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.977 [2024-11-26 15:50:55.332848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.333019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.333044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.977 [2024-11-26 15:50:55.333060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.977 [2024-11-26 15:50:55.333175] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.977 [2024-11-26 15:50:55.333326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.977 [2024-11-26 15:50:55.333346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.977 [2024-11-26 15:50:55.333360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.977 [2024-11-26 15:50:55.335366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.977 [2024-11-26 15:50:55.344867] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.977 [2024-11-26 15:50:55.345162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.345300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.345325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.977 [2024-11-26 15:50:55.345341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.977 [2024-11-26 15:50:55.345489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.977 [2024-11-26 15:50:55.345637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.977 [2024-11-26 15:50:55.345657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.977 [2024-11-26 15:50:55.345670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.977 [2024-11-26 15:50:55.347851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.977 [2024-11-26 15:50:55.357286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.977 [2024-11-26 15:50:55.357561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.357702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.357728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.977 [2024-11-26 15:50:55.357744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.977 [2024-11-26 15:50:55.357876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.977 [2024-11-26 15:50:55.358026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.977 [2024-11-26 15:50:55.358046] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.977 [2024-11-26 15:50:55.358059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.977 [2024-11-26 15:50:55.360098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.977 [2024-11-26 15:50:55.369452] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.977 [2024-11-26 15:50:55.369751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.369879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.369905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.977 [2024-11-26 15:50:55.369921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.977 [2024-11-26 15:50:55.370036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.977 [2024-11-26 15:50:55.370202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.977 [2024-11-26 15:50:55.370222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.977 [2024-11-26 15:50:55.370235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.977 [2024-11-26 15:50:55.372209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.977 [2024-11-26 15:50:55.381783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.977 [2024-11-26 15:50:55.382071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.382215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.977 [2024-11-26 15:50:55.382241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.977 [2024-11-26 15:50:55.382257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.978 [2024-11-26 15:50:55.382405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.978 [2024-11-26 15:50:55.382584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.978 [2024-11-26 15:50:55.382605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.978 [2024-11-26 15:50:55.382618] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.978 [2024-11-26 15:50:55.384787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.978 [2024-11-26 15:50:55.393949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.978 [2024-11-26 15:50:55.394247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.978 [2024-11-26 15:50:55.394356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.978 [2024-11-26 15:50:55.394383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.978 [2024-11-26 15:50:55.394399] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.978 [2024-11-26 15:50:55.394547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.978 [2024-11-26 15:50:55.394703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.978 [2024-11-26 15:50:55.394724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.978 [2024-11-26 15:50:55.394737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.978 [2024-11-26 15:50:55.396816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.978 [2024-11-26 15:50:55.406030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.978 [2024-11-26 15:50:55.406357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.978 [2024-11-26 15:50:55.406490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.978 [2024-11-26 15:50:55.406516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.978 [2024-11-26 15:50:55.406531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.978 [2024-11-26 15:50:55.406680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.978 [2024-11-26 15:50:55.406885] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.978 [2024-11-26 15:50:55.406906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.978 [2024-11-26 15:50:55.406920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.978 [2024-11-26 15:50:55.408833] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.978 [2024-11-26 15:50:55.418364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.978 [2024-11-26 15:50:55.418587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.978 [2024-11-26 15:50:55.418763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.978 [2024-11-26 15:50:55.418791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:03.978 [2024-11-26 15:50:55.418807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:03.978 [2024-11-26 15:50:55.418923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:03.978 [2024-11-26 15:50:55.419089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.978 [2024-11-26 15:50:55.419109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.978 [2024-11-26 15:50:55.419122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.978 [2024-11-26 15:50:55.421159] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.238 [2024-11-26 15:50:55.430705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.238 [2024-11-26 15:50:55.430966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.238 [2024-11-26 15:50:55.431106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.238 [2024-11-26 15:50:55.431134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.238 [2024-11-26 15:50:55.431150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.238 [2024-11-26 15:50:55.431298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.238 [2024-11-26 15:50:55.431478] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.239 [2024-11-26 15:50:55.431499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.239 [2024-11-26 15:50:55.431512] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.239 [2024-11-26 15:50:55.433504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.239 [2024-11-26 15:50:55.442953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.239 [2024-11-26 15:50:55.443222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.443355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.443381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.239 [2024-11-26 15:50:55.443396] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.239 [2024-11-26 15:50:55.443513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.239 [2024-11-26 15:50:55.443735] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.239 [2024-11-26 15:50:55.443757] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.239 [2024-11-26 15:50:55.443771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.239 [2024-11-26 15:50:55.445808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.239 [2024-11-26 15:50:55.455075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.239 [2024-11-26 15:50:55.455368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.455501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.455527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.239 [2024-11-26 15:50:55.455542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.239 [2024-11-26 15:50:55.455674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.239 [2024-11-26 15:50:55.455834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.239 [2024-11-26 15:50:55.455855] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.239 [2024-11-26 15:50:55.455870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.239 [2024-11-26 15:50:55.457961] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.239 [2024-11-26 15:50:55.467313] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.239 [2024-11-26 15:50:55.467642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.467784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.467811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.239 [2024-11-26 15:50:55.467826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.239 [2024-11-26 15:50:55.467958] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.239 [2024-11-26 15:50:55.468138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.239 [2024-11-26 15:50:55.468158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.239 [2024-11-26 15:50:55.468172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.239 [2024-11-26 15:50:55.470220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.239 [2024-11-26 15:50:55.479621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.239 [2024-11-26 15:50:55.479896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.480009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.480035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.239 [2024-11-26 15:50:55.480055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.239 [2024-11-26 15:50:55.480234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.239 [2024-11-26 15:50:55.480413] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.239 [2024-11-26 15:50:55.480433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.239 [2024-11-26 15:50:55.480446] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.239 [2024-11-26 15:50:55.482502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.239 [2024-11-26 15:50:55.491967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.239 [2024-11-26 15:50:55.492243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.492377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.492404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.239 [2024-11-26 15:50:55.492420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.239 [2024-11-26 15:50:55.492520] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.239 [2024-11-26 15:50:55.492670] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.239 [2024-11-26 15:50:55.492711] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.239 [2024-11-26 15:50:55.492727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.239 [2024-11-26 15:50:55.494788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.239 [2024-11-26 15:50:55.504277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.239 [2024-11-26 15:50:55.504582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.504730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.504757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.239 [2024-11-26 15:50:55.504773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.239 [2024-11-26 15:50:55.504954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.239 [2024-11-26 15:50:55.505117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.239 [2024-11-26 15:50:55.505138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.239 [2024-11-26 15:50:55.505151] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.239 [2024-11-26 15:50:55.507281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.239 [2024-11-26 15:50:55.516531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.239 [2024-11-26 15:50:55.516887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.516996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.517022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.239 [2024-11-26 15:50:55.517043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.239 [2024-11-26 15:50:55.517176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.239 [2024-11-26 15:50:55.517293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.239 [2024-11-26 15:50:55.517314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.239 [2024-11-26 15:50:55.517327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.239 [2024-11-26 15:50:55.519234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.239 [2024-11-26 15:50:55.528940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.239 [2024-11-26 15:50:55.529227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.529394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.529421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.239 [2024-11-26 15:50:55.529437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.239 [2024-11-26 15:50:55.529585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.239 [2024-11-26 15:50:55.529778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.239 [2024-11-26 15:50:55.529804] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.239 [2024-11-26 15:50:55.529819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.239 [2024-11-26 15:50:55.532089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.239 [2024-11-26 15:50:55.541164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.239 [2024-11-26 15:50:55.541456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.541627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.239 [2024-11-26 15:50:55.541653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.239 [2024-11-26 15:50:55.541669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.239 [2024-11-26 15:50:55.541826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.239 [2024-11-26 15:50:55.541931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.239 [2024-11-26 15:50:55.541952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.239 [2024-11-26 15:50:55.541965] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.240 [2024-11-26 15:50:55.544108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.240 [2024-11-26 15:50:55.553358] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.240 [2024-11-26 15:50:55.553641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.553793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.553819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.240 [2024-11-26 15:50:55.553835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.240 [2024-11-26 15:50:55.554025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.240 [2024-11-26 15:50:55.554190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.240 [2024-11-26 15:50:55.554210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.240 [2024-11-26 15:50:55.554224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.240 [2024-11-26 15:50:55.556266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.240 [2024-11-26 15:50:55.565797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.240 [2024-11-26 15:50:55.566065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.566228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.566254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.240 [2024-11-26 15:50:55.566270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.240 [2024-11-26 15:50:55.566434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.240 [2024-11-26 15:50:55.566584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.240 [2024-11-26 15:50:55.566604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.240 [2024-11-26 15:50:55.566617] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.240 [2024-11-26 15:50:55.568596] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.240 [2024-11-26 15:50:55.578062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.240 [2024-11-26 15:50:55.578391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.578500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.578525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.240 [2024-11-26 15:50:55.578541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.240 [2024-11-26 15:50:55.578697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.240 [2024-11-26 15:50:55.578882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.240 [2024-11-26 15:50:55.578903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.240 [2024-11-26 15:50:55.578917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.240 [2024-11-26 15:50:55.581140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.240 [2024-11-26 15:50:55.590267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.240 [2024-11-26 15:50:55.590547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.590678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.590711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.240 [2024-11-26 15:50:55.590727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.240 [2024-11-26 15:50:55.590892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.240 [2024-11-26 15:50:55.591078] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.240 [2024-11-26 15:50:55.591099] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.240 [2024-11-26 15:50:55.591112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.240 [2024-11-26 15:50:55.593014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.240 [2024-11-26 15:50:55.602581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.240 [2024-11-26 15:50:55.602940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.603076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.603102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.240 [2024-11-26 15:50:55.603118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.240 [2024-11-26 15:50:55.603266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.240 [2024-11-26 15:50:55.603431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.240 [2024-11-26 15:50:55.603451] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.240 [2024-11-26 15:50:55.603465] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.240 [2024-11-26 15:50:55.605421] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.240 [2024-11-26 15:50:55.614949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.240 [2024-11-26 15:50:55.615280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.615419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.615445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.240 [2024-11-26 15:50:55.615461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.240 [2024-11-26 15:50:55.615658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.240 [2024-11-26 15:50:55.615830] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.240 [2024-11-26 15:50:55.615851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.240 [2024-11-26 15:50:55.615864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.240 [2024-11-26 15:50:55.617912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.240 [2024-11-26 15:50:55.627247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.240 [2024-11-26 15:50:55.627539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.627654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.627680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.240 [2024-11-26 15:50:55.627704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.240 [2024-11-26 15:50:55.627854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.240 [2024-11-26 15:50:55.627988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.240 [2024-11-26 15:50:55.628013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.240 [2024-11-26 15:50:55.628027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.240 [2024-11-26 15:50:55.629971] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.240 [2024-11-26 15:50:55.639571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.240 [2024-11-26 15:50:55.639884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.640019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.640045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.240 [2024-11-26 15:50:55.640061] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.240 [2024-11-26 15:50:55.640193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.240 [2024-11-26 15:50:55.640344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.240 [2024-11-26 15:50:55.640364] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.240 [2024-11-26 15:50:55.640377] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.240 [2024-11-26 15:50:55.642530] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.240 [2024-11-26 15:50:55.651905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.240 [2024-11-26 15:50:55.652191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.652302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.652329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.240 [2024-11-26 15:50:55.652344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.240 [2024-11-26 15:50:55.652493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.240 [2024-11-26 15:50:55.652729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.240 [2024-11-26 15:50:55.652751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.240 [2024-11-26 15:50:55.652765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.240 [2024-11-26 15:50:55.655013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.240 [2024-11-26 15:50:55.664062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.240 [2024-11-26 15:50:55.664319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.240 [2024-11-26 15:50:55.664432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.241 [2024-11-26 15:50:55.664458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.241 [2024-11-26 15:50:55.664474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.241 [2024-11-26 15:50:55.664606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.241 [2024-11-26 15:50:55.664717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.241 [2024-11-26 15:50:55.664739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.241 [2024-11-26 15:50:55.664758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.241 [2024-11-26 15:50:55.666910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.241 [2024-11-26 15:50:55.676425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.241 [2024-11-26 15:50:55.676728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.241 [2024-11-26 15:50:55.676843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.241 [2024-11-26 15:50:55.676869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.241 [2024-11-26 15:50:55.676885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.241 [2024-11-26 15:50:55.677050] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.241 [2024-11-26 15:50:55.677230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.241 [2024-11-26 15:50:55.677252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.241 [2024-11-26 15:50:55.677266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.241 [2024-11-26 15:50:55.679241] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.502 [2024-11-26 15:50:55.688580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.502 [2024-11-26 15:50:55.688914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.502 [2024-11-26 15:50:55.689051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.502 [2024-11-26 15:50:55.689078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.502 [2024-11-26 15:50:55.689093] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.502 [2024-11-26 15:50:55.689257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.502 [2024-11-26 15:50:55.689406] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.502 [2024-11-26 15:50:55.689427] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.502 [2024-11-26 15:50:55.689440] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.502 [2024-11-26 15:50:55.691523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.502 [2024-11-26 15:50:55.700775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.502 [2024-11-26 15:50:55.701160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.502 [2024-11-26 15:50:55.701321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.502 [2024-11-26 15:50:55.701347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.502 [2024-11-26 15:50:55.701363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.502 [2024-11-26 15:50:55.701463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.502 [2024-11-26 15:50:55.701701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.502 [2024-11-26 15:50:55.701723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.502 [2024-11-26 15:50:55.701737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.502 [2024-11-26 15:50:55.703795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.502 [2024-11-26 15:50:55.712930] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.502 [2024-11-26 15:50:55.713225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.502 [2024-11-26 15:50:55.713366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.502 [2024-11-26 15:50:55.713393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.502 [2024-11-26 15:50:55.713409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.502 [2024-11-26 15:50:55.713541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.502 [2024-11-26 15:50:55.713746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.503 [2024-11-26 15:50:55.713767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.503 [2024-11-26 15:50:55.713780] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.503 [2024-11-26 15:50:55.715803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.503 [2024-11-26 15:50:55.725233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.503 [2024-11-26 15:50:55.725560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.725702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.725729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.503 [2024-11-26 15:50:55.725744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.503 [2024-11-26 15:50:55.725876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.503 [2024-11-26 15:50:55.726043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.503 [2024-11-26 15:50:55.726064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.503 [2024-11-26 15:50:55.726078] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.503 [2024-11-26 15:50:55.728184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.503 [2024-11-26 15:50:55.737501] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.503 [2024-11-26 15:50:55.738168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.738271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.738297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.503 [2024-11-26 15:50:55.738312] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.503 [2024-11-26 15:50:55.738428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.503 [2024-11-26 15:50:55.738563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.503 [2024-11-26 15:50:55.738583] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.503 [2024-11-26 15:50:55.738597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.503 15:50:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:04.503 15:50:55 -- common/autotest_common.sh@862 -- # return 0 00:27:04.503 15:50:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:04.503 [2024-11-26 15:50:55.740660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.503 15:50:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:04.503 15:50:55 -- common/autotest_common.sh@10 -- # set +x 00:27:04.503 [2024-11-26 15:50:55.749865] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.503 [2024-11-26 15:50:55.750241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.750405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.750431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.503 [2024-11-26 15:50:55.750447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.503 [2024-11-26 15:50:55.750596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.503 [2024-11-26 15:50:55.750771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.503 [2024-11-26 15:50:55.750794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.503 [2024-11-26 15:50:55.750808] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.503 [2024-11-26 15:50:55.752915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.503 [2024-11-26 15:50:55.762286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.503 [2024-11-26 15:50:55.762658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.762800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.762826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.503 [2024-11-26 15:50:55.762843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.503 [2024-11-26 15:50:55.762976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.503 [2024-11-26 15:50:55.763120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.503 [2024-11-26 15:50:55.763141] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.503 [2024-11-26 15:50:55.763154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.503 [2024-11-26 15:50:55.765242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.503 15:50:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:04.503 15:50:55 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:04.503 15:50:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:04.503 15:50:55 -- common/autotest_common.sh@10 -- # set +x 00:27:04.503 [2024-11-26 15:50:55.769436] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:04.503 [2024-11-26 15:50:55.774420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.503 [2024-11-26 15:50:55.774780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.774909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.774935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.503 [2024-11-26 15:50:55.774950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.503 [2024-11-26 15:50:55.775082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.503 15:50:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:04.503 [2024-11-26 15:50:55.775257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.503 [2024-11-26 15:50:55.775278] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.503 [2024-11-26 15:50:55.775291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.503 15:50:55 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:04.503 15:50:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:04.503 15:50:55 -- common/autotest_common.sh@10 -- # set +x 00:27:04.503 [2024-11-26 15:50:55.777351] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.503 [2024-11-26 15:50:55.786786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.503 [2024-11-26 15:50:55.787127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.787267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.787294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.503 [2024-11-26 15:50:55.787310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.503 [2024-11-26 15:50:55.787426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.503 [2024-11-26 15:50:55.787620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.503 [2024-11-26 15:50:55.787640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.503 [2024-11-26 15:50:55.787653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.503 [2024-11-26 15:50:55.789915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.503 [2024-11-26 15:50:55.799395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.503 [2024-11-26 15:50:55.799662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.799819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.799846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.503 [2024-11-26 15:50:55.799861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.503 [2024-11-26 15:50:55.799962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.503 [2024-11-26 15:50:55.800160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.503 [2024-11-26 15:50:55.800181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.503 [2024-11-26 15:50:55.800194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.503 [2024-11-26 15:50:55.802465] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.503 [2024-11-26 15:50:55.811627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.503 [2024-11-26 15:50:55.812135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.812323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.503 [2024-11-26 15:50:55.812351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.503 [2024-11-26 15:50:55.812372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.503 [2024-11-26 15:50:55.812533] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.503 [2024-11-26 15:50:55.812728] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.503 [2024-11-26 15:50:55.812757] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.503 [2024-11-26 15:50:55.812774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.503 [2024-11-26 15:50:55.814910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.503 Malloc0 00:27:04.503 15:50:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:04.504 15:50:55 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:04.504 15:50:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:04.504 15:50:55 -- common/autotest_common.sh@10 -- # set +x 00:27:04.504 [2024-11-26 15:50:55.824154] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.504 [2024-11-26 15:50:55.824493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.504 [2024-11-26 15:50:55.824616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.504 [2024-11-26 15:50:55.824642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.504 [2024-11-26 15:50:55.824659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.504 [2024-11-26 15:50:55.824816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.504 [2024-11-26 15:50:55.824952] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.504 [2024-11-26 15:50:55.824988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.504 [2024-11-26 15:50:55.825002] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.504 15:50:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:04.504 15:50:55 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:04.504 [2024-11-26 15:50:55.827226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.504 15:50:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:04.504 15:50:55 -- common/autotest_common.sh@10 -- # set +x 00:27:04.504 15:50:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:04.504 15:50:55 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:04.504 15:50:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:04.504 15:50:55 -- common/autotest_common.sh@10 -- # set +x 00:27:04.504 [2024-11-26 15:50:55.836463] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.504 [2024-11-26 15:50:55.836775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.504 [2024-11-26 15:50:55.836915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.504 [2024-11-26 15:50:55.836941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1747160 with addr=10.0.0.2, port=4420 00:27:04.504 [2024-11-26 15:50:55.836957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1747160 is same with the state(5) to be set 00:27:04.504 [2024-11-26 15:50:55.837122] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1747160 (9): Bad file descriptor 00:27:04.504 [2024-11-26 15:50:55.837317] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.504 [2024-11-26 15:50:55.837338] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.504 [2024-11-26 15:50:55.837351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.504 [2024-11-26 15:50:55.839073] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:04.504 [2024-11-26 15:50:55.839468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.504 15:50:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:04.504 15:50:55 -- host/bdevperf.sh@38 -- # wait 981729 00:27:04.504 [2024-11-26 15:50:55.849122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.504 [2024-11-26 15:50:55.925191] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:14.482 00:27:14.482 Latency(us) 00:27:14.482 [2024-11-26T14:51:05.935Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:14.482 [2024-11-26T14:51:05.935Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:14.482 Verification LBA range: start 0x0 length 0x4000 00:27:14.482 Nvme1n1 : 15.01 8849.03 34.57 15948.17 0.00 5146.93 849.54 19515.16 00:27:14.482 [2024-11-26T14:51:05.935Z] =================================================================================================================== 00:27:14.482 [2024-11-26T14:51:05.935Z] Total : 8849.03 34.57 15948.17 0.00 5146.93 849.54 19515.16 00:27:14.482 15:51:04 -- host/bdevperf.sh@39 -- # sync 00:27:14.482 15:51:04 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:14.482 15:51:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:14.482 15:51:04 -- common/autotest_common.sh@10 -- # set +x 00:27:14.482 15:51:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:14.482 15:51:04 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:14.482 15:51:04 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:14.482 15:51:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:14.482 15:51:04 -- nvmf/common.sh@116 -- # sync 00:27:14.482 15:51:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:14.482 15:51:04 -- nvmf/common.sh@119 -- # set +e 00:27:14.482 15:51:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:14.482 15:51:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:14.482 rmmod nvme_tcp 00:27:14.482 rmmod nvme_fabrics 00:27:14.482 rmmod nvme_keyring 00:27:14.482 15:51:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:14.482 15:51:04 -- nvmf/common.sh@123 -- # set -e 00:27:14.482 15:51:04 -- nvmf/common.sh@124 -- # return 0 00:27:14.482 15:51:04 -- nvmf/common.sh@477 -- # '[' -n 982382 ']' 00:27:14.482 15:51:04 -- nvmf/common.sh@478 -- # killprocess 982382 00:27:14.482 15:51:04 -- common/autotest_common.sh@936 -- # '[' -z 982382 ']' 00:27:14.482 15:51:04 -- common/autotest_common.sh@940 -- # kill -0 982382 00:27:14.482 15:51:04 -- common/autotest_common.sh@941 -- # uname 00:27:14.482 15:51:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:14.482 15:51:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 982382 00:27:14.482 15:51:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:14.482 15:51:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:14.482 15:51:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 982382' 00:27:14.482 killing process with pid 982382 00:27:14.482 15:51:04 -- common/autotest_common.sh@955 -- # kill 982382 00:27:14.482 15:51:04 -- common/autotest_common.sh@960 -- # wait 982382 00:27:14.482 15:51:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:14.482 15:51:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:14.482 15:51:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:14.482 15:51:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:14.482 15:51:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:14.482 15:51:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:14.482 15:51:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:14.482 15:51:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:15.863 15:51:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:15.863 00:27:15.863 real 0m23.425s 00:27:15.863 user 1m2.259s 00:27:15.863 sys 0m4.648s 00:27:15.863 15:51:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:15.863 15:51:06 -- common/autotest_common.sh@10 -- # set +x 00:27:15.863 ************************************ 00:27:15.863 END TEST nvmf_bdevperf 00:27:15.863 ************************************ 00:27:15.863 15:51:06 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:15.863 15:51:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:15.863 15:51:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:15.863 15:51:06 -- common/autotest_common.sh@10 -- # set +x 00:27:15.863 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:27:15.863 ************************************ 00:27:15.863 START TEST nvmf_target_disconnect 00:27:15.863 ************************************ 00:27:15.863 15:51:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:15.863 * Looking for test storage... 00:27:15.863 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:15.863 15:51:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:15.863 15:51:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:15.863 15:51:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:15.863 15:51:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:15.863 15:51:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:15.863 15:51:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:15.863 15:51:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:15.863 15:51:07 -- scripts/common.sh@335 -- # IFS=.-: 00:27:15.863 15:51:07 -- scripts/common.sh@335 -- # read -ra ver1 00:27:15.863 15:51:07 -- scripts/common.sh@336 -- # IFS=.-: 00:27:15.863 15:51:07 -- scripts/common.sh@336 -- # read -ra ver2 00:27:15.863 15:51:07 -- scripts/common.sh@337 -- # local 'op=<' 00:27:15.863 15:51:07 -- scripts/common.sh@339 -- # ver1_l=2 00:27:15.863 15:51:07 -- scripts/common.sh@340 -- # ver2_l=1 00:27:15.863 15:51:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:15.863 15:51:07 -- scripts/common.sh@343 -- # case "$op" in 00:27:15.863 15:51:07 -- scripts/common.sh@344 -- # : 1 00:27:15.863 15:51:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:15.863 15:51:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:15.863 15:51:07 -- scripts/common.sh@364 -- # decimal 1 00:27:15.863 15:51:07 -- scripts/common.sh@352 -- # local d=1 00:27:15.863 15:51:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:15.863 15:51:07 -- scripts/common.sh@354 -- # echo 1 00:27:15.863 15:51:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:15.863 15:51:07 -- scripts/common.sh@365 -- # decimal 2 00:27:15.863 15:51:07 -- scripts/common.sh@352 -- # local d=2 00:27:15.863 15:51:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:15.863 15:51:07 -- scripts/common.sh@354 -- # echo 2 00:27:15.863 15:51:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:15.863 15:51:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:15.863 15:51:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:15.863 15:51:07 -- scripts/common.sh@367 -- # return 0 00:27:15.863 15:51:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:15.863 15:51:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:15.863 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:15.863 --rc genhtml_branch_coverage=1 00:27:15.863 --rc genhtml_function_coverage=1 00:27:15.863 --rc genhtml_legend=1 00:27:15.863 --rc geninfo_all_blocks=1 00:27:15.863 --rc geninfo_unexecuted_blocks=1 00:27:15.863 00:27:15.863 ' 00:27:15.863 15:51:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:15.863 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:15.863 --rc genhtml_branch_coverage=1 00:27:15.863 --rc genhtml_function_coverage=1 00:27:15.863 --rc genhtml_legend=1 00:27:15.863 --rc geninfo_all_blocks=1 00:27:15.863 --rc geninfo_unexecuted_blocks=1 00:27:15.863 00:27:15.863 ' 00:27:15.863 15:51:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:15.863 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:15.863 --rc genhtml_branch_coverage=1 00:27:15.863 --rc genhtml_function_coverage=1 00:27:15.863 --rc genhtml_legend=1 00:27:15.863 --rc geninfo_all_blocks=1 00:27:15.863 --rc geninfo_unexecuted_blocks=1 00:27:15.863 00:27:15.863 ' 00:27:15.863 15:51:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:15.863 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:15.863 --rc genhtml_branch_coverage=1 00:27:15.863 --rc genhtml_function_coverage=1 00:27:15.863 --rc genhtml_legend=1 00:27:15.863 --rc geninfo_all_blocks=1 00:27:15.863 --rc geninfo_unexecuted_blocks=1 00:27:15.863 00:27:15.863 ' 00:27:15.863 15:51:07 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:15.863 15:51:07 -- nvmf/common.sh@7 -- # uname -s 00:27:15.863 15:51:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:15.863 15:51:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:15.863 15:51:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:15.863 15:51:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:15.863 15:51:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:15.863 15:51:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:15.863 15:51:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:15.863 15:51:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:15.863 15:51:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:15.863 15:51:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:15.863 15:51:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:15.863 15:51:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:15.863 15:51:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:15.863 15:51:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:15.863 15:51:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:15.863 15:51:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:15.863 15:51:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:15.863 15:51:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:15.863 15:51:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:15.863 15:51:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.864 15:51:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.864 15:51:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.864 15:51:07 -- paths/export.sh@5 -- # export PATH 00:27:15.864 15:51:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.864 15:51:07 -- nvmf/common.sh@46 -- # : 0 00:27:15.864 15:51:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:15.864 15:51:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:15.864 15:51:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:15.864 15:51:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:15.864 15:51:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:15.864 15:51:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:15.864 15:51:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:15.864 15:51:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:15.864 15:51:07 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:15.864 15:51:07 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:15.864 15:51:07 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:15.864 15:51:07 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:15.864 15:51:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:15.864 15:51:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:15.864 15:51:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:15.864 15:51:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:15.864 15:51:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:15.864 15:51:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:15.864 15:51:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:15.864 15:51:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:15.864 15:51:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:15.864 15:51:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:15.864 15:51:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:15.864 15:51:07 -- common/autotest_common.sh@10 -- # set +x 00:27:17.769 15:51:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:17.769 15:51:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:17.769 15:51:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:17.769 15:51:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:17.769 15:51:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:17.769 15:51:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:17.769 15:51:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:17.769 15:51:09 -- nvmf/common.sh@294 -- # net_devs=() 00:27:17.769 15:51:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:17.769 15:51:09 -- nvmf/common.sh@295 -- # e810=() 00:27:17.769 15:51:09 -- nvmf/common.sh@295 -- # local -ga e810 00:27:17.769 15:51:09 -- nvmf/common.sh@296 -- # x722=() 00:27:17.769 15:51:09 -- nvmf/common.sh@296 -- # local -ga x722 00:27:17.769 15:51:09 -- nvmf/common.sh@297 -- # mlx=() 00:27:17.769 15:51:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:17.769 15:51:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:17.769 15:51:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:17.769 15:51:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:17.769 15:51:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:17.769 15:51:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:17.769 15:51:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:17.769 15:51:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:17.769 15:51:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:17.769 15:51:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:17.769 15:51:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:17.769 15:51:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:17.769 15:51:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:17.769 15:51:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:17.769 15:51:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:17.769 15:51:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:17.769 15:51:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:17.769 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:17.769 15:51:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:17.769 15:51:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:17.769 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:17.769 15:51:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:17.769 15:51:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:17.769 15:51:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:17.769 15:51:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:17.769 15:51:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:17.769 15:51:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:17.769 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:17.769 15:51:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:17.769 15:51:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:17.769 15:51:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:17.769 15:51:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:17.769 15:51:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:17.769 15:51:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:17.769 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:17.769 15:51:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:17.769 15:51:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:17.769 15:51:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:17.769 15:51:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:17.769 15:51:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:17.769 15:51:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:17.769 15:51:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:17.769 15:51:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:17.769 15:51:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:17.769 15:51:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:17.769 15:51:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:17.769 15:51:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:17.769 15:51:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:17.769 15:51:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:17.769 15:51:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:17.769 15:51:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:17.769 15:51:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:17.769 15:51:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:18.029 15:51:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:18.029 15:51:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:18.029 15:51:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:18.029 15:51:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:18.029 15:51:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:18.029 15:51:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:18.029 15:51:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:18.029 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:18.029 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.302 ms 00:27:18.029 00:27:18.029 --- 10.0.0.2 ping statistics --- 00:27:18.029 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:18.029 rtt min/avg/max/mdev = 0.302/0.302/0.302/0.000 ms 00:27:18.029 15:51:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:18.029 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:18.029 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:27:18.029 00:27:18.029 --- 10.0.0.1 ping statistics --- 00:27:18.029 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:18.029 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:27:18.029 15:51:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:18.029 15:51:09 -- nvmf/common.sh@410 -- # return 0 00:27:18.029 15:51:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:18.029 15:51:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:18.029 15:51:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:18.029 15:51:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:18.029 15:51:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:18.029 15:51:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:18.029 15:51:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:18.029 15:51:09 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:18.029 15:51:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:18.029 15:51:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:18.029 15:51:09 -- common/autotest_common.sh@10 -- # set +x 00:27:18.029 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:27:18.029 ************************************ 00:27:18.029 START TEST nvmf_target_disconnect_tc1 00:27:18.029 ************************************ 00:27:18.029 15:51:09 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:18.029 15:51:09 -- host/target_disconnect.sh@32 -- # set +e 00:27:18.029 15:51:09 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:18.029 EAL: No free 2048 kB hugepages reported on node 1 00:27:18.029 [2024-11-26 15:51:09.402598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:18.029 [2024-11-26 15:51:09.402797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:18.029 [2024-11-26 15:51:09.402826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x221db40 with addr=10.0.0.2, port=4420 00:27:18.029 [2024-11-26 15:51:09.402864] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:18.029 [2024-11-26 15:51:09.402890] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:18.029 [2024-11-26 15:51:09.402903] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:18.029 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:18.029 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:18.029 Initializing NVMe Controllers 00:27:18.029 15:51:09 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:18.029 15:51:09 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:18.029 15:51:09 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:18.029 15:51:09 -- common/autotest_common.sh@1142 -- # return 0 00:27:18.029 15:51:09 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:18.029 15:51:09 -- host/target_disconnect.sh@41 -- # set -e 00:27:18.029 00:27:18.029 real 0m0.091s 00:27:18.029 user 0m0.039s 00:27:18.029 sys 0m0.052s 00:27:18.029 15:51:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:18.029 15:51:09 -- common/autotest_common.sh@10 -- # set +x 00:27:18.029 ************************************ 00:27:18.029 END TEST nvmf_target_disconnect_tc1 00:27:18.029 ************************************ 00:27:18.029 15:51:09 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:18.029 15:51:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:18.029 15:51:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:18.029 15:51:09 -- common/autotest_common.sh@10 -- # set +x 00:27:18.029 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:27:18.029 ************************************ 00:27:18.030 START TEST nvmf_target_disconnect_tc2 00:27:18.030 ************************************ 00:27:18.030 15:51:09 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:18.030 15:51:09 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:18.030 15:51:09 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:18.030 15:51:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:18.030 15:51:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:18.030 15:51:09 -- common/autotest_common.sh@10 -- # set +x 00:27:18.030 15:51:09 -- nvmf/common.sh@469 -- # nvmfpid=985840 00:27:18.030 15:51:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:18.030 15:51:09 -- nvmf/common.sh@470 -- # waitforlisten 985840 00:27:18.030 15:51:09 -- common/autotest_common.sh@829 -- # '[' -z 985840 ']' 00:27:18.030 15:51:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:18.030 15:51:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:18.030 15:51:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:18.030 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:18.030 15:51:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:18.030 15:51:09 -- common/autotest_common.sh@10 -- # set +x 00:27:18.289 [2024-11-26 15:51:09.483077] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:18.289 [2024-11-26 15:51:09.483178] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:18.289 EAL: No free 2048 kB hugepages reported on node 1 00:27:18.289 [2024-11-26 15:51:09.551884] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:18.289 [2024-11-26 15:51:09.665093] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:18.289 [2024-11-26 15:51:09.665258] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:18.289 [2024-11-26 15:51:09.665276] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:18.289 [2024-11-26 15:51:09.665288] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:18.289 [2024-11-26 15:51:09.665342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:18.289 [2024-11-26 15:51:09.665585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:18.289 [2024-11-26 15:51:09.665647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:18.289 [2024-11-26 15:51:09.665650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:19.224 15:51:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:19.224 15:51:10 -- common/autotest_common.sh@862 -- # return 0 00:27:19.224 15:51:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:19.224 15:51:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:19.224 15:51:10 -- common/autotest_common.sh@10 -- # set +x 00:27:19.224 15:51:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:19.224 15:51:10 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:19.224 15:51:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.224 15:51:10 -- common/autotest_common.sh@10 -- # set +x 00:27:19.224 Malloc0 00:27:19.224 15:51:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.224 15:51:10 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:19.224 15:51:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.224 15:51:10 -- common/autotest_common.sh@10 -- # set +x 00:27:19.224 [2024-11-26 15:51:10.562284] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:19.224 15:51:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.224 15:51:10 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:19.224 15:51:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.224 15:51:10 -- common/autotest_common.sh@10 -- # set +x 00:27:19.224 15:51:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.224 15:51:10 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:19.224 15:51:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.224 15:51:10 -- common/autotest_common.sh@10 -- # set +x 00:27:19.224 15:51:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.224 15:51:10 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:19.224 15:51:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.224 15:51:10 -- common/autotest_common.sh@10 -- # set +x 00:27:19.224 [2024-11-26 15:51:10.590568] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:19.224 15:51:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.224 15:51:10 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:19.224 15:51:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.224 15:51:10 -- common/autotest_common.sh@10 -- # set +x 00:27:19.224 15:51:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.224 15:51:10 -- host/target_disconnect.sh@50 -- # reconnectpid=986168 00:27:19.224 15:51:10 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:19.224 15:51:10 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:19.224 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.787 15:51:12 -- host/target_disconnect.sh@53 -- # kill -9 985840 00:27:21.787 15:51:12 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:21.787 Read completed with error (sct=0, sc=8) 00:27:21.787 starting I/O failed 00:27:21.787 Read completed with error (sct=0, sc=8) 00:27:21.787 starting I/O failed 00:27:21.787 Read completed with error (sct=0, sc=8) 00:27:21.787 starting I/O failed 00:27:21.787 Read completed with error (sct=0, sc=8) 00:27:21.787 starting I/O failed 00:27:21.787 Write completed with error (sct=0, sc=8) 00:27:21.787 starting I/O failed 00:27:21.787 Read completed with error (sct=0, sc=8) 00:27:21.787 starting I/O failed 00:27:21.787 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 [2024-11-26 15:51:12.615465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 [2024-11-26 15:51:12.615807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 [2024-11-26 15:51:12.616108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Write completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.788 Read completed with error (sct=0, sc=8) 00:27:21.788 starting I/O failed 00:27:21.789 Read completed with error (sct=0, sc=8) 00:27:21.789 starting I/O failed 00:27:21.789 Write completed with error (sct=0, sc=8) 00:27:21.789 starting I/O failed 00:27:21.789 Write completed with error (sct=0, sc=8) 00:27:21.789 starting I/O failed 00:27:21.789 Read completed with error (sct=0, sc=8) 00:27:21.789 starting I/O failed 00:27:21.789 Write completed with error (sct=0, sc=8) 00:27:21.789 starting I/O failed 00:27:21.789 Read completed with error (sct=0, sc=8) 00:27:21.789 starting I/O failed 00:27:21.789 Read completed with error (sct=0, sc=8) 00:27:21.789 starting I/O failed 00:27:21.789 Read completed with error (sct=0, sc=8) 00:27:21.789 starting I/O failed 00:27:21.789 Write completed with error (sct=0, sc=8) 00:27:21.789 starting I/O failed 00:27:21.789 [2024-11-26 15:51:12.616373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.789 [2024-11-26 15:51:12.616633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.616813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.616848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.616974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.617111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.617137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.617262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.617427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.617453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.617590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.617726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.617752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.617895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.618034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.618060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.618203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.618360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.618400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.618573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.618716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.618744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.618868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.618970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.618995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.619137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.619251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.619277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.619382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.619490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.619517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.619654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.619786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.619815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.619923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.620063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.620090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.620209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.620317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.620343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.620501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.620684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.620717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.620823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.620939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.620964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.621078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.621221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.621246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.621390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.621559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.621601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.621784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.621893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.621919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.622032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.622164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.622189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.622353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.622504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.622531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.622709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.622823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.622850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.622972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.623138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.623164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.623346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.623457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.623485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.623616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.623719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.623746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.623865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.623962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.623987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.789 [2024-11-26 15:51:12.624151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.624299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.789 [2024-11-26 15:51:12.624324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.789 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.624465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.624575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.624600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.624733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.624869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.624895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.625002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.625159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.625184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.625326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.625482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.625510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.625650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.625767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.625794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.625912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.626094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.626120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.626263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.626431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.626456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.626565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.626708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.626739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.626848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.626999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.627025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.627251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.627391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.627417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.627602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.627737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.627765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.627890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.628004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.628029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.628190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.628322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.628347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.628546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.628678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.628718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.628886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.628985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.629011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.629135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.629270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.629295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.629391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.629516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.629541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.629706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.630718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.630749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.630883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.631013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.631039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.631178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.631309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.631334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.631468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.631627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.631651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.631815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.631925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.631950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.632069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.632204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.632230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.632336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.632471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.632497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.632636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.632769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.632795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.632905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.633082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.633108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.633250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.633376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.633401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.633500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.633656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.633681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.790 qpair failed and we were unable to recover it. 00:27:21.790 [2024-11-26 15:51:12.633860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.790 [2024-11-26 15:51:12.633995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.634020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.634137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.634276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.634303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.634517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.634666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.634717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.634830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.634937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.634962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.635108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.635262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.635303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.635413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.635543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.635567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.635673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.635808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.635840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.635990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.636128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.636153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.636317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.636424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.636450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.636614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.636755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.636781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.636904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.637042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.637067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.637195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.637326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.637351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.637481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.637614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.637639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.637756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.637905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.637948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.638086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.638185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.638209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.638345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.638504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.638528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.638661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.638812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.638838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.638972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.639077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.639101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.639236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.639400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.639425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.639585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.639755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.639801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.639913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.640073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.640097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.640283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.640427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.640452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.640612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.640751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.640777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.640910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.641044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.641070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.641171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.641313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.641337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.641471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.641606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.641633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.641793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.641930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.641977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.642136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.642288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.642314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.642472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.642577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-11-26 15:51:12.642602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-11-26 15:51:12.642742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.642849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.642874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.642995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.643147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.643172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.643331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.643438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.643462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.643573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.643733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.643759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.643918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.644025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.644050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.644165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.644273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.644297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.644434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.644540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.644564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.644731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.644840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.644864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.645024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.645134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.645159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.645331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.645432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.645457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.645594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.645702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.645730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.645891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.646075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.646101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.646238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.646398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.646422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.646554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.646691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.646717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.646889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.647009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.647034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.647145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.647303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.647328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.647464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.647622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.647646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.647764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.647877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.647907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.648029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.648211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.648236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.648374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.648512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.648538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.648641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.648751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-11-26 15:51:12.648779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-11-26 15:51:12.648887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.649023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.649047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.649160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.649291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.649317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.649426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.649538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.649562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.649695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.649825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.649849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.649958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.650091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.650115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.650276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.650393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.650417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.650576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.650731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.650761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.650891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.651049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.651074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.651209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.651345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.651370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.651475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.651633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.651657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.651809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.651949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.651973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.652081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.652262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.652306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.652466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.652598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.652624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.652829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.652961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.652986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.653100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.653204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.653228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.653369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.653476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.653500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.653634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.653766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.653797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.653925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.654061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.654086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.654194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.654305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.654331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.654469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.654583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.654608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.654744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.654855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.654881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.655039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.655142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.655167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.655304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.655436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.655462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.655605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.655746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.655772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.655902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.656015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.656039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.656208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.656338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.656365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.656527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.656633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-11-26 15:51:12.656663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-11-26 15:51:12.656794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.656940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.656965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.657094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.657244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.657270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.657408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.657506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.657531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.657640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.657745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.657771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.657934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.658044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.658069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.658167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.658297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.658324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.658432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.658580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.658605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.658740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.658870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.658896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.659008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.659139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.659164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.659294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.659430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.659456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.659602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.659731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.659757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.659894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.660008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.660038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.660197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.660333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.660358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.660468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.660598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.660622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.660790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.660921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.660947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.661108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.661243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.661269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.661432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.661540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.661565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.661706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.661820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.661845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.661980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.662165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.662208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.662368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.662503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.662527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.662698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.662813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.662838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.663030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.663177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.663202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.663340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.663473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.663499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.663628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.663765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.663791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.663891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.664032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.664056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.664157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.664294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.664319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.664418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.664550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.664575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.664714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.664865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.664907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.665052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.665197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-11-26 15:51:12.665222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-11-26 15:51:12.665358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.665490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.665516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.665692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.665828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.665854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.665977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.666176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.666202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.666316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.666454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.666479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.666638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.666746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.666772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.666908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.667037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.667061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.667211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.667342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.667367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.667527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.667635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.667660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.667768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.667919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.667962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.668148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.668321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.668345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.668480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.668611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.668637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.668776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.668972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.669014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.669116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.669280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.669305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.669458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.669590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.669615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.669754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.669886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.669911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.670071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.670212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.670237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.670348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.670462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.670487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.670624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.670786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.670812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.670979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.671089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.671113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.671227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.671368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.671393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.671524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.671660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.671715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.671887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.672000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.672026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.672166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.672299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.672325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.672461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.672571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.672596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.672735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.672898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.672923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.673032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.673188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.673212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.673318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.673448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.673472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.673600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.673747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.673795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-11-26 15:51:12.673925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.674089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-11-26 15:51:12.674132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.674290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.674395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.674420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.674524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.674653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.674679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.674830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.674966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.674992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.675099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.675228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.675253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.675361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.675495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.675521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.675657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.675811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.675837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.675947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.676083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.676108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.676244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.676346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.676371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.676528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.676665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.676698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.676837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.676986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.677029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.677138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.677249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.677275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.677404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.677526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.677551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.677679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.677850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.677876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.678006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.678152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.678176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.678342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.678479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.678504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.678665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.678807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.678833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.678966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.679097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.679121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.679229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.679338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.679362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.679522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.679620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.679644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.679764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.679921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.679945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.680075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.680184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.680209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.680313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.680419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.680443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.680582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.680715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.680741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.680852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.680965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.680990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.681145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.681255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.681279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.681409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.681557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.681582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.681746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.681853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.681879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.681993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.682152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.682177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-11-26 15:51:12.682294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-11-26 15:51:12.682400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.682426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.682591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.682698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.682723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.682839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.682937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.682961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.683101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.683269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.683293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.683402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.683540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.683566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.683719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.683879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.683904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.684029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.684181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.684208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.684344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.684476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.684501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.684630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.684810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.684836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.684996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.685127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.685153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.685309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.685467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.685493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.685594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.685731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.685757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.685865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.685998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.686025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.686186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.686320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.686345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.686441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.686607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.686632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.686741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.686875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.686900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.686999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.687125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.687149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.687289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.687392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.687416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.687550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.687660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.687690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.687803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.687933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.687957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.688117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.688247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.688271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.688405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.688541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.688566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.688673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.688816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.688842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.689023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.689188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.689230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-11-26 15:51:12.689359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.689499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-11-26 15:51:12.689523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.689635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.689772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.689799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.689936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.690071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.690096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.690238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.690374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.690399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.690535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.690664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.690694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.690829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.690972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.690998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.691129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.691306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.691331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.691443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.691582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.691607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.691766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.691904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.691929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.692056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.692182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.692207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.692337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.692474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.692499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.692634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.692741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.692766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.692906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.693068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.693093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.693255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.693383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.693408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.693540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.693701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.693726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.693884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.693994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.694020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.694135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.694269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.694296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.694431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.694565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.694590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.694711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.694848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.694873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.695028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.695181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.695207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.695352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.695476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.695504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.695639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.695824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.695850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.695961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.696071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.696096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.696193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.696295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.696320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.696458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.696590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.696615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.696778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.696887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.696914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.697072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.697259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.697285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.697395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.697526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.697552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.697695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.697856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.697881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-11-26 15:51:12.697990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.698119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-11-26 15:51:12.698143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.698305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.698439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.698468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.698579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.698694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.698721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.698847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.698980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.699005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.699140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.699274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.699299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.699416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.699575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.699601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.699716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.699878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.699904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.700036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.700183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.700209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.700322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.700431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.700457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.700559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.700718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.700744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.700917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.701047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.701072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.701239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.701345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.701376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.701513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.701638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.701663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.701816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.701969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.701997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.702137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.702291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.702316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.702451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.702582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.702608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.702747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.702858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.702885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.703022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.703152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.703197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.703330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.703463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.703488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.703598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.703734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.703760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.703901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.704068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.704093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.704201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.704312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.704342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.704469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.704597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.704623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.704744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.704890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.704916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.705053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.705160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.705186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.705328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.705461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.705485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.705597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.705728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.705754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.705858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.705995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.706021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.706180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.706319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-11-26 15:51:12.706343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-11-26 15:51:12.706489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.706621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.706645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.706791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.706965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.707008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.707137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.707267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.707310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.707448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.707581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.707608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.707749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.707955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.707996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.708132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.708257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.708283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.708417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.708513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.708538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.708666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.708810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.708837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.708998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.709156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.709182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.709294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.709430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.709454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.709619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.709743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.709772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.709962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.710126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.710168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.710333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.710468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.710495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.710662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.710820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.710846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.710960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.711054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.711079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.711211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.711313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.711338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.711435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.711535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.711562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.711699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.711867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.711892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.712049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.712229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.712256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.712433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.712568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.712593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.712742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.712878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.712921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.713076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.713311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.713368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.713502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.713642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.713667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.713799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.713958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.713982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.714110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.714266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.714291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.714448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.714582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.714606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.714742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.714908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.714950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.715141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.715316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-11-26 15:51:12.715358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-11-26 15:51:12.715467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.715579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.715604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.715754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.715903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.715927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.716055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.716221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.716246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.716368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.716495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.716520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.716692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.716800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.716825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.716963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.717065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.717090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.717224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.717389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.717415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.717512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.717643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.717669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.717850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.718022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.718048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.718219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.718365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.718391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.718503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.718665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.718696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.718816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.718991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.719017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.719147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.719302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.719327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.719489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.719595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.719620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.719782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.719946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.719990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.720125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.720304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.720328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.720461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.720599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.720623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.720782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.720981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.721024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.721182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.721333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.721357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.721488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.721624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.721648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.721838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.721982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.722025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.722175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.722353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.722377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.722517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.722681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.722713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.722817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.722958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.722982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-11-26 15:51:12.723135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.723332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-11-26 15:51:12.723375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.723512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.723649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.723674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.723822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.723962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.723986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.724120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.724288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.724313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.724476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.724640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.724665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.724814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.724946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.724971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.725104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.725270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.725295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.725459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.725591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.725615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.725768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.725985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.726010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.726146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.726248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.726274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.726387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.726550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.726575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.726740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.726894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.726936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.727106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.727262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.727287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.727448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.727585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.727610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.727743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.727893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.727937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.728095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.728241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.728267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.728404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.728503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.728529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.728635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.728755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.728784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.728938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.729100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.729124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.729258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.729394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.729418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.729575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.729714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.729740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.729879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.730027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.730051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.730182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.730335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.730360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.730491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.730588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.730613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.730795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.730914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.730939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.731072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.731209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.731234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.731398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.731555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.731580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.731711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.731826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.731851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.731997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.732143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.732168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-11-26 15:51:12.732293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-11-26 15:51:12.732427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.732452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.732615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.732748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.732791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.732945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.733086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.733130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.733312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.733467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.733492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.733653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.733824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.733849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.733984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.734127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.734168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.734329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.734489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.734514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.734653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.734787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.734829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.734931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.735080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.735122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.735312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.735457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.735483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.735645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.735830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.735857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.735967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.736129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.736153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.736308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.736437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.736463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.736599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.736742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.736768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.736874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.737007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.737034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.737173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.737306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.737332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.737443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.737601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.737626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.737747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.737939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.737965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.738127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.738286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.738311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.738412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.738516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.738541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.738678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.738815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.738840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.738984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.739144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.739169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.739279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.739421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.739446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.739608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.739741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.739767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.739870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.740024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.740065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.740202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.740331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.740357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.740461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.740566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.740593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.740754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.740925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.740968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-11-26 15:51:12.741122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-11-26 15:51:12.741269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.741294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.741454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.741615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.741640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.741787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.741896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.741921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.742057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.742186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.742210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.742369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.742509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.742534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.742671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.742790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.742817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.742982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.743142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.743168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.743275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.743432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.743457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.743615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.743755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.743781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.743908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.744010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.744037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.744176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.744325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.744350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.744455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.744564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.744589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.744738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.744873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.744898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.745059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.745220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.745245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.745357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.745465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.745494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.745604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.745705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.745731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.745858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.745992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.746017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.746150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.746286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.746310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.746441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.746575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.746599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.746777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.746964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.746989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.747104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.747208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.747235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.747367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.747505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.747530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.747663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.747774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.747800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.747920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.748065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.748089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.748307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.748466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.748496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.748631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.748795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.748839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.749022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.749206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.749237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.749388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.749551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.749576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-11-26 15:51:12.749678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.749837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-11-26 15:51:12.749879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.750011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.750218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.750260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.750396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.750529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.750554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.750679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.750812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.750837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.750975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.751174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.751218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.751348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.751454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.751480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.751653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.751832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.751863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.752020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.752187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.752230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.752393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.752521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.752545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.752673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.752828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.752870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.753029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.753228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.753255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.753407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.753539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.753564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.753676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.753818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.753843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.753975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.754138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.754163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.754293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.754426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.754452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.754585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.754698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.754724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.754850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.754988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.755013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.755179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.755309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.755333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.755467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.755595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.755619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.755805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.755950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.755992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.756153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.756287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.756312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.756449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.756610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.756635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.756798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.756935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.756963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.757134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.757284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.757309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.757440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.757572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.757597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.757750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.757922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.757964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.758121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.758274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.758299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.758442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.758570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.758596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-11-26 15:51:12.758750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.758900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-11-26 15:51:12.758941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.759053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.759186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.759210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.759326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.759487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.759511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.759617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.759746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.759771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.759882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.760015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.760039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.760145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.760280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.760304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.760404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.760530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.760555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.760683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.760803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.760828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.760940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.761045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.761069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.761184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.761314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.761338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.761443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.761552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.761578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.761695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.761817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.761860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.762001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.762135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.762160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.762299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.762432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.762456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.762588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.762700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.762726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.762856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.762987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.763029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.763190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.763319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.763346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.763507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.763643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.763667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.763821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.763946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.763971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.764116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.764245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.764270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.764407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.764547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.764572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.764678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.764823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.764847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.764964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.765084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.765110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.765213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.765343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.765367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.765530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.765624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.765648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.765825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.765950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-11-26 15:51:12.765975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-11-26 15:51:12.766158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.766284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.766310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.766450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.766614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.766638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.766775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.766900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.766942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.767075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.767208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.767233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.767375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.767505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.767531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.767698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.767849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.767891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.768134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.768377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.768405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.768581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.768720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.768744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.768908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.769030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.769055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.769191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.769349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.769391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.769530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.769656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.769680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.769821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.769954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.769979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.770097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.770265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.770308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.770417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.770553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.770577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.770677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.770840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.770868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.771068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.771199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.771226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.771404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.771512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.771538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.771673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.771798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.771823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.771924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.772087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.772112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.772217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.772375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.772399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.772538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.772670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.772704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.772865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.773025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.773070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.773183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.773321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.773347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.773488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.773651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.773675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.773799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.773926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.773951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.774113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.774247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.774272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.774406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.774539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.774563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.774700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.774846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.774888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-11-26 15:51:12.775021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.775121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-11-26 15:51:12.775146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.775252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.775388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.775412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.775549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.775713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.775739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.775906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.776006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.776031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.776141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.776275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.776300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.776448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.776604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.776629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.776754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.776894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.776922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.777091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.777232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.777256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.777382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.777514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.777539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.777700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.777853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.777895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.778060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.778172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.778197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.778332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.778491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.778516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.778626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.778831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.778857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.778996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.779143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.779170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.779352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.779486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.779511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.779611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.779734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.779761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.779872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.780011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.780036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.780165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.780272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.780297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.780457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.780592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.780616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.780793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.780980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.781006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.781162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.781306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.781331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.781492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.781629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.781654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.781848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.782055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.782098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.782307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.782467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.782492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.782622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.782774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.782818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.782942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.783123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.783149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.783309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.783410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.783435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.783568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.783745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.783789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.783959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.784114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.784139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-11-26 15:51:12.784333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-11-26 15:51:12.784484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.784508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.784669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.784807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.784850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.785036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.785208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.785252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.785389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.785499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.785524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.785656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.785813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.785855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.785985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.786183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.786225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.786382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.786502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.786527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.786631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.786789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.786832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.786962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.787142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.787184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.787371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.787522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.787547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.787683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.787810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.787853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.787980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.788139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.788164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.788275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.788375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.788400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.788537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.788699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.788725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.788837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.788963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.788987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.789091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.789218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.789243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.789408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.789544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.789569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.789701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.789884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.789927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.790086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.790237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.790262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.790400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.790534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.790558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.790663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.790776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.790802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.790930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.791039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.791063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.791178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.791317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.791342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.791476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.791607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.791631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.791783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.791959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.791983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.792148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.792274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.792300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.792425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.792558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.792587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.792757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.792913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.792938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.793087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.793210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.793235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-11-26 15:51:12.793396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-11-26 15:51:12.793505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.793529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.793637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.793792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.793817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.793944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.794089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.794116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.794274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.794406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.794430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.794569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.794705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.794731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.794856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.795003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.795044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.795185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.795343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.795369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.795500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.795637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.795666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.795826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.795965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.795993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.796119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.796253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.796280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.796389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.796491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.796518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.796697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.796839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.796864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.796996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.797131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.797155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.797301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.797460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.797485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.797594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.797754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.797780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.797884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.798020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.798045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.798219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.798329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.798356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.798489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.798616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.798645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.798759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.798864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.798890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.799025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.799131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.799156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.799298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.799405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.799430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.799542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.799669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.799708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.799854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.799987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.800012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.800157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.800267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.800293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.800455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.800587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.800614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.800792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.800936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.800964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.801105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.801279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.801303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.801445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.801575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.801604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.801763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.801987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-11-26 15:51:12.802043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-11-26 15:51:12.802202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.802365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.802389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.802524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.802658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.802690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.802878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.803021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.803064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.803204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.803338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.803363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.803498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.803604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.803629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.803808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.804021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.804079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.804235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.804385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.804409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.804547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.804681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.804733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.804888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.805030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.805071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.805203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.805350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.805375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.805488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.805588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.805612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.805753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.805882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.805906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.806041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.806151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.806178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.806339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.806442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.806467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.806593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.806727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.806753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.806866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.806971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.806996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.807129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.807263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.807288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.807426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.807584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.807609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.807758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.807911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.807954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.808067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.808230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.808255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.808383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.808519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.808543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.808683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.808813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.808856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.809011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.809197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.809255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.809371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.809480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.809504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.809614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.809795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.809839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-11-26 15:51:12.810023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-11-26 15:51:12.810226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.810253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.810405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.810514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.810541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.810719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.810909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.810951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.811083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.811269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.811293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.811406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.811531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.811556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.811716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.811880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.811922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.812111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.812230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.812256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.812393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.812527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.812553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.812652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.812795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.812820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.812932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.813088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.813113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.813210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.813366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.813391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.813526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.813694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.813720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.813878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.814008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.814032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.814156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.814311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.814336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.814496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.814651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.814676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.814842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.815021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.815063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.815246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.815396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.815421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.815529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.815662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.815702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.815857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.816006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.816033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.816182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.816338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.816362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.816494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.816592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.816616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.816781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.816909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.816934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.817178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.817359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.817383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.817493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.817625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.817648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.817820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.817990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.818034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.818194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.818365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.818391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.818530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.818636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.818660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.818786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.818951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.818975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.819115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.819244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.819269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-11-26 15:51:12.819380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-11-26 15:51:12.819508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.819532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.819637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.819765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.819791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.819950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.820153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.820181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.820333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.820479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.820503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.820635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.820805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.820847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.821110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.821262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.821303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.821473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.821606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.821631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.821763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.821939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.821966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.822112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.822332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.822396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.822510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.822663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.822693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.822849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.822996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.823038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.823174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.823341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.823365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.823499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.823662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.823714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.823855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.824013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.824038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.824178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.824311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.824337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.824506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.824667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.824700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.824882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.825155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.825205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.825423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.825590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.825614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.825769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.825943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.825985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.826170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.826345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.826371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.826526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.826663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.826696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.826853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.827018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.827068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.827195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.827362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.827403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.827521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.827626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.827650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.827765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.827907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.827931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.828067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.828231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.828256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.828393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.828524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.828550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.828665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.828800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.828826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-11-26 15:51:12.828962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.829067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-11-26 15:51:12.829092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.829224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.829327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.829351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.829488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.829622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.829646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.829807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.829982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.830024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.830209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.830369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.830393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.830535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.830673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.830705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.830837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.831038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.831081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.831280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.831433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.831458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.831592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.831749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.831792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.832023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.832167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.832193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.832361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.832539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.832563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.832695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.832846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.832873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.833070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.833267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.833320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.833448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.833556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.833580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.833696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.833810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.833834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.833976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.834074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.834098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.834241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.834370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.834394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.834507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.834648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.834673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.834803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.834899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.834923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.835056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.835162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.835186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.835327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.835474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.835499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.835631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.835789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.835832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.835995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.836135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.836178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.836287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.836447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.836472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.836581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.836743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.836769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.836906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.837048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.837073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.837178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.837314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.837339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.837466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.837606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.837631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.837811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.837983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.838028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-11-26 15:51:12.838211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.838393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-11-26 15:51:12.838419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.838531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.838663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.838692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.838889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.839035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.839077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.839185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.839315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.839343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.839499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.839605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.839629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.839808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.839948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.839991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.840175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.840347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.840388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.840553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.840657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.840683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.840817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.840968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.841010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.841135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.841292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.841317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.841437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.841572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.841597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.841701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.841855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.841896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.842106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.842264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.842287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.842426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.842560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.842586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.842693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.842846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.842887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.843071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.843213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.843238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.843373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.843475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.843499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.843638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.843808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.843833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.843940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.844072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.844119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.844257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.844439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.844463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.844620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.844807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.844865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.845051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.845186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.845216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.845398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.845559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.845584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.845700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.845805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.845831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.845994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.846145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-11-26 15:51:12.846186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-11-26 15:51:12.846325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.846459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.846483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.846617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.846768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.846812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.846974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.847153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.847177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.847314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.847449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.847478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.847611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.847785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.847829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.848013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.848202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.848258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.848370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.848502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.848526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.848629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.848782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.848825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.849017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.849215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.849242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.849392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.849552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.849576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.849707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.849858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.849901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.850100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.850290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.850341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.850479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.850641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.850666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.850827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.850999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.851046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.851229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.851378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.851402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.851567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.851708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.851734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.851884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.852097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.852138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.852322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.852452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.852477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.852609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.852730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.852759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.853031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.853182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.853210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.853367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.853528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.853554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.853696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.853821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.853850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.854050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.854201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.854226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.854328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.854426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.854458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.854621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.854801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.854844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.855028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.855197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.855225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.855401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.855499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.855523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.855695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.855830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.855874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-11-26 15:51:12.856029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.856212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-11-26 15:51:12.856238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.856350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.856485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.856511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.856672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.856838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.856881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.857006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.857163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.857189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.857333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.857435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.857460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.857574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.857756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.857799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.857965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.858066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.858091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.858221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.858378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.858403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.858534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.858665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.858696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.858837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.858947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.858972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.859097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.859228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.859253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.859383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.859542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.859566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.859725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.859857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.859882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.859987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.860144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.860169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.860271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.860412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.860438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.860549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.860725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.860754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.860904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.861056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.861083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.861246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.861396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.861420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.861523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.861640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.861665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.861859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.861997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.862041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.862204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.862337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.862362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.862537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.862702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.862747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.862870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.863076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.863119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.863282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.863379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.863404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.863508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.863615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.863641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.863773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.863925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.863968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.864144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.864306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.864330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.864432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.864561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.864586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.864699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.864802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.864827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-11-26 15:51:12.864991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-11-26 15:51:12.865096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.865122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.865285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.865386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.865412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.865551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.865709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.865735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.865921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.866093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.866136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.866249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.866407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.866432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.866566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.866680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.866712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.866836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.866981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.867024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.867190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.867288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.867312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.867412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.867577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.867602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.867741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.867853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.867878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.868012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.868155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.868183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.868340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.868474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.868500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.868612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.868723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.868749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.868878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.869044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.869089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.869211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.869360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.869385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.869501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.869609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.869634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.869744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.869881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.869906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.870073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.870182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.870207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.870340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.870502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.870527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.870626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.870747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.870777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.870924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.871069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.871112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.871224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.871322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.871346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.871452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.871551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.871577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.871709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.871812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.871837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.871973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.872112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.872137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.872271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.872382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.872407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.872523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.872635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.872660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.872838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.872974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.873002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.873150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.873288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-11-26 15:51:12.873314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-11-26 15:51:12.873447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.873558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.873585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.873699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.873807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.873832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.873934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.874102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.874127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.874239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.874345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.874373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.874507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.874634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.874660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.874805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.874934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.874960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.875087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.875250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.875275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.875411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.875510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.875535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.875704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.875827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.875872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.875978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.876113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.876138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.876239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.876369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.876394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.876533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.876635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.876661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.876801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.876958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.877001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.877161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.877296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.877321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.877459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.877558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.877582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.877699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.877821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.877846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.877979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.878086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.878111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.878222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.878378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.878403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.878521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.878650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.878680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.878835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.878969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.878996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.879124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.879228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.879252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.879377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.879493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.879520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.879672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.879815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.879840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.879990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.880112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.880139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.880316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.880458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.880485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.880606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.880731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.880757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.880861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.880991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.881016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.881149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.881292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.881321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.819 [2024-11-26 15:51:12.881442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.881607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.819 [2024-11-26 15:51:12.881635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.819 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.881790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.881899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.881923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.882075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.882220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.882247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.882392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.882527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.882551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.882645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.882757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.882782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.882921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.883073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.883100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.883226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.883357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.883385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.883541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.883661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.883691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.883811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.883915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.883940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.884071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.884190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.884217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.884348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.884510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.884537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.884665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.884776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.884801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.884922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.885076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.885103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.885252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.885381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.885408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.885592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.885730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.885756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.885863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.886034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.886061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.886171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.886281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.886307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.886430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.886577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.886604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.886758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.886866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.886891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.886997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.887144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.887170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.887299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.887448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.887475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.887624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.887779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.887805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.887918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.888033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.888058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.888170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.888325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.888352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.888526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.888707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.888751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.888888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.889013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.889040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.820 qpair failed and we were unable to recover it. 00:27:21.820 [2024-11-26 15:51:12.889168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.820 [2024-11-26 15:51:12.889323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.889350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.889495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.889658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.889697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.889853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.889976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.890003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.890131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.890237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.890264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.890420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.890539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.890571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.890741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.890851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.890876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.890974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.891141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.891168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.891303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.891398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.891440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.891601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.891751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.891776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.891887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.892001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.892025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.892183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.892350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.892374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.892509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.892691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.892734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.892840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.892969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.892994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.893156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.893315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.893342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.893462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.893582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.893614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.893779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.893888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.893914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.894054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.894162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.894186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.894315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.894510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.894537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.894658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.894787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.894814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.894929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.895045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.895072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.895243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.895358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.895386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.895536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.895680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.895732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.895835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.895988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.896016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.896157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.896351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.896379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.896596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.896755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.896786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.896904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.897040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.897064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.897180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.897329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.897358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.897501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.897656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.897683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.897846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.897981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.821 [2024-11-26 15:51:12.898005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.821 qpair failed and we were unable to recover it. 00:27:21.821 [2024-11-26 15:51:12.898132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.898274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.898303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.898446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.898627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.898652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.898766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.898921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.898948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.899121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.899224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.899249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.899404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.899525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.899553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.899661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.899810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.899843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.899994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.900144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.900169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.900273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.900405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.900429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.900561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.900681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.900737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.900892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.901015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.901041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.901183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.901306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.901332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.901490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.901616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.901640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.901812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.901957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.901985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.902104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.902222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.902250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.902430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.902568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.902596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.902725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.902833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.902857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.902986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.903170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.903195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.903302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.903413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.903454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.903599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.903736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.903775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.903918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.904022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.904048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.904223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.904344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.904371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.904531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.904683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.904718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.904864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.905014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.905041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.905176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.905282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.905307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.905426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.905546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.905573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.905718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.905838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.905866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.906015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.906128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.906155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.906292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.906402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.906426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.822 [2024-11-26 15:51:12.906534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.906664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.822 [2024-11-26 15:51:12.906701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.822 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.906838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.906981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.907009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.907184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.907296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.907321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.907457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.907561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.907586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.907696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.907827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.907852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.907975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.908144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.908172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.908295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.908402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.908428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.908582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.908713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.908755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.908877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.909017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.909044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.909189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.909342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.909366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.909502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.909638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.909668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.909835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.909944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.909968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.910151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.910261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.910288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.910435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.910541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.910568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.910674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.910827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.910854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.911011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.911115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.911140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.911309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.911442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.911467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.911629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.911763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.911788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.911906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.912039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.912067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.912193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.912321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.912346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.912480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.912663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.912692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.912818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.912978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.913002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.913135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.913281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.913308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.913436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.913567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.913592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.913696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.913805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.913830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.913937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.914035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.914059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.914221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.914372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.914399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.914556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.914719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.914744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.914910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.915023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.915049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.823 qpair failed and we were unable to recover it. 00:27:21.823 [2024-11-26 15:51:12.915182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.915325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.823 [2024-11-26 15:51:12.915352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.915469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.915644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.915671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.915813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.915923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.915948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.916131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.916245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.916273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.916395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.916550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.916574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.916729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.916898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.916923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.917059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.917186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.917210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.917343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.917488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.917515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.917638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.917785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.917814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.917964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.918106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.918133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.918286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.918397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.918421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.918550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.918658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.918682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.918797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.918931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.918957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.919089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.919206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.919235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.919373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.919477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.919503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.919638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.919763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.919792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.919968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.920114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.920144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.920266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.920387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.920414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.920543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.920682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.920715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.920906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.921055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.921082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.921207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.921364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.921388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.921497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.921603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.921629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.921740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.921879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.921904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.922060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.922210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.922237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.922393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.922505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.922532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.922674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.922795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.824 [2024-11-26 15:51:12.922824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.824 qpair failed and we were unable to recover it. 00:27:21.824 [2024-11-26 15:51:12.922955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.923060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.923085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.923247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.923366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.923393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.923562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.923675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.923712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.923872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.924009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.924036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.924168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.924298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.924323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.924473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.924594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.924622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.924742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.924890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.924915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.925048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.925175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.925203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.925353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.925472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.925496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.925654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.925770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.925795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.925957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.926071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.926100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.926222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.926368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.926395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.926520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.926661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.926694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.926835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.926961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.926988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.927146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.927288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.927315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.927462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.927606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.927633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.927767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.927874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.927899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.928018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.928194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.928221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.928381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.928497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.928521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.928673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.928829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.928857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.929011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.929115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.929139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.929243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.929392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.929421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.929538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.929700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.929726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.929842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.929978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.930005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.930164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.930271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.930295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.930422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.930571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.930598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.930753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.930861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.930886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.930993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.931171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.931197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.825 [2024-11-26 15:51:12.931326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.931436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.825 [2024-11-26 15:51:12.931460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.825 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.931607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.931757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.931784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.931899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.932038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.932065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.932211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.932353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.932380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.932536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.932670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.932736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.932862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.932984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.933012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.933190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.933369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.933396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.933548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.933663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.933698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.933854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.933955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.933982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.934146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.934297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.934321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.934483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.934611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.934635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.934769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.934935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.934962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.935143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.935241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.935265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.935394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.935531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.935557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.935700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.935847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.935875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.936033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.936153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.936178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.936283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.936414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.936438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.936593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.936724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.936750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.936879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.937025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.937052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.937171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.937319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.937346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.937477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.937578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.937605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.937729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.937871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.937898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.938073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.938195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.938222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.938332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.938518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.938543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.938676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.938795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.938821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.938982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.939129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.939161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.939302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.939458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.939483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.939622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.939748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.939777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.939941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.940099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.940124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.826 qpair failed and we were unable to recover it. 00:27:21.826 [2024-11-26 15:51:12.940319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.826 [2024-11-26 15:51:12.940420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.940444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.940575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.940716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.940745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.940890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.941064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.941092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.941227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.941336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.941360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.941488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.941647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.941674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.941831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.941948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.941978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.942123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.942242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.942275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.942412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.942544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.942569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.942701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.942845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.942872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.942987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.943094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.943121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.943246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.943390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.943417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.943577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.943717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.943742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.943878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.944000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.944027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.944172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.944288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.944315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.944457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.944603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.944633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.944764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.944873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.944898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.945016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.945166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.945198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.945354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.945488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.945513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.945645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.945806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.945834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.945956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.946109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.946133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.946287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.946397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.946438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.946546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.946683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.946714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.946819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.946972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.946999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.947172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.947288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.947312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.947423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.947531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.947572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.947696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.947842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.947870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.948051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.948188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.948217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.948353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.948513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.948537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.827 qpair failed and we were unable to recover it. 00:27:21.827 [2024-11-26 15:51:12.948665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.948833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.827 [2024-11-26 15:51:12.948862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.949019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.949171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.949196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.949305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.949454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.949481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.949614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.949741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.949766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.949949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.950072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.950101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.950252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.950372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.950399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.950542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.950681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.950715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.950866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.950977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.951001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.951132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.951325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.951349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.951462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.951614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.951642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.951768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.951924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.951948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.952084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.952227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.952252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.952381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.952501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.952530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.952649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.952802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.952830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.952979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.953132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.953159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.953311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.953417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.953442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.953586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.953741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.953767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.953898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.954061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.954086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.954252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.954382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.954407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.954548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.954678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.954711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.954895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.955031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.955055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.955208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.955353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.955380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.955495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.955614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.955642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.955780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.955906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.955931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.956067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.956175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.956202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.956359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.956486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.956511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.956669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.956814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.956842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.956975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.957138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.957162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.957327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.957434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.828 [2024-11-26 15:51:12.957459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.828 qpair failed and we were unable to recover it. 00:27:21.828 [2024-11-26 15:51:12.957570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.957708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.957736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.957857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.957976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.958005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.958167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.958328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.958370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.958518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.958640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.958669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.958858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.959013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.959043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.959164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.959301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.959326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.959434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.959563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.959588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.959751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.959901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.959929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.960112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.960249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.960276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.960400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.960554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.960579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.960702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.960867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.960909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.961048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.961198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.961226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.961395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.961533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.961563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.961717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.961828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.961856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.962006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.962160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.962202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.962318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.962487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.962514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.962663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.962795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.962821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.962923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.963026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.963051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.963185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.963328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.963368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.963483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.963595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.963622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.963759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.963867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.963892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.964015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.964139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.964166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.964354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.964490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.964515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.964625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.964759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.964784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.964887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.964984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.965026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.965173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.965283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.965310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.965435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.965571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.965596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.965785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.965923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.965948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.829 qpair failed and we were unable to recover it. 00:27:21.829 [2024-11-26 15:51:12.966065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.829 [2024-11-26 15:51:12.966207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.966235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.966384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.966497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.966524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.966654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.966805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.966830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.966939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.967066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.967094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.967283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.967396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.967421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.967603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.967773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.967799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.967942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.968079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.968104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.968209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.968341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.968366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.968497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.968632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.968660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.968800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.968936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.968961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.969059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.969194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.969218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.969324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.969420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.969444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.969616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.969751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.969780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.969919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.970054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.970081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.970243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.970368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.970392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.970558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.970680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.970710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.970847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.970949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.970973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.971112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.971295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.971319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.971428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.971539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.971565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.971726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.971880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.971905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.972041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.972184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.972212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.972325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.972474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.972501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.972704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.972839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.972865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.972999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.973171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.973195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.973329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.973447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.973475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.973592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.973711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.973755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.973860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.973968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.973993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.974133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.974281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.974308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.974424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.974543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.974570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.974763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.974905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.974930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.975031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.975132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.975158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.830 [2024-11-26 15:51:12.975285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.975437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.830 [2024-11-26 15:51:12.975461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.830 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.975570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.975672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.975722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.975859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.976041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.976068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.976231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.976329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.976354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.976509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.976617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.976645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.976775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.976912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.976937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.977067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.977208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.977235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.977381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.977482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.977506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.977638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.977776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.977802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.977902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.978062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.978087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.978297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.978441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.978468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.978625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.978723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.978749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.978858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.978965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.978990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.979101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.979205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.979229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.979384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.979489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.979517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.979654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.979772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.979797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.979912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.980038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.980081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.980212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.980365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.980392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.980506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.980634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.980661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.980811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.980948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.980973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.981130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.981271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.981298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.981414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.981552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.981579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.981721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.981891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.981916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.982058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.982195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.982220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.982331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.982486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.982515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.982633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.982752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.982780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.982892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.983011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.983052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.983185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.983323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.983348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.983472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.983588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.983615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.983734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.983893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.983918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.984017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.984133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.984161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.984292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.984427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.831 [2024-11-26 15:51:12.984451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.831 qpair failed and we were unable to recover it. 00:27:21.831 [2024-11-26 15:51:12.984578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.984693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.984726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.984846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.984955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.984996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.985131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.985234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.985260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.985388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.985516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.985540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.985665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.985807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.985834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.985946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.986092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.986116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.986210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.986317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.986344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.986475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.986613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.986638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.986780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.986895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.986922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.987031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.987174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.987201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.987324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.987470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.987504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.987665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.987774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.987799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.987961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.988084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.988111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.988221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.988327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.988354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.988509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.988640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.988664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.988802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.988921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.988949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.989107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.989255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.989283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.989448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.989596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.989621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.989731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.989863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.989907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.990059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.990197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.990224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.990425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.990557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.990582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.990726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.990929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.990971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.991101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.991255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.991282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.991432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.991566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.991591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.991753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.991899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.991941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.992071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.992205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.992230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.992363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.992496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.992521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.992654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.992800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.992826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.992940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.993098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.993123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.993229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.993360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.993385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.993518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.993625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.993650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.993796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.993911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.993938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.832 [2024-11-26 15:51:12.994052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.994164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.832 [2024-11-26 15:51:12.994189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.832 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.994346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.994459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.994485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.994624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.994733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.994759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.994932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.995065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.995090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.995191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.995294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.995319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.995458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.995588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.995613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.995735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.995846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.995871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.996005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.996148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.996175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.996297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.996431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.996456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.996595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.996728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.996754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.996891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.996990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.997016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.997153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.997260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.997285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.997399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.997556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.997582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.997691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.997838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.997864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.997969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.998102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.998128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.998235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.998346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.998370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.998482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.998596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.998620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.998756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.998896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.998941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.999044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.999183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.999208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.999317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.999444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.999469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.999571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.999692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.999719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:12.999854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:12.999981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.000007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:13.000119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.000222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.000248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:13.000352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.000481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.000507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:13.000615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.000714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.000740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:13.000850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.000977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.001003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:13.001138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.001274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.001299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:13.001443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.001573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.001600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:13.001753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.001898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.001946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:13.002051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.002183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.002209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.833 qpair failed and we were unable to recover it. 00:27:21.833 [2024-11-26 15:51:13.002341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.002455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.833 [2024-11-26 15:51:13.002482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.002616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.002780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.002825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.002983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.003103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.003130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.003253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.003411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.003436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.003547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.003675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.003706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.003866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.003997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.004040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.004149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.004258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.004284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.004387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.004514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.004539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.004665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.004826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.004872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.005000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.005129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.005155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.005274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.005406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.005431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.005549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.005651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.005678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.005831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.005973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.006015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.006122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.006231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.006256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.006387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.006522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.006546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.006648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.006769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.006795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.006899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.007038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.007064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.007171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.007302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.007328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.007441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.007544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.007569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.007682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.007827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.007855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.007968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.008101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.008126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.834 qpair failed and we were unable to recover it. 00:27:21.834 [2024-11-26 15:51:13.008232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.834 [2024-11-26 15:51:13.008368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.008395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.008531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.008640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.008666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.008810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.008984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.009016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.009169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.009283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.009312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.009422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.009549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.009577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.009700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.009850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.009880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.010019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.010195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.010222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.010332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.010448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.010476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.010633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.010804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.010830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.010934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.011094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.011121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.011332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.011450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.011478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.011620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.011795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.011821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.011954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.012089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.012116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.012288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.012400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.012427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.012544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.012745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.012771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.012879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.012982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.013022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.013170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.013318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.013346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.013500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.013627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.013652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.013797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.013901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.013927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.014049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.014202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.014243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.014390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.014529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.014556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.014670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.014835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.014860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.014996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.015095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.015122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.015273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.015411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.015438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.015587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.015743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.015770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.015928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.016109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.016137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.016346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.016491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.016518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.016634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.016762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.016787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.835 [2024-11-26 15:51:13.016932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.017041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.835 [2024-11-26 15:51:13.017066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.835 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.017173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.017342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.017383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.017521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.017683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.017714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.017823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.017984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.018011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.018153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.018299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.018326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.018449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.018601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.018629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.018761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.018906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.018931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.019081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.019215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.019240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.019424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.019542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.019569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.019737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.019871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.019896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.020086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.020199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.020237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.020360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.020504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.020531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.020648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.020821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.020847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.020950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.021060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.021086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.021218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.021365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.021392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.021566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.021683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.021734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.021842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.022019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.022046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.022187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.022306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.022333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.022458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.022585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.022613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.022777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.022884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.022910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.023036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.023176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.023211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.023356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.023474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.023502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.023657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.023778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.023804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.023937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.024051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.024075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.024197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.024329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.024356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.024512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.024663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.024706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.024885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.024987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.025012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.025173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.025302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.025329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.025434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.025584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.025610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.836 qpair failed and we were unable to recover it. 00:27:21.836 [2024-11-26 15:51:13.025728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.025846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.836 [2024-11-26 15:51:13.025875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.026030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.026138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.026169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.026350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.026466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.026491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.026638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.026813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.026838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.026945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.027052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.027092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.027219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.027329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.027356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.027479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.027616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.027643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.027771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.027929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.027956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.028082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.028200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.028227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.028364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.028461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.028486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.028642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.028834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.028864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.028984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.029097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.029130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.029314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.029466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.029490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.029595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.029736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.029762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.029930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.030043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.030068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.030221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.030367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.030394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.030510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.030624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.030652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.030813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.030950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.030975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.031088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.031184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.031209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.031372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.031517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.031545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.031707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.031846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.031871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.031976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.032135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.032160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.032304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.032421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.032449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.032566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.032675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.032718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.032828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.032972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.032999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.033149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.033323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.033350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.033498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.033633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.033657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.033813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.033931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.033959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.034096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.034253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.034277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.837 qpair failed and we were unable to recover it. 00:27:21.837 [2024-11-26 15:51:13.034379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.837 [2024-11-26 15:51:13.034511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.034536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.034666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.034812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.034840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.034990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.035142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.035169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.035298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.035443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.035471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.035596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.035725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.035751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.035857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.035988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.036018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.036200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.036355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.036380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.036520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.036643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.036668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.036780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.036912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.036937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.037069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.037226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.037251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.037388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.037535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.037562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.037721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.037855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.037879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.037988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.038091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.038115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.038244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.038395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.038419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.038521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.038655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.038679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.038826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.038973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.039001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.039127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.039273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.039298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.039430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.039583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.039608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.039745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.039858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.039887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.040031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.040177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.040205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.040343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.040477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.040502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.040677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.040820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.040848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.041024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.041131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.041158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.041317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.041418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.041443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.838 [2024-11-26 15:51:13.041600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.041705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.838 [2024-11-26 15:51:13.041730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.838 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.041889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.042007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.042035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.042145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.042290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.042317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.042426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.042540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.042567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.042753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.042890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.042931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.043054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.043201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.043228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.043338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.043481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.043508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.043635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.043757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.043785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.043906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.044045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.044069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.044202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.044323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.044353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.044526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.044704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.044741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.044862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.045025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.045049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.045162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.045263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.045287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.045419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.045545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.045572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.045684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.045802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.045829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.045948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.046118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.046145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.046281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.046389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.046414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.046572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.046747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.046776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.046893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.047012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.047040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.047190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.047338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.047365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.047499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.047628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.047652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.047798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.047911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.047941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.048053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.048199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.048226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.048341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.048475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.048502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.048661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.048781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.048807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.048969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.049087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.049115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.049236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.049414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.049439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.049545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.049714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.049744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.049884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.050018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.050043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.839 qpair failed and we were unable to recover it. 00:27:21.839 [2024-11-26 15:51:13.050172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.839 [2024-11-26 15:51:13.050282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.050312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.050456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.050569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.050597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.050746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.050893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.050921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.051048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.051158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.051184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.051336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.051483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.051526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.051629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.051746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.051772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.051892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.052021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.052049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.052201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.052306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.052331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.052482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.052593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.052622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.052752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.052891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.052916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.053104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.053215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.053244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.053402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.053511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.053538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.053674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.053838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.053865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.054022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.054122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.054146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.054258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.054376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.054403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.054531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.054665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.054698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.054836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.054992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.055019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.055149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.055306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.055333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.055487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.055602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.055626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.055764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.055907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.055948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.056097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.056285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.056310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.056448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.056574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.056601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.056742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.056862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.056890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.057042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.057175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.057199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.057359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.057483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.057510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.057653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.057805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.057830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.057930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.058038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.058062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.058207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.058375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.058400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.058541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.058698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.058726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.840 qpair failed and we were unable to recover it. 00:27:21.840 [2024-11-26 15:51:13.058930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.840 [2024-11-26 15:51:13.059028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.059054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.059187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.059356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.059385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.059510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.059650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.059674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.059808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.059923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.059953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.060098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.060271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.060298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.060445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.060592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.060619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.060749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.060850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.060875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.061033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.061182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.061209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.061322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.061467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.061494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.061611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.061729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.061757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.061888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.062022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.062046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.062207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.062315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.062340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.062470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.062614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.062641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.062785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.062899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.062926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.063091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.063204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.063229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.063382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.063503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.063531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.063683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.063836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.063863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.064022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.064120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.064144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.064270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.064378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.064403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.064556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.064716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.064745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.064886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.065028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.065057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.065178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.065297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.065325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.065475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.065590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.065615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.065751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.065884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.065911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.066062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.066220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.066244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.066356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.066535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.066562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.066729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.066863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.066904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.067065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.067207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.067234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.841 [2024-11-26 15:51:13.067365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.067508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.841 [2024-11-26 15:51:13.067535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.841 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.067652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.067775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.067803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.067957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.068094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.068118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.068234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.068360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.068396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.068567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.068714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.068743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.068883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.069023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.069050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.069224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.069361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.069402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.069522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.069678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.069710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.069848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.069999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.070026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.070140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.070263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.070290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.070444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.070550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.070575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.070697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.070847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.070874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.070991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.071132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.071159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.071303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.071520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.071552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.071690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.071800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.071825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.071948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.072055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.072082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.072301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.072419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.072448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.072599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.072733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.072759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.072894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.073026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.073051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.073270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.073393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.073420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.073536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.073682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.073717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.073836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.073950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.073977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.074129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.074271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.074295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.074465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.074597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.074626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.074733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.074927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.074954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.842 [2024-11-26 15:51:13.075076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.075246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.842 [2024-11-26 15:51:13.075273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.842 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.075428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.075574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.075599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.075756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.075898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.075926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.076077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.076233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.076258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.076396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.076522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.076549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.076717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.076856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.076880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.076992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.077130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.077154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.077272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.077442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.077469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.077644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.077806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.077835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.077975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.078088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.078114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.078277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.078461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.078486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.078609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.078758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.078787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.078933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.079052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.079080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.079240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.079342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.079366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.079523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.079683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.079713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.079854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.079979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.080007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.080163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.080310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.080338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.080461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.080585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.080610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.080772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.080940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.080965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.081108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.081295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.081323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.081473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.081586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.081610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.081747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.081852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.081877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.082031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.082167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.082191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.082325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.082504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.082531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.082695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.082840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.082864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.083002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.083137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.083162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.083354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.083472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.083501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.083620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.083800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.083826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.083985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.084107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.084136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.843 qpair failed and we were unable to recover it. 00:27:21.843 [2024-11-26 15:51:13.084272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.843 [2024-11-26 15:51:13.084379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.084403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.084549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.084711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.084740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.084860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.084970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.084999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.085185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.085315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.085341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.085474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.085572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.085596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.085745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.085891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.085918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.086076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.086248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.086275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.086390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.086504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.086531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.086655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.086795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.086820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.086973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.087118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.087146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.087295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.087448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.087473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.087609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.087750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.087780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.087922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.088028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.088053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.088161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.088292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.088317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.088423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.088564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.088592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.088773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.088910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.088935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.089033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.089166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.089191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.089318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.089441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.089468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.089595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.089781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.089809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.089965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.090093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.090119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.090231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.090338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.090364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.090502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.090718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.090744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.090922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.091073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.091100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.091246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.091391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.091419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.091597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.091695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.091721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.091849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.091998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.092025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.092172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.092341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.092369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.092501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.092645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.092704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.092871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.093006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.093051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.844 qpair failed and we were unable to recover it. 00:27:21.844 [2024-11-26 15:51:13.093224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.844 [2024-11-26 15:51:13.093375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.093400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.093539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.093727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.093755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.093904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.094038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.094063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.094276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.094452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.094479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.094661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.094810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.094839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.094982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.095124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.095153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.095327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.095481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.095507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.095665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.095784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.095810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.095930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.096073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.096098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.096255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.096462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.096487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.096632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.096771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.096800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.096999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.097105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.097129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.097289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.097464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.097491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.097719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.097864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.097892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.098049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.098200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.098228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.098406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.098508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.098534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.098665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.098821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.098849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.098997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.099142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.099171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.099322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.099494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.099522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.099649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.099763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.099788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.100003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.100176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.100202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.100384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.100528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.100562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.100707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.100863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.100892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.101061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.101169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.101195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.101332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.101524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.101553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.101697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.101843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.101873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.102013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.102197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.102227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.102341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.102502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.102529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.102667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.102799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.845 [2024-11-26 15:51:13.102825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.845 qpair failed and we were unable to recover it. 00:27:21.845 [2024-11-26 15:51:13.102943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.103079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.103111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.103219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.103358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.103389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.103553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.103698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.103726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.103848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.103978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.104013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.104134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.104263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.104297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.104451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.104558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.104587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.104771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.104876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.104903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.105042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.105225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.105250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.105383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.105548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.105579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.105728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.105832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.105861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.106003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.106132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.106178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.106333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.106523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.106551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.106717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.106821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.106851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.106988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.107138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.107168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.107325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.107462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.107488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.107628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.107790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.107816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.107935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.108093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.108121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.108310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.108474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.108521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.108674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.108824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.108853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.109018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.109163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.109195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.109337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.109465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.109497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.109628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.109789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.109819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.109940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.110045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.110079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.110243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.110407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.110434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.110579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.110716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.110746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.110872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.111006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.111032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.111166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.111282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.111308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.111457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.111616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.111644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.846 [2024-11-26 15:51:13.111841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.111958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.846 [2024-11-26 15:51:13.111983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.846 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.112152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.112298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.112324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.112440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.112550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.112578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.112742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.112851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.112880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.112998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.113103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.113131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.113242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.113397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.113426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.113583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.113726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.113753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.113874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.114048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.114077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.114246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.114380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.114407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.114555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.114742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.114772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.114968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.115097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.115140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.115269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.115397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.115427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.115547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.115694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.115724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.115860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.116007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.116039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.116193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.116300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.116326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.116492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.116619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.116647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.116802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.116947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.116972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.117136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.117264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.117293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.117438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.117573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.117615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.117757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.117895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.117924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.118048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.118156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.118189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.118336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.118476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.118521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.118664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.118805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.118852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.118994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.119146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.119180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.119330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.119443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.119471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.119612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.119748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.119777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.847 qpair failed and we were unable to recover it. 00:27:21.847 [2024-11-26 15:51:13.119931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.847 [2024-11-26 15:51:13.120071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.120097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.120323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.120461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.120492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.120632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.120762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.120795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.120969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.121071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.121097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.121213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.121345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.121370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.121556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.121720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.121746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.121893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.122018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.122047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.122178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.122304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.122336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.122501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.122632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.122658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.122840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.122960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.122986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.123140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.123291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.123321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.123457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.123579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.123614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.123759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.123883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.123908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.124023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.124150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.124176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.124305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.124457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.124485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.124612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.124790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.124823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.124988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.125127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.125156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.125277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.125454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.125487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.125641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.125815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.125849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.126032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.126186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.126217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.126332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.126438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.126464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.126646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.126800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.126830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.126991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.127094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.127124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.127319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.127422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.127449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.127610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.127749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.127798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.127961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.128102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.128147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.128262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.128417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.128451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.128611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.128724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.128751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.128904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.129046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.129090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.848 qpair failed and we were unable to recover it. 00:27:21.848 [2024-11-26 15:51:13.129236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.848 [2024-11-26 15:51:13.129384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.129413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.129558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.129713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.129742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.129887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.130048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.130075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.130200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.130331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.130360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.130481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.130637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.130667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.130836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.130967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.130994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.131106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.131212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.131238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.131394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.131499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.131524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.131697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.131853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.131883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.132048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.132190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.132218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.132374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.132553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.132578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.132724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.132846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.132872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.133044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.133165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.133196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.133313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.133465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.133494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.133646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.133806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.133840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.133973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.134083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.134113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.134258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.134416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.134445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.134614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.134735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.134765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.134901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.135040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.135070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.135215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.135324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.135350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.135509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.135632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.135661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.135816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.135979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.136008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.136167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.136276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.136304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.136412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.136544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.136574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.136744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.136907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.136934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.137068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.137219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.137247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.137434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.137571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.137599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.137765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.137907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.137949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.138137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.138246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.138272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.849 qpair failed and we were unable to recover it. 00:27:21.849 [2024-11-26 15:51:13.138398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.849 [2024-11-26 15:51:13.138528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.138559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.138727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.138859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.138889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.139020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.139128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.139157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.139308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.139453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.139482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.139612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.139730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.139759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.139907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.140023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.140051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.140199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.140362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.140388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.140562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.140683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.140715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.140855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.140997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.141027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.141190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.141329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.141360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.141528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.141643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.141670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.141804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.141951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.141979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.142121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.142267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.142301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.142422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.142596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.142630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.142814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.142928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.142973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.143124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.143240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.143274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.143455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.143583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.143611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.143759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.143938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.143968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.144084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.144243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.144273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.144424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.144573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.144603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.144771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.144913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.144939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.145107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.145277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.145304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.145416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.145583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.145611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.145755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.145871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.145899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.146024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.146170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.146204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.146359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.146531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.146561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.146721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.146833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.146860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.147047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.147177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.147203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.147318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.147483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.147515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.850 qpair failed and we were unable to recover it. 00:27:21.850 [2024-11-26 15:51:13.147677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.850 [2024-11-26 15:51:13.147870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.147904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.148041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.148178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.148204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.148345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.148487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.148512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.148629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.148760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.148791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.148949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.149067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.149096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.149257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.149397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.149426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.149591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.149747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.149781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.149915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.150023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.150051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.150170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.150279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.150308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.150449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.150564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.150589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.150718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.150829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.150860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.151022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.151134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.151162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.151338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.151490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.151519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.151698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.151827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.151853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.151973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.152081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.152110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.152277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.152426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.152455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.152603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.152758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.152788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.152973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.153080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.153106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.153236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.153361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.153392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.153580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.153684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.153722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.153870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.154024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.154053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.154209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.154344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.154370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.154478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.154614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.154639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.154787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.154912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.154947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.155105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.155222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.155251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.851 [2024-11-26 15:51:13.155471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.155619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.851 [2024-11-26 15:51:13.155645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.851 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.155771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.155875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.155905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.156044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.156199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.156228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.156371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.156489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.156519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.156673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.156828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.156875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.157050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.157192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.157222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.157391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.157500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.157529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.157642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.157774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.157801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.157943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.158101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.158144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.158272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.158391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.158432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.158557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.158707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.158738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.158892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.159042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.159074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.159224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.159360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.159385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.159611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.159740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.159770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.159894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.160015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.160044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.160232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.160367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.160394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.160526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.160661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.160806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.160950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.161079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.161113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.161241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.161370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.161399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.161560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.161709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.161746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.161948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.162047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.162092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.162215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.162363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.162393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.162545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.162665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.162705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.162829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.162978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.163007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.163153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.163285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.163311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.163526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.163634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.163662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.163850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.163976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.164006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.164144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.164261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.164288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.164399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.164505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.164533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.852 [2024-11-26 15:51:13.164659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.164840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.852 [2024-11-26 15:51:13.164869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.852 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.165010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.165168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.165197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.165360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.165514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.165547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.165704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.165856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.165905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.166030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.166175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.166205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.166367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.166489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.166520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.166678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.166804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.166830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.166990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.167090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.167120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.167264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.167390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.167423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.167569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.167719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.167756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.167892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.168018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.168049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.168203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.168304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.168330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.168494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.168629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.168658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.168844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.168964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.168999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.169133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.169279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.169308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.169473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.169616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.169659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.169858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.169968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.169997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.170127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.170265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.170294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.170452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.170635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.170665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.170854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.170964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.170990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.171109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.171273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.171307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.171433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.171577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.171606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.171757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.171881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.171914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.172077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.172207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.172236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.172353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.172460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.172504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.172630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.172808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.172838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.172969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.173120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.173149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.173336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.173454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.173480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.173650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.173777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.173807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.853 [2024-11-26 15:51:13.173918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.174057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.853 [2024-11-26 15:51:13.174085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.853 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.174234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.174380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.174409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.174580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.174696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.174727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.174864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.175021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.175053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.175207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.175349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.175380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.175555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.175679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.175719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.175860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.175974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.176002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.176152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.176304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.176336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.176460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.176573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.176601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.176752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.176891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.176937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.177072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.177238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.177267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.177402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.177531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.177564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.177711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.177877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.177916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.178051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.178199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.178230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.178414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.178550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.178596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.178783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.178891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.178917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.179078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.179244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.179275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.179394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.179557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.179586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.179764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.179889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.179918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.180033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.180182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.180209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.180341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.180478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.180507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.180668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.180843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.180877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.181015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.181124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.181153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.181283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.181389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.181415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.181520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.181664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.181699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.181864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.182002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.182031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.182166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.182334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.182361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.182492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.182644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.182677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.182865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.183007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.183036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.854 [2024-11-26 15:51:13.183188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.183323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.854 [2024-11-26 15:51:13.183352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.854 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.183500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.183637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.183681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.183876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.183992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.184018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.184205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.184382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.184411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.184529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.184679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.184751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.184882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.185016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.185045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.185182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.185373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.185402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.185539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.185678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.185716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.185852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.185979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.186012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.186145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.186285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.186310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.186451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.186571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.186604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.186752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.186893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.186921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.187068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.187210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.187255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.187395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.187501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.187528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.187696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.187826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.187856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.187990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.188103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.188136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.188272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.188398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.188427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.188579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.188693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.188723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.188856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.188967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.188993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.189101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.189270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.189296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.189438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.189561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.189587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.189698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.189846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.189874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.190001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.190144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.190175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.190334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.190514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.190545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.190714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.190859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.190892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.191052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.191214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.191255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.191369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.191492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.191524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.191671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.191838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.191866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.191980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.192086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.192118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.855 [2024-11-26 15:51:13.192251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.192394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.855 [2024-11-26 15:51:13.192420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.855 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.192618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.192757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.192786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.192930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.193074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.193103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.193256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.193376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.193423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.193564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.193703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.193731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.193887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.194027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.194085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.194203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.194325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.194355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.194468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.194618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.194649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.194827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.194968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.194995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.195149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.195311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.195337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.195478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.195602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.195631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.195763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.195892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.195926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.196088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.196195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.196223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.196384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.196505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.196534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.196712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.196866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.196896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.197056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.197232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.197264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.197425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.197605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.197634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.197780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.197939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.197969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.198102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.198238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.198270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.198393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.198585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.198614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.198747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.198898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.198940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.199130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.199328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.199358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.199488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.199618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.199650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.199817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.199931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.199961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.200099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.200225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.200252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.200456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.200562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.200591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.856 qpair failed and we were unable to recover it. 00:27:21.856 [2024-11-26 15:51:13.200719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.856 [2024-11-26 15:51:13.200873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.200900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.201068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.201187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.201216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.201392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.201536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.201578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.201738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.201863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.201893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.202036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.202197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.202222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.202343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.202501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.202531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.202666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.202818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.202846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.202990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.203151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.203197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.203349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.203541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.203568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.203693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.203802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.203846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.204044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.204165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.204208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.204327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.204462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.204494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.204614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.204746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.204782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.204965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.205101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.205131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.205292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.205439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.205483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.205622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.205764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.205794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.205932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.206089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.206119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.206248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.206361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.206390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.206519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.206636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.206664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:21.857 qpair failed and we were unable to recover it. 00:27:21.857 [2024-11-26 15:51:13.206819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.857 [2024-11-26 15:51:13.206937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.206966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.207112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.207272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.207303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.207439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.207568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.207602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.207750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.207871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.207897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.208058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.208247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.208280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.208417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.208566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.208595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.208724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.208874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.208904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.209035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.209180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.209212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.209401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.209514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.209543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.209665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.209791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.209820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.209965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.210110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.210139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.210294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.210452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.210482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.210649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.210773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.210802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.210968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.211193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.211221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.211373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.211516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.211544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.211674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.211810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.211835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.211993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.212178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.212202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.212338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.212438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.212484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.212659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.212781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.212807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.212934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.213094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.213119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.213273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.213421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.213449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.213567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.213720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.213750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.213914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.214027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.214055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.214209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.214338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.214363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.214524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.214671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.214707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.214880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.215024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.215052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.215201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.215304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.215332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.139 qpair failed and we were unable to recover it. 00:27:22.139 [2024-11-26 15:51:13.215499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.139 [2024-11-26 15:51:13.215629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.215654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.215821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.215942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.215971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.216108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.216250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.216278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.216449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.216563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.216593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.216748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.216880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.216906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.217071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.217206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.217233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.217348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.217501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.217525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.217624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.217781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.217809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.217948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.218053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.218078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.218225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.218357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.218384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.218501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.218608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.218636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.218812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.218946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.218971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.219106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.219204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.219229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.219355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.219507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.219534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.219652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.219800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.219828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.220002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.220161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.220193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.220355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.220499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.220525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.220635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.220773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.220801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.220941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.221109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.221135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.221271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.221406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.221431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.221595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.221730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.221756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.221862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.221972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.221997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.222139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.222307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.222333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.222445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.222574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.222600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.222706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.222814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.222841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.223006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.223140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.223167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.223328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.223455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.223480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.223596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.223754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.223782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.223920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.224018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.224043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.140 qpair failed and we were unable to recover it. 00:27:22.140 [2024-11-26 15:51:13.224171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.140 [2024-11-26 15:51:13.224280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.224307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.224445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.224552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.224577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.224712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.224816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.224843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.225001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.225130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.225156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.225292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.225394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.225420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.225557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.225661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.225693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.225830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.225993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.226019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.226128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.226261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.226288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.226422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.226524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.226549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.226681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.226820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.226846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.227005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.227111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.227137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.227274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.227411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.227437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.227605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.227734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.227762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.227873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.228004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.228030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.228166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.228301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.228327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.228457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.228613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.228639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.228775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.228890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.228915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.229078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.229248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.229273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.229406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.229570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.229595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.229759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.229865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.229891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.229992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.230122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.230148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.230256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.230354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.230379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.230520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.230635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.230660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.230771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.230937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.230962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.231120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.231251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.231276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.231417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.231546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.231571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.231706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.231848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.231874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.231981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.232113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.232138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.232271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.232372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.141 [2024-11-26 15:51:13.232398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.141 qpair failed and we were unable to recover it. 00:27:22.141 [2024-11-26 15:51:13.232529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.232656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.232682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.232828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.232957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.232983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.233085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.233187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.233214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.233352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.233458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.233483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.233613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.233723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.233750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.233917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.234043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.234068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.234231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.234367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.234392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.234528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.234700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.234727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.234860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.234960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.234986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.235116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.235249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.235274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.235431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.235565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.235590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.235725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.235834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.235860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.235990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.236117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.236142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.236242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.236403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.236429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.236561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.236669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.236709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.236854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.237018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.237044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.237155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.237288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.237313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.237416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.237550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.237581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.237747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.237908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.237932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.238143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.238355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.238380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.238522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.238656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.238681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.238813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.238989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.239018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.239168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.239295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.239320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.239433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.239574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.239599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.239713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.239857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.239883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.240043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.240163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.240191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.240341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.240472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.240496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.240645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.240806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.240840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.142 qpair failed and we were unable to recover it. 00:27:22.142 [2024-11-26 15:51:13.240967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.241101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.142 [2024-11-26 15:51:13.241126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.241266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.241396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.241421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.241590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.241726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.241751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.241861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.242007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.242031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.242169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.242327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.242352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.242511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.242660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.242694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.242849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.243008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.243033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.243247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.243396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.243425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.243575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.243717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.243747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.243896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.244025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.244054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.244192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.244327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.244352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.244457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.244582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.244607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.244766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.244900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.244925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.245056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.245164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.245189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.245352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.245485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.245510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.245675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.245827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.245855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.246004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.246145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.246171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.246295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.246467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.246494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.246654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.246767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.246792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.246927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.247031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.247066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.247201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.247333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.247358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.247513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.247702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.247733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.247889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.248021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.248063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.248252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.248476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.248530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.143 [2024-11-26 15:51:13.248681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.248803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.143 [2024-11-26 15:51:13.248831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.143 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.248976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.249107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.249132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.249262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.249418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.249443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.249554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.249727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.249753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.249850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.249985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.250009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.250140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.250264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.250292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.250470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.250572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.250597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.250731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.250865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.250891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.251053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.251184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.251213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.251366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.251541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.251568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.251725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.251835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.251862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.251996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.252128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.252155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.252267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.252420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.252448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.252574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.252712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.252741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.252871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.252980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.253004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.253107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.253242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.253267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.253410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.253535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.253560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.253695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.253862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.253888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.254052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.254163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.254190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.254328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.254491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.254519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.254655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.254809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.254838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.254975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.255140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.255165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.255292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.255450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.255475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.255582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.255713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.255750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.255895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.256039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.256068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.256225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.256334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.256359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.256522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.256652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.256676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.256875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.256992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.257020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.257141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.257303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.257328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.144 qpair failed and we were unable to recover it. 00:27:22.144 [2024-11-26 15:51:13.257463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.144 [2024-11-26 15:51:13.257569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.257594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.257734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.257874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.257899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.258036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.258175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.258202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.258325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.258450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.258475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.258583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.258718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.258744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.258899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.259032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.259058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.259170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.259354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.259382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.259540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.259651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.259677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.259850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.259995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.260025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.260184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.260319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.260344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.260482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.260635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.260662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.260834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.261036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.261089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.261222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.261368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.261396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.261525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.261694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.261720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.261829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.261935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.261960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.262096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.262205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.262229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.262382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.262515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.262541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.262680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.262791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.262816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.262952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.263056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.263080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.263190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.263322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.263363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.263510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.263655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.263683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.263833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.263968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.263993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.264128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.264317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.264345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.264493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.264642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.264670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.264860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.265023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.265090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.265247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.265383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.265409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.265570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.265672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.265707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.265850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.265984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.266009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.266169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.266276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.266300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.145 qpair failed and we were unable to recover it. 00:27:22.145 [2024-11-26 15:51:13.266404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.145 [2024-11-26 15:51:13.266540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.266566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.266727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.266929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.266980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.267144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.267299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.267324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.267456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.267615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.267643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.267800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.267936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.267961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.268137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.268267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.268292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.268418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.268519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.268545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.268680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.268845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.268874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.269036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.269136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.269160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.269292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.269426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.269451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.269617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.269771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.269801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.269949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.270096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.270124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.270272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.270381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.270405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.270516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.270693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.270719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.270852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.270955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.270981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.271116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.271250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.271276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.271434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.271564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.271604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.271787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.272009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.272059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.272223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.272391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.272417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.272532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.272681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.272725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.272877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.272980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.273005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.273114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.273322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.273351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.273523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.273672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.273708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.273827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.274005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.274033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.274155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.274294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.274318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.274464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.274604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.274631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.274780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.274928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.274957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.275138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.275261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.275290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.275481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.275624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.146 [2024-11-26 15:51:13.275648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.146 qpair failed and we were unable to recover it. 00:27:22.146 [2024-11-26 15:51:13.275811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.275961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.275990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.276137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.276283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.276311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.276460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.276609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.276634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.276794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.276926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.276951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.277156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.277266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.277292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.277431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.277537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.277562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.277721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.277886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.277915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.278041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.278174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.278199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.278359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.278504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.278532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.278641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.278820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.278849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.278967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.279095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.279120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.279227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.279389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.279415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.279547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.279728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.279754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.279857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.280014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.280039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.280187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.280338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.280367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.280511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.280643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.280668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.280812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.280947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.280971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.281072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.281233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.281262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.281414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.281587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.281615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.281772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.281912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.281938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.282050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.282241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.282300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.282447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.282586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.282614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.282777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.282948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.282977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.283140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.283250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.283276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.283387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.283495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.283522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.283651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.283791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.283820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.283985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.284122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.284146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.284280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.284438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.284463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.147 qpair failed and we were unable to recover it. 00:27:22.147 [2024-11-26 15:51:13.284623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.284805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.147 [2024-11-26 15:51:13.284835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.284986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.285142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.285170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.285308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.285463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.285489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.285620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.285786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.285813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.285928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.286059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.286101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.286246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.286419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.286446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.286563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.286717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.286746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.286874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.287004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.287028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.287165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.287302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.287327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.287481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.287641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.287666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.287835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.287946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.287971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.288074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.288177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.288207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.288315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.288467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.288496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.288642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.288795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.288821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.288932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.289064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.289089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.289192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.289291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.289317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.289477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.289638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.289680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.289847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.290000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.290028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.290190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.290323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.290348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.290461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.290589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.290614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.290776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.290907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.290932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.291114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.291263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.291295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.291439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.291551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.291579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.291770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.291878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.291904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.292043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.292227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.292256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.148 qpair failed and we were unable to recover it. 00:27:22.148 [2024-11-26 15:51:13.292424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.148 [2024-11-26 15:51:13.292531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.292558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.292702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.292819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.292844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.292949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.293086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.293111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.293272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.293420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.293447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.293596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.293745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.293773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.293919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.294127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.294176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.294368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.294501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.294533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.294714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.294820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.294846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.294977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.295152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.295180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.295300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.295444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.295473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.295594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.295758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.295783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.295937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.296147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.296196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.296346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.296462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.296490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.296634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.296794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.296823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.297001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.297108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.297133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.297296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.297402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.297427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.297541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.297676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.297708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.297848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.297982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.298010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.298145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.298279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.298303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.298438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.298564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.298589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.298731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.298840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.298865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.298989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.299132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.299161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.299307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.299440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.299465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.299630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.299741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.299767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.299876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.300057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.300085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.300230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.300370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.300399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.300578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.300710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.300737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.300967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.301172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.301218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.301392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.301533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.301560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.149 qpair failed and we were unable to recover it. 00:27:22.149 [2024-11-26 15:51:13.301738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.149 [2024-11-26 15:51:13.301911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.301939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.302093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.302224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.302251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.302383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.302518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.302543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.302676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.302817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.302843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.302956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.303081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.303107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.303208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.303311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.303336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.303445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.303549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.303576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.303694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.303834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.303859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.303973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.304101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.304126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.304265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.304433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.304458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.304621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.304755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.304782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.304880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.304987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.305013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.305135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.305268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.305293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.305432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.305532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.305558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.305696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.305824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.305850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.305987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.306118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.306143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.306278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.306375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.306400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.306531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.306638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.306663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.306808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.306948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.306974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.307109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.307215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.307242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.307371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.307468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.307494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.307599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.307735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.307761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.307868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.307995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.308021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.308149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.308284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.308310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.308474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.308608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.308633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.308773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.308885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.308910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.309050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.309190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.309215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.309345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.309477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.309502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.309635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.309747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.150 [2024-11-26 15:51:13.309773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.150 qpair failed and we were unable to recover it. 00:27:22.150 [2024-11-26 15:51:13.309906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.310048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.310073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.310207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.310311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.310339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.310450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.310564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.310590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.310727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.310887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.310912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.311057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.311219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.311244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.311405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.311541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.311566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.311701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.311874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.311900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.312038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.312146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.312171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.312277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.312374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.312399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.312544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.312679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.312719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.312832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.313000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.313025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.313130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.313271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.313296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.313427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.313538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.313564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.313673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.313818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.313844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.313975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.314112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.314138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.314272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.314404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.314429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.314564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.314672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.314717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.314852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.314991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.315016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.315150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.315285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.315311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.315425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.315582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.315607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.315705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.315844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.315869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.315962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.316085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.316110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.316272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.316400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.316426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.316556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.316694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.316725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.316836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.316969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.316994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.317158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.317288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.317313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.317413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.317515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.317541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.317677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.317815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.317841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.151 [2024-11-26 15:51:13.317966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.318124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.151 [2024-11-26 15:51:13.318150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.151 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.318258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.318395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.318420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.318533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.318641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.318667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.318778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.318912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.318938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.319098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.319261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.319286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.319390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.319513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.319538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.319645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.319777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.319803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.319908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.320019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.320044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.320176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.320283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.320309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.320406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.320529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.320555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.320683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.320833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.320860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.321021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.321158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.321184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.321322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.321457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.321482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.321593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.321731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.321757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.321924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.322034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.322059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.322236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.322342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.322369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.322504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.322664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.322696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.322814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.322954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.322979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.323114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.323219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.323244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.323374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.323507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.323534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.323700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.323858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.323884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.324000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.324134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.324159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.324263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.324373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.324398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.324558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.324697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.324727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.324861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.324997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.325024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.152 [2024-11-26 15:51:13.325136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.325267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.152 [2024-11-26 15:51:13.325293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.152 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.325422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.325560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.325585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.325713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.325872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.325898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.326008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.326157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.326183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.326316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.326450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.326475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.326582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.326695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.326721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.326834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.326999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.327024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.327158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.327315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.327340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.327480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.327582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.327609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.327719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.327856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.327881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.328012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.328146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.328171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.328331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.328476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.328501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.328633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.328745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.328773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.328909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.329016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.329041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.329180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.329291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.329317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.329416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.329537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.329562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.329692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.329806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.329831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.329968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.330082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.330109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.330252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.330384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.330410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.330553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.330713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.330739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.330873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.331033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.331058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.331223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.331349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.331374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.331503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.331640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.331665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.331816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.331966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.331996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.332158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.332288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.332315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.332476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.332607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.332632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.332787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.332936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.332985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.333171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.333333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.333379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.333491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.333594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.333619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.153 qpair failed and we were unable to recover it. 00:27:22.153 [2024-11-26 15:51:13.333777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.153 [2024-11-26 15:51:13.333958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.333999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.334150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.334310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.334338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.334516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.334648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.334674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.334850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.335003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.335029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.335192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.335290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.335315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.335421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.335546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.335571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.335700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.335880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.335923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.336055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.336223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.336270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.336408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.336537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.336562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.336748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.336877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.336902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.337030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.337166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.337192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.337359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.337491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.337518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.337653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.337778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.337806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.337943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.338143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.338185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.338318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.338428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.338453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.338611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.338793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.338837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.338981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.339114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.339156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.339286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.339454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.339484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.339642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.339770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.339813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.339971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.340086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.340111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.340249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.340385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.340411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.340548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.340692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.340718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.340864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.341074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.341116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.341273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.341421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.341446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.341585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.341741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.341770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.341911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.342054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.342084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.342234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.342399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.342424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.342558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.342696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.342728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.342885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.343055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.154 [2024-11-26 15:51:13.343097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.154 qpair failed and we were unable to recover it. 00:27:22.154 [2024-11-26 15:51:13.343197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.343354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.343380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.343517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.343656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.343681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.343870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.344035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.344079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.344249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.344357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.344382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.344516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.344674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.344706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.344836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.345039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.345067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.345208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.345346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.345371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.345504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.345664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.345697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.345852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.346059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.346101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.346259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.346380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.346405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.346538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.346676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.346709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.346840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.346960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.346987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.347171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.347319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.347344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.347473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.347630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.347655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.347789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.347991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.348033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.348217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.348392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.348417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.348562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.348699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.348725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.348871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.349032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.349060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.349200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.349318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.349345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.349489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.349623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.349649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.349787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.349932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.349974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.350107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.350235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.350260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.350417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.350548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.350574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.350717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.350872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.350915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.351034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.351186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.351211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.351349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.351482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.351507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.351616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.351795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.351843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.351969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.352138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.352181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.155 qpair failed and we were unable to recover it. 00:27:22.155 [2024-11-26 15:51:13.352312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.155 [2024-11-26 15:51:13.352442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.352467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.352587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.352718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.352745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.352862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.353021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.353046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.353143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.353281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.353306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.353416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.353559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.353586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.353735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.353911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.353954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.354076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.354200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.354224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.354332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.354489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.354514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.354653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.354821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.354865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.355049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.355229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.355271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.355432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.355535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.355560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.355701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.355858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.355902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.356052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.356252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.356280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.356457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.356561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.356586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.356701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.356883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.356926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.357069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.357202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.357245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.357405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.357538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.357563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.357697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.357859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.357902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.358068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.358190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.358215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.358378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.358506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.358531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.358711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.358858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.358902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.359054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.359194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.359237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.359394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.359548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.359573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.359704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.359886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.359929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.360116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.360252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.360279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.360409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.360537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.360562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.360696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.360843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.360889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.361022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.361154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.361179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.361308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.361441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.156 [2024-11-26 15:51:13.361468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.156 qpair failed and we were unable to recover it. 00:27:22.156 [2024-11-26 15:51:13.361579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.361708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.361734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.361863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.362031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.362073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.362218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.362354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.362379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.362518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.362619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.362644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.362806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.362940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.362968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.363117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.363279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.363303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.363460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.363592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.363619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.363771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.363944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.363987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.364110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.364224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.364249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.364348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.364513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.364538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.364672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.364808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.364834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.364961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.365101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.365127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.365233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.365366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.365391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.365523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.365653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.365678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.365795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.365933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.365959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.366116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.366262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.366305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.366467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.366609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.366634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.366751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.366887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.366931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.367062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.367238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.367281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.367380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.367540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.367566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.367670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.367838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.367882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.368038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.368182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.368210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.368363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.368506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.368531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.368667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.368833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.368859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.368984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.369105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.157 [2024-11-26 15:51:13.369130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.157 qpair failed and we were unable to recover it. 00:27:22.157 [2024-11-26 15:51:13.369261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.369369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.369393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.369504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.369662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.369703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.369866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.370000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.370025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.370135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.370239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.370265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.370383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.370479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.370504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.370639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.370743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.370768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.370901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.371067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.371091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.371192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.371300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.371327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.371462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.371592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.371617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.371753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.371956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.371998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.372129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.372269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.372294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.372436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.372546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.372571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.372668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.372775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.372801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.372905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.373036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.373063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.373190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.373319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.373344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.373457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.373562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.373587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.373695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.373812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.373854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.373965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.374139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.374164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.374307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.374421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.374446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.374603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.374715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.374742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.374885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.375057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.375100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.375211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.375317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.375343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.375482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.375641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.375666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.375803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.375943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.375986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.376115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.376259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.376284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.376421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.376523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.376549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.377144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.377320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.377348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.377474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.377593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.377619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.158 [2024-11-26 15:51:13.377746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.377862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.158 [2024-11-26 15:51:13.377888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.158 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.378023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.378129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.378156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.378292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.378434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.378460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.378589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.378744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.378788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.378903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.379013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.379040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.379184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.379311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.379336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.379464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.379619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.379645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.379777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.379931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.379975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.380146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.380277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.380302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.380455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.380558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.380584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.380748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.380885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.380915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.381038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.381195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.381220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.381339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.381472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.381497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.381639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.381794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.381838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.381964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.382162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.382205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.382340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.382453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.382478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.382589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.382734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.382763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.382923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.383110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.383153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.383288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.383443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.383468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.383586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.383703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.383735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.383875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.384052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.384096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.384244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.384349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.384384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.384547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.384691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.384719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.384879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.385018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.385046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.385247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.385398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.385426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.385559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.385699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.385724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.385862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.386018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.386061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.386192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.386354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.386380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.386513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.386639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.386666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.159 qpair failed and we were unable to recover it. 00:27:22.159 [2024-11-26 15:51:13.386847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.387006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.159 [2024-11-26 15:51:13.387044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.387178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.387358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.387384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.387538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.387706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.387749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.387887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.388107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.388135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.388288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.388438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.388465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.388638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.388803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.388829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.388936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.389080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.389110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.389262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.389433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.389461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.389613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.389722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.389748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.389886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.390040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.390078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.390231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.390360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.390392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.390617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.390809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.390834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.390942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.391057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.391082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.391247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.391382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.391410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.391559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.391745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.391770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.391881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.392006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.392034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.392191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.392330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.392357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.392471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.392619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.392646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.392806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.393021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.393049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.393280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.393395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.393422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.393558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.393726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.393757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.393895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.394033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.394058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.394194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.394328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.394352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.395195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.395381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.395411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.396397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.396554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.396584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.397368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.397573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.397602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.397761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.397894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.397919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.398021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.398131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.398171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.398326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.398483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.160 [2024-11-26 15:51:13.398511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.160 qpair failed and we were unable to recover it. 00:27:22.160 [2024-11-26 15:51:13.398657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.398855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.398881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.398998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.399136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.399161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.399283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.399390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.399432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.399568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.399745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.399770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.399901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.400056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.400084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.400234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.400378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.400405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.400551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.400697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.400725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.400883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.401040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.401081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.401257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.401427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.401455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.401609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.401731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.401759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.401903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.402031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.402061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.402217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.402366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.402390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.402553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.402697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.402725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.402847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.402961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.402988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.403134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.403281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.403308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.403462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.403622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.403664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.403829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.403961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.403986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.404185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.404316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.404341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.404483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.404634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.404662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.404791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.404928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.404952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.405089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.405276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.405301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.405434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.405590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.405617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.405752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.405889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.405913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.406078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.406177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.406201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.406333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.406473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.406507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.161 qpair failed and we were unable to recover it. 00:27:22.161 [2024-11-26 15:51:13.406695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.406804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.161 [2024-11-26 15:51:13.406828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.406970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.407088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.407115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.407278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.407390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.407415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.407607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.407749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.407778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.407931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.408045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.408072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.408204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.408324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.408351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.408523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.408622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.408647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.408841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.408975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.409003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.409158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.409324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.409348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.409500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.409617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.409645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.409801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.409928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.409955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.410129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.410274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.410301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.410409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.410624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.410652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.410803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.410925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.410951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.411090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.411197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.411222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.411330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.411432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.411473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.411604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.411768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.411792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.411930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.412101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.412128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.412309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.412417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.412443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.412577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.412725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.412752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.412868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.413042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.413068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.413253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.413414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.413443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.413599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.413737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.413763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.413907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.414024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.414050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.414206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.414353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.414382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.414497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.414618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.414645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.414876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.414973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.415015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.415166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.415288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.415314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.415472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.415580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.162 [2024-11-26 15:51:13.415603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.162 qpair failed and we were unable to recover it. 00:27:22.162 [2024-11-26 15:51:13.415763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.415910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.415938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.416110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.416249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.416273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.416425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.416573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.416599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.416751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.416873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.416900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.417040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.417162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.417189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.417329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.417458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.417484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.417664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.417841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.417865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.418105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.418216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.418245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.418377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.418531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.418557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.418721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.418850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.418893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.419078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.419197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.419224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.419338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.419454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.419481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.419587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.419777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.419802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.419913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.420069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.420093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.420242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.420350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.420378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.420502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.420667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.420708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.420817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.420935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.420961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.421120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.421278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.421303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.421407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.421515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.421540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.421692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.421848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.421873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.422012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.422211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.422238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.422395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.422529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.422552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.422726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.422853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.422881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.423037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.423178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.423205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.423351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.423497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.423524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.423649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.423788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.423812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.424008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.424143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.424166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.424316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.424496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.424524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.163 [2024-11-26 15:51:13.424639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.424798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.163 [2024-11-26 15:51:13.424825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.163 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.424973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.425094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.425118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.425246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.425357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.425382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.425521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.425698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.425741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.425852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.426002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.426029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.426177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.426314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.426338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.426503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.426627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.426655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.426810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.426956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.426984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.427105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.427296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.427320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.427462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.427594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.427619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.427782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.427933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.427961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.428094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.428201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.428229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.428372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.428503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.428529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.428655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.428779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.428803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.428917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.429050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.429073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.429200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.429334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.429358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.429511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.429638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.429665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.429801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.429904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.429929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.430134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.430291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.430319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.430458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.430607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.430635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.430777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.430931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.430959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.431100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.431214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.431238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.431347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.431468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.431492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.431638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.431789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.431817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.431936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.432099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.432127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.432271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.432367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.432390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.432529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.432710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.432750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.432853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.432988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.433012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.433117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.433224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.433249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.164 qpair failed and we were unable to recover it. 00:27:22.164 [2024-11-26 15:51:13.433372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.164 [2024-11-26 15:51:13.433507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.433531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.433659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.433781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.433812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.433922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.434067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.434094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.434223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.434337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.434364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.434504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.434639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.434663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.434870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.435023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.435056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.435180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.435330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.435358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.435501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.435624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.435656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.435798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.435911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.435937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.436074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.436256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.436280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.436388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.436511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.436549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.436707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.436838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.436868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.437010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.437147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.437171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.437328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.437476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.437503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.437621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.437764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.437791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.437890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.437987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.438012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.438147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.438368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.438396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.438578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.438742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.438768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.438873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.438983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.439010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.439173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.439331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.439359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.439499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.439639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.439681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.439830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.439929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.439955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.440107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.440224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.440253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.440378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.440493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.440520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.440677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.440788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.440813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.441004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.441137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.441166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.442052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.442185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.442215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.442338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.442509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.442537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.442704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.442817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.442843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.165 qpair failed and we were unable to recover it. 00:27:22.165 [2024-11-26 15:51:13.443005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.165 [2024-11-26 15:51:13.443178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.443224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.443334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.443518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.443546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.443673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.443842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.443868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.443980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.444136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.444160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.444314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.444485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.444509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.444635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.444788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.444814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.444952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.445110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.445134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.445262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.445372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.445397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.445548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.445708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.445733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.445867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.446098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.446144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.446329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.446496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.446524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.446672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.446813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.446838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.446937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.447112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.447137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.447376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.447592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.447620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.447763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.447877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.447902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.448030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.448167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.448193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.448353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.448473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.448501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.448637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.448788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.448816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.448925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.449052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.449080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.449205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.449315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.449340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.449549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.449694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.449719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.449847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.450014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.450050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.450210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.450350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.450378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.450510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.450647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.450672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.450873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.451011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.451036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.166 [2024-11-26 15:51:13.451212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.451383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.166 [2024-11-26 15:51:13.451414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.166 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.451571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.451712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.451740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.451861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.452020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.452045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.452190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.452306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.452333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.452511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.452642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.452667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.452812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.452959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.452995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.453184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.453319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.453359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.453476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.453603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.453631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.453770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.453948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.453981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.454150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.454348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.454375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.454528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.454634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.454659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.454769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.454880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.454904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.455046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.455182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.455207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.455361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.455479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.455506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.455664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.455821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.455866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.456041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.456223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.456251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.456431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.456572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.456599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.456771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.456942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.456967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.457062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.457197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.457222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.457393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.457538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.457565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.457711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.457871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.457896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.458007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.458156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.458184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.458361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.458519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.458561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.458693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.458812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.458846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.458990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.459147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.459182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.459333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.459446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.459471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.459649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.459814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.459840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.459965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.460119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.460144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.460273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.460380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.460425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.167 [2024-11-26 15:51:13.460551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.460692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.167 [2024-11-26 15:51:13.460720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.167 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.460901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.461020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.461045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.461202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.461307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.461335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.461553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.461700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.461729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.461873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.461996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.462023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.462160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.462267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.462292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.462407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.462629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.462657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.462822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.462945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.462974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.463132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.463246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.463274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.463397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.463545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.463570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.463732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.463871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.463898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.464021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.464174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.464201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.464368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.464461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.464486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.464622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.464759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.464802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.464942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.465085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.465113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.465262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.465387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.465415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.465551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.465665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.465702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.465869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.466000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.466025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.466176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.466354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.466379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.466480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.466605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.466633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.466794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.466899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.466924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.467084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.467190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.467238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.467390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.467555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.467582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.467743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.467875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.467903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.468057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.468214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.468239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.468343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.468476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.468512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.468698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.468819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.468847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.468992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.469102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.469129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.469262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.469429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.469456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.168 [2024-11-26 15:51:13.469580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.469721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.168 [2024-11-26 15:51:13.469747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.168 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.469879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.470029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.470060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.470198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.470371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.470398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.470544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.470682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.470715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.470840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.470976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.471000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.471188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.471370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.471395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.471506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.471606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.471631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.471775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.471931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.471960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.472086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.472191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.472216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.472334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.472469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.472495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.472646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.472796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.472821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.472960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.473057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.473086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.473190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.473326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.473351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.473522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.473659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.473692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.473876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.473999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.474026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.474165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.474354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.474379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.474516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.474629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.474654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.474811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.474912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.474936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.475083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.475254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.475282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.475388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.475537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.475562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.475693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.475805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.475829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.475930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.476118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.476145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.476281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.476395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.476423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.476596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.476729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.476757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.476877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.477007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.477032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.477177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.477321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.477351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.477467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.477603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.477630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.477780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.477895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.477919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.478056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.478156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.478182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.169 qpair failed and we were unable to recover it. 00:27:22.169 [2024-11-26 15:51:13.478335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.169 [2024-11-26 15:51:13.478484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.478511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.478671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.478824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.478852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.479007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.479135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.479168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.479275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.479401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.479426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.479579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.479795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.479824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.479972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.480131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.480159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.480274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.480400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.480429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.480559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.480698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.480724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.480831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.480961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.480985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.481163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.481322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.481348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.481480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.481609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.481637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.481779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.481892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.481917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.482042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.482162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.482190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.482336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.482453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.482482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.482631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.482780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.482822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.483030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.483204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.483231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.483344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.483500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.483542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.483691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.483812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.483837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.483986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.484144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.484189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.484402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.484544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.484572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.484750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.484867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.484895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.485053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.485182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.485209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.485379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.485517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.485542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.485704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.485810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.485835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.485995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.486175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.486200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.486307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.486463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.486490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.170 qpair failed and we were unable to recover it. 00:27:22.170 [2024-11-26 15:51:13.486665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.486792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.170 [2024-11-26 15:51:13.486820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.486954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.487093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.487117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.487267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.487382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.487411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.487535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.487679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.487728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.487866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.487982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.488009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.488148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.488277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.488301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.488431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.488647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.488675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.488835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.488956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.488992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.489134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.489249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.489276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.489401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.489507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.489532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.489639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.489772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.489798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.489950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.490106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.490131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.490258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.490376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.490404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.490534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.490665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.490696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.490853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.490968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.490995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.491165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.491282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.491309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.491428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.491540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.491567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.491695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.491798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.491823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.491935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.492117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.492141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.492255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.492364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.492389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.492521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.492654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.492682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.492832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.492942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.492967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.493128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.493235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.493264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.493381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.493490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.493518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.493659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.493834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.493862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.494047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.494177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.494219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.494339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.494532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.494557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.494682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.494829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.494855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.171 [2024-11-26 15:51:13.494971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.495106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.171 [2024-11-26 15:51:13.495134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.171 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.495286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.495408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.495433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.495562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.495676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.495744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.495865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.496052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.496077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.496234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.496363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.496390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.496508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.496614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.496638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.496784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.496918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.496943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.497108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.497276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.497303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.497477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.497600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.497627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.497762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.497888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.497912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.498038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.498215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.498242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.498399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.498537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.498562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.498720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.498839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.498867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.499019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.499153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.499179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.499311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.499446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.499474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.499622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.499775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.499803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.499955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.500074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.500103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.500256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.500381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.500406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.500557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.500670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.500703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.500850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.500977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.501004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.501129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.501273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.501302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.501430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.501530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.501555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.501700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.501832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.501857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.501989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.502126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.502153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.502297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.502411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.502438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.502570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.502704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.502730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.502873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.502984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.503025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.503132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.503309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.503336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.503523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.503678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.503724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.172 [2024-11-26 15:51:13.503845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.503978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.172 [2024-11-26 15:51:13.504003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.172 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.504128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.504276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.504305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.504403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.504536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.504561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.504700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.504849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.504876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.505023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.505124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.505149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.505253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.505411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.505438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.505584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.505743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.505785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.505919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.506069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.506096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.506271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.506406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.506431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.506551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.506666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.506700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.506881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.507014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.507040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.507166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.507271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.507299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.507459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.507588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.507613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.507803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.507926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.507953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.508103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.508215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.508243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.508402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.508502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.508527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.508662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.508792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.508818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.508975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.509114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.509141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.509272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.509399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.509424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.509577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.509699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.509728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.509850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.509987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.510012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.510181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.510330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.510358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.510513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.510661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.510693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.510822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.510968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.510992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.511125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.511253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.511277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.511403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.511549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.511578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.511718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.511867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.511894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.512053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.512157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.512182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.512294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.512410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.512435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.173 qpair failed and we were unable to recover it. 00:27:22.173 [2024-11-26 15:51:13.512582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.512726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.173 [2024-11-26 15:51:13.512754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.512868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.513046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.513074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.513188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.513330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.513358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.513479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.513636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.513660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.513793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.513894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.513918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.514054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.514200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.514227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.514368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.514511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.514538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.514696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.514801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.514825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.514959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.515112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.515139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.515246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.515409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.515434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.515569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.515715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.515745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.515907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.516063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.516103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.516239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.516349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.516376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.516518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.516696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.516725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.516866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.517043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.517071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.517197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.517333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.517357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.517482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.517598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.517625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.517826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.517948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.517976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.518118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.518268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.518296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.518468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.518594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.518620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.518771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.518941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.518968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.519080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.519227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.519254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.519400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.519517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.519544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.519710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.519849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.519877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.520039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.520187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.520214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.520360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.520527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.520552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.520684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.520813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.520841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.521011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.521147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.521188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.174 qpair failed and we were unable to recover it. 00:27:22.174 [2024-11-26 15:51:13.521330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.174 [2024-11-26 15:51:13.521444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.521471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.521670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.521796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.521821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.521929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.522055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.522083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.522226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.522446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.522473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.522581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.522750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.522778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.522929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.523081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.523112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.523254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.523375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.523403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.523555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.523695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.523721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.523846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.524003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.524027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.524129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.524234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.524259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.524364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.524517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.524546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.524726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.524837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.524862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.525049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.525194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.525221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.525378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.525490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.525513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.525618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.525776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.525804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.525958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.526080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.526104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.526230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.526377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.526404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.526512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.526613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.526641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.526796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.526919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.526946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.527074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.527175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.527200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.527325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.527468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.527495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.527640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.527772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.527800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.527921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.528115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.528140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.528275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.528415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.528439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.528593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.528738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.528766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.175 qpair failed and we were unable to recover it. 00:27:22.175 [2024-11-26 15:51:13.528906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.175 [2024-11-26 15:51:13.529024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.529051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.529198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.529325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.529352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.529525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.529650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.529675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.529812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.529970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.529995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.530105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.530211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.530236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.530345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.530500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.530524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.530658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.530801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.530826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.530985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.531134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.531158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.531256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.531365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.531389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.531510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.531646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.531673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.531832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.531938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.531963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.532133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.532293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.532318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.532449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.532592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.532619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.532723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.532839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.532864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.532981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.533096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.533120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.533231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.533381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.533409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.533521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.533658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.533691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.533835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.533982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.534009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.534173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.534306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.534330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.534465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.534578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.534605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.534726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.534884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.534911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.535084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.535283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.535313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.535449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.535539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.535564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.535709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.535828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.535856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.536078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.536207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.536232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.536382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.536496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.536523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.536679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.536828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.536853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.536977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.537076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.537116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.537283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.537417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.537441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.176 qpair failed and we were unable to recover it. 00:27:22.176 [2024-11-26 15:51:13.537604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.176 [2024-11-26 15:51:13.537788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.537813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.537919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.538021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.538045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.538149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.538251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.538296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.538435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.538570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.538598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.538756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.538870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.538895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.539003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.539111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.539137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.539270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.539380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.539408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.539526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.539644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.539672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.539806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.539981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.540009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.540132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.540258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.540282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.540406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.540543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.540572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.540718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.540861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.540890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.541017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.541122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.541150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.541274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.541404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.541429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.541560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.541667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.541703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.541901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.542003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.542027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.542178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.542348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.542375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.542501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.542638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.542663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.542769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.542895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.542919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.543031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.543185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.543214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.543338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.543448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.543476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.543620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.543798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.543823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.543918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.544048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.544076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.544196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.544366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.544394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.544514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.544653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.544681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.544835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.544937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.544961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.545079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.545234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.545261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.545410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.545524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.545551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.545725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.545850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.545875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.177 qpair failed and we were unable to recover it. 00:27:22.177 [2024-11-26 15:51:13.546006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.177 [2024-11-26 15:51:13.546138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.546163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.546323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.546449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.546476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.546584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.546700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.546729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.546869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.546983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.547011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.547125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.547256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.547281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.547475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.547578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.547605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.547729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.547843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.547870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.547989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.548111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.548138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.548257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.548354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.548379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.548538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.548651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.548698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.548801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.548965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.548992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.549118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.549233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.549260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.549412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.549543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.549567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.549697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.549825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.549853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.550030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.550224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.550271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.550449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.550556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.550581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.550728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.550864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.550904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.551023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.551141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.551170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.551287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.551413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.551440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.551622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.551730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.551755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.551872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.552029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.552053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.552178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.552289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.552317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.552436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.552555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.552583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.552701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.552860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.552886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.552994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.553125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.553154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.553314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.553454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.553481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.553666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.553805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.553830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.553967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.554076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.554103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.554291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.554423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.178 [2024-11-26 15:51:13.554465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.178 qpair failed and we were unable to recover it. 00:27:22.178 [2024-11-26 15:51:13.554622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.554742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.554770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.554959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.555060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.555086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.555259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.555383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.555408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.555561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.555720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.555767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.555903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.556018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.556047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.556199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.556315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.556343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.556500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.556609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.556636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.556763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.556875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.556900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.556993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.557092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.557117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.557220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.557322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.557347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.557511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.557664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.557693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.557798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.557924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.557949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.558049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.558186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.558211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.558339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.558509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.558536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.558652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.558845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.558870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.558984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.559143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.559168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.559317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.559459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.559487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.559639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.559775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.559804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.559976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.560123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.560150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.560298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.560406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.560430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.560559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.560693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.560722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.560833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.560953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.560980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.561101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.561245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.561273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.561421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.561533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.561558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.561665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.561769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.561794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.561916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.562066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.562093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.562246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.562386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.562413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.562546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.562648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.562672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.562789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.562948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.179 [2024-11-26 15:51:13.562975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.179 qpair failed and we were unable to recover it. 00:27:22.179 [2024-11-26 15:51:13.563123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.180 [2024-11-26 15:51:13.563246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.180 [2024-11-26 15:51:13.563273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.180 qpair failed and we were unable to recover it. 00:27:22.180 [2024-11-26 15:51:13.563395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.180 [2024-11-26 15:51:13.563527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.180 [2024-11-26 15:51:13.563554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.180 qpair failed and we were unable to recover it. 00:27:22.180 [2024-11-26 15:51:13.563713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.180 [2024-11-26 15:51:13.563815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.180 [2024-11-26 15:51:13.563840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.180 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.563968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.564080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.564108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.564293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.564403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.564427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.564534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.564671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.564719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.564830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.564966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.564990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.565097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.565243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.565271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.565390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.565535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.565562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.565667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.565788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.565813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.565952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.566076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.566101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.566236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.566343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.566371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.566530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.566644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.566668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.566790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.566917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.566944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.567074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.567210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.567235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.567401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.567524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.567553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.567748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.567896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.567923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.568051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.568185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.568215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.568347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.568501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.568543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.568653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.568806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.568834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.568965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.569078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.569105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.569250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.569424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.569451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.569606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.569705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.569730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.464 [2024-11-26 15:51:13.569866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.569981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.464 [2024-11-26 15:51:13.570005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.464 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.570153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.570262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.570289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.570396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.570531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.570559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.570681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.570787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.570811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.570960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.571146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.571170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.571285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.571393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.571436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.571557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.571714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.571739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.571844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.571950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.571975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.572079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.572203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.572231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.572352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.572496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.572524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.572700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.572806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.572831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.572965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.573061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.573086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.573200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.573349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.573377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.573497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.573647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.573675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.573833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.573962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.573987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.574095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.574221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.574245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.574370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.574495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.574522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.574648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.574800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.574828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.574952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.575065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.575093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.575201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.575348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.575372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.575509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.575657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.575692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.575847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.575997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.576025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.576185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.576315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.576340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.576439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.576637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.576678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.576816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.576955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.576979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.577113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.577221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.577247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.577366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.577516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.577544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.577696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.577825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.577850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.578035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.578152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.578180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.465 qpair failed and we were unable to recover it. 00:27:22.465 [2024-11-26 15:51:13.578296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.465 [2024-11-26 15:51:13.578427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.578454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.578607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.578731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.578757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.578862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.578971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.578996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.579119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.579265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.579292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.579434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.579563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.579587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.579704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.579828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.579856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.580009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.580162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.580187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.580309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.580467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.580492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.580598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.580703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.580729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.580863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.581017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.581042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.581153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.581257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.581282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.581401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.581523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.581551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.581696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.581803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.581831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.581999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.582141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.582168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.582295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.582413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.582437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.582549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.582700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.582728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.582868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.583031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.583059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.583189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.583342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.583369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.583496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.583601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.583626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.583727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.583859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.583884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.583982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.584112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.584154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.584297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.584441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.584469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.584587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.584697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.584724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.584879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.584993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.585021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.585142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.585260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.585287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.585463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.585562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.585587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.585682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.585792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.585821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.585920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.586075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.586103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.586216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.586331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.586358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.466 qpair failed and we were unable to recover it. 00:27:22.466 [2024-11-26 15:51:13.586460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.466 [2024-11-26 15:51:13.586571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.586598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.586737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.586845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.586869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.586967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.587094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.587118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.587274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.587422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.587451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.587572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.587722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.587751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.587873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.588033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.588058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.588197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.588312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.588340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.588520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.588655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.588681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.588818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.588934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.588962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.589086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.589192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.589217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.589373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.589518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.589546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.589666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.589794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.589822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.589953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.590064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.590091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.590215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.590345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.590370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.590526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.590681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.590716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.590825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.590975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.590999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.591112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.591239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.591263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.591382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.591506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.591531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.591716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.591867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.591894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.592036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.592149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.592176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.592346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.592458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.592486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.592616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.592751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.592778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.592932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.593073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.593100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.593246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.593372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.593399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.593516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.593624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.593651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.593807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.593907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.593932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.594071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.594250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.594275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.594377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.594513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.594540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.594696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.594801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.467 [2024-11-26 15:51:13.594825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.467 qpair failed and we were unable to recover it. 00:27:22.467 [2024-11-26 15:51:13.594927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.595056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.595081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.595210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.595316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.595343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.595490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.595644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.595669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.595826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.595946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.595971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.596130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.596262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.596305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.596447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.596634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.596659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.596797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.596889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.596913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.597050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.597204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.597232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.597355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.597463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.597487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.597643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.597774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.597800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.597913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.598063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.598091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.598233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.598361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.598388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.598517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.598630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.598654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.598765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.598872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.598897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.599080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.599227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.599254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.599355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.599460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.599488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.599642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.599765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.599791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.599905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.600015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.600040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.600195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.600338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.600363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.600499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.600607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.600636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.600742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.600848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.600873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.601026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.601172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.601201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.601355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.601498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.601522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.601699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.601835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.468 [2024-11-26 15:51:13.601860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.468 qpair failed and we were unable to recover it. 00:27:22.468 [2024-11-26 15:51:13.601967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.602075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.602100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.602275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.602432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.602456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.602601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.602716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.602760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.602855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.602964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.603007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.603162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.603301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.603325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.603427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.603610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.603638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.603812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.603959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.603984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.604141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.604259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.604287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.604433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.604569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.604594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.604733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.604853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.604881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.605003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.605138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.605165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.605308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.605450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.605478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.605628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.605729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.605755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.605880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.605998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.606028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.606136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.606278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.606306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.606438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.606595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.606623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.606758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.606874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.606899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.606998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.607125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.607149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.607303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.607416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.607444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.607557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.607674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.607706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.607839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.607972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.607996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.608129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.608282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.608307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.608446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.608582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.608607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.608713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.608850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.608875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.608990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.609094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.609119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.609249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.609405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.609432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.609559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.609703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.609731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.609856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.609971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.609998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.469 [2024-11-26 15:51:13.610119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.610225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.469 [2024-11-26 15:51:13.610250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.469 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.610379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.610539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.610564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.610732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.610855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.610884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.611001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.611116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.611144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.611270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.611405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.611430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.611563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.611708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.611734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.611860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.612014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.612038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.612141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.612275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.612299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.612407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.612526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.612555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.612714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.612813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.612838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.612942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.613070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.613097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.613252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.613356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.613380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.613485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.613622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.613648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.613815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.613921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.613946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.614134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.614309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.614336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.614453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.614575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.614603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.614746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.614874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.614898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.615022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.615130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.615157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.615281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.615419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.615451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.615588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.615705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.615734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.615890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.616011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.616050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.616166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.616318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.616343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.616450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.616546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.616571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.616697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.616821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.616848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.616998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.617131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.617156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.617312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.617452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.617480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.617617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.617766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.617794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.617907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.618048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.618076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.618238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.618339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.618363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.470 qpair failed and we were unable to recover it. 00:27:22.470 [2024-11-26 15:51:13.618494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.618623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.470 [2024-11-26 15:51:13.618648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.618779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.618906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.618933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.619045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.619146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.619188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.619333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.619463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.619488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.619652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.619803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.619829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.619973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.620154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.620182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.620327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.620474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.620501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.620627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.620738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.620764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.620896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.621047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.621075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.621229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.621377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.621404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.621558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.621669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.621703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.621824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.621925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.621950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.622107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.622223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.622250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.622387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.622527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.622555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.622727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.622835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.622862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.622995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.623149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.623173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.623319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.623436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.623463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.623609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.623749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.623777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.623895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.624044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.624069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.624226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.624350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.624391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.624526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.624670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.624706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.624834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.624943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.624970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.625115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.625287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.625315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.625434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.625535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.625561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.625717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.625863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.625891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.626041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.626183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.626210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.626327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.626440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.626468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.626589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.626704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.626730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.626834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.626943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.626983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.471 qpair failed and we were unable to recover it. 00:27:22.471 [2024-11-26 15:51:13.627090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.627238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.471 [2024-11-26 15:51:13.627266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.627418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.627531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.627557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.627673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.627819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.627845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.627949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.628080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.628122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.628234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.628388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.628415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.628528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.628640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.628667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.628799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.628911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.628936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.629088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.629242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.629269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.629398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.629514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.629542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.629697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.629797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.629822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.629934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.630052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.630077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.630224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.630360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.630393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.630510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.630629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.630657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.630790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.630912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.630939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.631061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.631170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.631195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.631332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.631483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.631512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.631665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.631810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.631838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.631940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.632086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.632113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.632242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.632406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.632431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.632566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.632708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.632736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.632881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.632991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.633018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.633161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.633278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.633310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.633450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.633577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.633602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.633802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.633905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.633932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.634080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.634199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.634226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.634343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.634458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.634485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.634612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.634713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.634738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.634848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.634948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.634973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.635088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.635234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.635262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.472 qpair failed and we were unable to recover it. 00:27:22.472 [2024-11-26 15:51:13.635435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.472 [2024-11-26 15:51:13.635566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.635591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.635732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.635835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.635860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.636052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.636184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.636209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.636342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.636527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.636552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.636657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.636827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.636856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.637005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.637134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.637159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.637282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.637387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.637416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.637558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.637703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.637732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.637840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.638015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.638040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.638194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.638328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.638369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.638512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.638620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.638648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.638778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.638906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.638931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.639059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.639207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.639235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.639378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.639478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.639503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.639612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.639740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.639769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.639889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.640003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.640031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.640171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.640291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.640319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.640449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.640556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.640581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.640703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.640852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.640880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.641024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.641137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.641165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.641291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.641478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.641503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.641631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.641756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.641782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.641942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.642052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.642079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.642195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.642318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.642346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.642491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.642626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.642654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.473 qpair failed and we were unable to recover it. 00:27:22.473 [2024-11-26 15:51:13.642807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.642931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.473 [2024-11-26 15:51:13.642956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.643093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.643248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.643273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.643387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.643533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.643560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.643705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.643833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.643861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.644018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.644154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.644179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.644316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.644427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.644454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.644573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.644736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.644761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.644870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.644983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.645008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.645113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.645218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.645242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.645440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.645552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.645580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.645735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.645845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.645870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.646015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.646122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.646150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.646308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.646403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.646428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.646623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.646730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.646758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.646883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.647003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.647031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.647177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.647300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.647327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.647454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.647564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.647588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.647769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.647881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.647909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.648024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.648144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.648177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.648329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.648469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.648496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.648611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.648720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.648747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.648879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.649031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.649056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.649215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.649338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.649365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.649474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.649647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.649671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.649778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.649906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.649930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.650082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.650224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.650252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.650364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.650474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.650501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.650640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.650780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.650806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.650940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.651054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.651078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.474 [2024-11-26 15:51:13.651213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.651365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.474 [2024-11-26 15:51:13.651391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.474 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.651514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.651625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.651652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.651823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.651978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.652003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.652135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.652234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.652259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.652420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.652530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.652557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.652730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.652866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.652891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.653020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.653140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.653168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.653292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.653396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.653420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.653546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.653656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.653683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.653808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.653953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.653980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.654093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.654212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.654240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.654386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.654521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.654546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.654654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.654808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.654838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.654980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.655128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.655156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.655273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.655416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.655443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.655602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.655717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.655743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.655843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.655946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.655971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.656062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.656238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.656262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.656365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.656475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.656501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.656637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.656741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.656767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.656884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.657058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.657086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.657197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.657345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.657370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.657569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.657704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.657730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.657895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.658065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.658108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.658282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.658388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.658415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.658576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.658673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.658704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.658805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.658936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.658961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.659059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.659198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.659223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.659319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.659449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.659473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.475 [2024-11-26 15:51:13.659631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.659795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.475 [2024-11-26 15:51:13.659820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.475 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.659919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.660019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.660044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.660150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.660285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.660309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.660433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.660600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.660628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.660763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.660869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.660896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.661067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.661209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.661258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.661413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.661510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.661534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.661727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.661867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.661895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.662042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.662154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.662182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.662327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.662511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.662536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.662695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.662831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.662874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.662990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.663134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.663167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.663349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.663447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.663471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.663592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.663745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.663774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.663904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.664010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.664036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.664136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.664302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.664326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.664461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.664611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.664638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.664796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.664938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.664965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.665095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.665229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.665254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.665373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.665518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.665545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.665661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.665780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.665808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.665955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.666060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.666087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.666240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.666375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.666400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.666559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.666739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.666767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.666909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.667015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.667041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.667177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.667326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.667355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.667481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.667617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.667642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.667752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.667885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.667910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.668069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.668240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.668267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.476 [2024-11-26 15:51:13.668444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.668560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.476 [2024-11-26 15:51:13.668585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.476 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.668719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.668874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.668899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.669054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.669195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.669224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.669380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.669553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.669580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.669744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.669854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.669879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.670002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.670128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.670152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.670259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.670349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.670374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.670478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.670648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.670675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.670831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.670958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.670985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.671146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.671302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.671344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.671491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.671660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.671695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.671826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.671995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.672019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.672196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.672444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.672497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.672656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.672805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.672832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.672968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.673114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.673141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.673287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.673448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.673473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.673575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.673718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.673747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.673903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.674017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.674042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.674186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.674292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.674319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.674481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.674638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.674665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.674799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.674944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.674971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.675103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.675226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.675251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.675362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.675548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.675575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.675714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.675836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.675864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.675980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.676122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.676150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.676307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.676408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.676433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.676624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.676766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.676795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.477 qpair failed and we were unable to recover it. 00:27:22.477 [2024-11-26 15:51:13.676966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.677118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.477 [2024-11-26 15:51:13.677144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.677278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.677440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.677468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.677596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.677774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.677799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.677930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.678084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.678111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.678262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.678359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.678384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.678514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.678657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.678690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.678830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.678934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.678963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.679100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.679286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.679314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.679484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.679595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.679623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.679771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.679929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.679954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.680130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.680256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.680281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.680468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.680637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.680665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.680808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.680933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.680961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.681132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.681271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.681300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.681479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.681615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.681639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.681773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.681884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.681910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.682031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.682182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.682209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.682386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.682497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.682525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.682672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.682780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.682805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.682978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.683105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.683129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.683245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.683381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.683408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.683521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.683668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.683709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.683894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.684022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.684063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.684182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.684328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.684356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.684501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.684604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.684631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.684745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.684855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.684883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.685069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.685181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.685206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.685367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.685522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.685550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.478 qpair failed and we were unable to recover it. 00:27:22.478 [2024-11-26 15:51:13.685667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.478 [2024-11-26 15:51:13.685822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.685847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.685957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.686161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.686212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.686367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.686475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.686500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.686629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.686788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.686813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.686926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.687028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.687068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.687243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.687411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.687438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.687585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.687743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.687769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.687914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.688059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.688087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.688255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.688398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.688425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.688551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.688677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.688706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.688800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.688903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.688928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.689025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.689137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.689164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.689346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.689470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.689498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.689606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.689749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.689777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.689921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.690055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.690080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.690235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.690396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.690421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.690576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.690673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.690704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.690828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.690966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.690990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.691103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.691234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.691260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.691442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.691590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.691618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.691743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.691857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.691884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.692067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.692198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.692223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.692380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.692551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.692578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.692697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.692846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.692874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.692987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.693156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.693183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.693380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.693512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.693538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.693678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.693790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.693815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.694007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.694126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.694153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.694294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.694435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.694462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.479 qpair failed and we were unable to recover it. 00:27:22.479 [2024-11-26 15:51:13.694574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.479 [2024-11-26 15:51:13.694720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.694752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.694911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.695038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.695063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.695185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.695321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.695348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.695519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.695627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.695654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.695807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.695925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.695953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.696109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.696273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.696298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.696441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.696584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.696611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.696790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.696890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.696914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.697021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.697144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.697186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.697331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.697464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.697488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.697646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.697810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.697840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.698019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.698120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.698148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.698265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.698376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.698404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.698567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.698701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.698726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.698857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.699009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.699036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.699195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.699327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.699353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.699483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.699613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.699638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.699809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.699906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.699931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.700090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.700238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.700265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.700407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.700526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.700555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.700718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.700838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.700866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.701048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.701176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.701200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.701353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.701465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.701492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.701661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.701857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.701883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.702017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.702294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.702322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.702502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.702677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.702710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.702836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.702980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.703008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.703146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.703290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.703317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.703452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.703625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.703652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.480 qpair failed and we were unable to recover it. 00:27:22.480 [2024-11-26 15:51:13.703804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.480 [2024-11-26 15:51:13.703937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.703963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.704114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.704267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.704292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.704423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.704526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.704550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.704730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.704889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.704914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.705075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.705208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.705232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.705363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.705510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.705537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.705677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.705838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.705862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.705988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.706109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.706138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.706291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.706425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.706450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.706651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.706810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.706836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.706966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.707120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.707147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.707319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.707453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.707480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.707629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.707816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.707842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.707942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.708078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.708103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.708256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.708382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.708411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.708565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.708676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.708708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.708836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.708950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.708975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.709144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.709327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.709355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.709509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.709606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.709631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.709788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.709940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.709967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.710148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.710282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.710325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.710462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.710617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.710643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.710778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.710940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.710968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.711114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.711231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.711259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.711437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.711571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.711596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.711747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.711932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.711960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.712079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.712223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.712251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.712358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.712531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.712556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.712716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.712813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.712837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.481 qpair failed and we were unable to recover it. 00:27:22.481 [2024-11-26 15:51:13.712940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.481 [2024-11-26 15:51:13.713059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.713087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.713225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.713398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.713425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.713526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.713700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.713725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.713891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.714060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.714093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.714282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.714409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.714434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.714584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.714765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.714791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.714901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.715044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.715081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.715215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.715347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.715372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.715507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.715677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.715719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.715866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.716011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.716038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.716222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.716345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.716369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.716532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.716632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.716657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.716786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.716934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.716961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.717107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.717283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.717311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.717466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.717606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.717634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.717815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.717919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.717944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.718049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.718218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.718246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.718395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.718592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.718617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.718762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.718931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.718958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.719114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.719239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.719264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.719440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.719625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.719650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.719790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.719933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.719961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.720096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.720299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.720347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.720532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.720662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.720707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.720833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.721009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.721037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.482 qpair failed and we were unable to recover it. 00:27:22.482 [2024-11-26 15:51:13.721178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.482 [2024-11-26 15:51:13.721348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.721376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.721530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.721661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.721691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.721820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.721948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.721973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.722106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.722253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.722278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.722408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.722563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.722590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.722734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.722868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.722896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.723048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.723209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.723233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.723410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.723541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.723566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.723674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.723811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.723836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.723995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.724169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.724196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.724353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.724457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.724481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.724610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.724781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.724806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.724913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.725072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.725099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.725256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.725410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.725437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.725596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.725762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.725788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.725888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.726025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.726050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.726195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.726334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.726362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.726489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.726636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.726660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.726793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.726928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.726953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.727144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.727306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.727330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.727485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.727623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.727650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.727806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.727911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.727936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.728046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.728175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.728200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.728351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.728492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.728519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.728658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.728831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.728860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.729022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.729192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.729248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.729378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.729510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.729535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.729664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.729806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.729831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.729931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.730024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.730049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.483 qpair failed and we were unable to recover it. 00:27:22.483 [2024-11-26 15:51:13.730177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.483 [2024-11-26 15:51:13.730289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.730321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.730437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.730571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.730596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.730760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.730893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.730920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.731079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.731250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.731277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.731391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.731535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.731562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.731718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.731854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.731878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.732010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.732134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.732162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.732309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.732415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.732443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.732566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.732702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.732727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.732841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.732972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.732997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.733100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.733270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.733295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.733500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.733629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.733654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.733752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.733908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.733936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.734080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.734182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.734206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.734337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.734512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.734539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.734723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.734870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.734895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.735028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.735232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.735282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.735478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.735584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.735624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.735809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.735943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.735968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.736095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.736235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.736262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.736436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.736577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.736605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.736772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.736904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.736930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.737051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.737219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.737247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.737394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.737503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.737531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.737670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.737824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.737852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.738012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.738168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.738210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.738365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.738510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.738537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.738645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.738766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.738794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.738944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.739116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.739163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.484 qpair failed and we were unable to recover it. 00:27:22.484 [2024-11-26 15:51:13.739306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.484 [2024-11-26 15:51:13.739464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.739507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.739626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.739779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.739807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.739950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.740096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.740123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.740292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.740410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.740437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.740558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.740696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.740721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.740854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.741044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.741072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.741179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.741323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.741351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.741487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.741583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.741608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.741721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.741849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.741874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.742048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.742191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.742219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.742366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.742510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.742539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.742694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.742839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.742867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.742988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.743147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.743172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.743321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.743490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.743518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.743709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.743861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.743885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.744032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.744131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.744173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.744358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.744527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.744555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.744742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.744902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.744927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.745057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.745205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.745233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.745355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.745474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.745502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.745625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.745764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.745789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.745938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.746077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.746105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.746262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.746396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.746425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.746563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.746703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.746732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.746889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.747020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.747046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.747214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.747372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.747397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.747555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.747737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.747766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.747891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.748001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.748028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.748180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.748289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.748313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.485 qpair failed and we were unable to recover it. 00:27:22.485 [2024-11-26 15:51:13.748442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.485 [2024-11-26 15:51:13.748583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.748611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.748749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.748866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.748894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.749037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.749184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.749209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.749372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.749530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.749559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.749717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.749876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.749900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.750030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.750177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.750205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.750354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.750464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.750492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.750621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.750744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.750770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.750936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.751103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.751128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.751257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.751426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.751450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.751577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.751770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.751795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.751931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.752030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.752054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.752207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.752349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.752378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.752524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.752697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.752726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.752907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.753076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.753104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.753225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.753361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.753386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.753542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.753658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.753693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.753830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.753972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.753999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.754125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.754262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.754290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.754452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.754561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.754585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.754744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.754917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.754942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.755103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.755295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.755322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.755494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.755633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.755660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.755820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.755954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.755981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.756173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.756310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.756351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.756480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.756633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.756660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.756819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.756962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.756990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.757138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.757299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.757340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.757477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.757614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.757641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.486 qpair failed and we were unable to recover it. 00:27:22.486 [2024-11-26 15:51:13.757780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.486 [2024-11-26 15:51:13.757879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.757904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.758058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.758199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.758228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.758383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.758518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.758543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.758701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.758811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.758839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.758992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.759136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.759164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.759318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.759427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.759453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.759582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.759738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.759764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.759873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.760001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.760025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.760192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.760336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.760364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.760524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.760666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.760700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.760859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.760967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.760991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.761115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.761251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.761279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.761416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.761554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.761581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.761698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.761813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.761841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.761977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.762084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.762108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.762208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.762346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.762374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.762533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.762661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.762691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.762838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.762999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.763024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.763194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.763328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.763353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.763456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.763582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.763610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.763762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.763944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.763969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.764100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.764339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.764363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.764532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.764683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.764718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.764875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.765027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.765055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.765204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.765317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.765345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.487 [2024-11-26 15:51:13.765518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.765659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.487 [2024-11-26 15:51:13.765700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.487 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.765856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.765987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.766012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.766167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.766347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.766371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.766526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.766683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.766716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.766852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.766968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.766995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.767116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.767245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.767271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.767370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.767460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.767501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.767675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.767849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.767876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.768045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.768185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.768212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.768364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.768499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.768525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.768693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.768840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.768868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.768986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.769122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.769150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.769294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.769408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.769436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.769590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.769726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.769751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.769873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.770015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.770042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.770219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.770328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.770356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.770500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.770651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.770677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.770838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.770974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.771016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.771167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.771337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.771365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.771500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.771602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.771629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.771781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.771922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.771950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.772107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.772267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.772292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.772434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.772548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.772576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.772751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.772891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.772918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.773074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.773224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.773251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.773407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.773531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.773556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.773715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.773864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.773891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.774040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.774211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.774238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.774381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.774552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.774580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.488 qpair failed and we were unable to recover it. 00:27:22.488 [2024-11-26 15:51:13.774742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.774868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.488 [2024-11-26 15:51:13.774893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.775079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.775233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.775291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.775411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.775563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.775590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.775733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.775857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.775887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.776042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.776176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.776201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.776369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.776527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.776552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.776710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.776865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.776891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.777032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.777209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.777260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.777443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.777577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.777618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.777791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.777971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.777995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.778092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.778231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.778256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.778388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.778514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.778539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.778708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.778880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.778906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.779059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.779230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.779257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.779404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.779554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.779578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.779717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.779858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.779886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.780034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.780190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.780214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.780370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.780490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.780517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.780694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.780817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.780845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.780960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.781108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.781135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.781314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.781498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.781525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.781705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.781865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.781890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.782018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.782127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.782160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.782383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.782550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.782578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.782771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.782900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.782943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.783101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.783235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.783260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.783430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.783577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.783604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.783733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.783906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.783934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.784051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.784185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.784210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.489 qpair failed and we were unable to recover it. 00:27:22.489 [2024-11-26 15:51:13.784359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.784517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.489 [2024-11-26 15:51:13.784544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.784679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.784846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.784871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.785004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.785161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.785208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.785339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.785494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.785519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.785720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.785881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.785906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.786069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.786207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.786235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.786395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.786553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.786578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.786704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.786831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.786856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.787042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.787202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.787239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.787366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.787494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.787521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.787660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.787810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.787838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.787970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.788105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.788130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.788273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.788399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.788426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.788567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.788745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.788773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.788881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.789054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.789081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.789264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.789359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.789384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.789512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.789681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.789716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.789860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.789967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.789994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.790239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.790450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.790477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.790607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.790708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.790733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.790851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.791026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.791054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.791230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.791376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.791406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.791551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.791720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.791749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.791934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.792045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.792069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.792217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.792368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.792396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.792569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.792717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.792746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.792890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.793027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.793055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.793184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.793309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.793334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.793465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.793601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.793626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.490 qpair failed and we were unable to recover it. 00:27:22.490 [2024-11-26 15:51:13.793761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.490 [2024-11-26 15:51:13.793906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.793934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.794049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.794194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.794222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.794372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.794474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.794499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.794654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.794819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.794844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.794957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.795088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.795113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.795213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.795318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.795343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.795476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.795605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.795630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.795828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.795938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.795965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.796123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.796256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.796281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.796406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.796565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.796589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.796719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.796878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.796903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.797098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.797195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.797219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.797367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.797468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.797496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.797637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.797809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.797838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.797965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.798101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.798126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.798227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.798333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.798362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.798473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.798627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.798654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.798776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.798922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.798950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.799077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.799207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.799232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.799351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.799522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.799550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.799664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.799809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.799837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.800015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.800160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.800188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.800338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.800465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.800490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.800639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.800791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.800821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.800941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.801062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.801089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.491 qpair failed and we were unable to recover it. 00:27:22.491 [2024-11-26 15:51:13.801227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.801337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.491 [2024-11-26 15:51:13.801364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.801547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.801679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.801726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.801873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.802016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.802043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.802150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.802250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.802277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.802422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.802554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.802579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.802708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.802811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.802835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.802955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.803056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.803081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.803189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.803319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.803343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.803487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.803629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.803656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.803826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.803940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.803965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.804166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.804287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.804312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.804470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.804642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.804670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.804821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.804969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.804997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.805123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.805253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.805278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.805456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.805571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.805598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.805770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.805878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.805905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.806078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.806255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.806283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.806463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.806559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.806583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.806766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.806902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.806926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.807046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.807161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.807188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.807335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.807486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.807511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.807648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.807785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.807810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.807973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.808142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.808169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.808314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.808490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.808517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.808657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.808831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.808857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.809018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.809149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.809191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.809304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.809446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.809474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.809616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.809756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.809784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.809931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.810069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.810134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.492 [2024-11-26 15:51:13.810290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.810423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.492 [2024-11-26 15:51:13.810448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.492 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.810572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.810714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.810741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.810869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.810991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.811019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.811195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.811305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.811329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.811456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.811592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.811617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.811787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.811905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.811929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.812061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.812164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.812208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.812379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.812496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.812523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.812703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.812804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.812828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.812956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.813063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.813091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.813232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.813376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.813404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.813542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.813751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.813779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.813927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.814088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.814135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.814316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.814445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.814471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.814601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.814745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.814774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.814883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.814993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.815021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.815172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.815331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.815371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.815491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.815625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.815653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.815779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.815905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.815932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.816077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.816225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.816252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.816428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.816531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.816555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.816737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.816869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.816895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.817075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.817182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.817214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.817386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.817526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.817554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.817707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.817843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.817870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.818000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.818154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.818179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.818309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.818438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.818463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.818581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.818757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.818785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.818947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.819072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.819097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.493 qpair failed and we were unable to recover it. 00:27:22.493 [2024-11-26 15:51:13.819250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.819390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.493 [2024-11-26 15:51:13.819417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.819530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.819699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.819724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.819858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.820008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.820036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.820165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.820297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.820323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.820444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.820587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.820614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.820787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.820903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.820931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.821056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.821201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.821229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.821413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.821559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.821586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.821718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.821889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.821917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.822067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.822211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.822238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.822380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.822546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.822574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.822704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.822863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.822888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.823011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.823145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.823172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.823274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.823451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.823475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.823579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.823709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.823734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.823847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.823980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.824005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.824189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.824321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.824345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.824485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.824623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.824650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.824801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.824913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.824940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.825095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.825268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.825296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.825468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.825604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.825631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.825777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.825934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.825959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.826091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.826233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.826260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.826417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.826577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.826602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.826727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.826846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.826874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.827017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.827227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.827276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.827430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.827617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.827642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.827783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.827916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.827958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.828151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.828283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.828308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.494 [2024-11-26 15:51:13.828443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.828591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.494 [2024-11-26 15:51:13.828616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.494 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.828776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.828963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.828988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.829149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.829278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.829321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.829465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.829649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.829674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.829811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.829920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.829945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.830045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.830165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.830192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.830349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.830483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.830507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.830615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.830706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.830732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.830839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.830929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.830969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.831143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.831310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.831337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.831469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.831603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.831629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.831731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.831831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.831856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.832033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.832141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.832169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.832303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.832446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.832473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.832628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.832763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.832787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.832946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.833089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.833121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.833268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.833376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.833403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.833571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.833785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.833839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.834019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.834153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.834177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.834327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.834441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.834468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.834639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.834825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.834854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.834965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.835110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.835139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.835252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.835378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.835402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.835563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.835712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.835740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.835896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.836001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.836026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.836203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.836348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.836376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.836508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.836642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.836666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.836847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.837020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.837077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.837184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.837328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.837355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.495 qpair failed and we were unable to recover it. 00:27:22.495 [2024-11-26 15:51:13.837540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.495 [2024-11-26 15:51:13.837664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.837701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.837836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.837962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.837986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.838152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.838261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.838288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.838429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.838544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.838571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.838745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.838897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.838922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.839051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.839206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.839247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.839388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.839557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.839584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.839746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.839862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.839887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.840027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.840168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.840196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.840347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.840471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.840496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.840617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.840773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.840799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.840904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.841053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.841080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.841230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.841383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.841409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.841542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.841699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.841742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.841918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.842059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.842086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.842232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.842333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.842360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.842504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.842611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.842639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.842810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.842993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.843052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.843204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.843321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.843348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.843524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.843617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.843642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.843753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.843846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.843871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.843988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.844089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.844115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.844277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.844446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.844473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.844591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.844714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.844742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.844869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.845017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.845044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.496 [2024-11-26 15:51:13.845199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.845359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.496 [2024-11-26 15:51:13.845383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.496 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.845495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.845659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.845684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.845844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.846004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.846028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.846143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.846296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.846323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.846477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.846577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.846601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.846754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.846864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.846893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.847043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.847189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.847217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.847355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.847473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.847500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.847631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.847768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.847794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.847976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.848165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.848221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.848376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.848510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.848534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.848716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.848853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.848880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.849010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.849135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.849164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.849288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.849455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.849482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.849624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.849791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.849817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.849920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.850026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.850052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.850178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.850299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.850324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.850444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.850614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.850642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.850800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.850905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.850930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.851105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.851312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.851362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.851541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.851671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.851717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.851870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.851985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.852009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.852164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.852305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.852333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.852487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.852633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.852662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.852806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.852903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.852927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.853055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.853215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.853242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.853360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.853531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.853558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.853700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.853871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.853899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.854057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.854214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.854254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.854427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.854525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.497 [2024-11-26 15:51:13.854549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.497 qpair failed and we were unable to recover it. 00:27:22.497 [2024-11-26 15:51:13.854683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.854858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.854886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.855055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.855257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.855307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.855458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.855612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.855636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.855844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.855954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.855978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.856112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.856259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.856287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.856442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.856604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.856629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.856758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.856871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.856896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.857034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.857136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.857163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.857338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.857454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.857481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.857599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.857733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.857761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.857922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.858012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.858037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.858212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.858348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.858376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.858485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.858628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.858655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.858773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.858891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.858918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.859027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.859126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.859151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.859309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.859439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.859463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.859642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.859780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.859806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.859940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.860084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.860111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.860241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.860352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.860378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.860487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.860593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.860617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.860754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.860927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.860955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.861079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.861195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.861222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.861348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.861455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.861480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.861640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.861790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.861819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.861960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.862109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.862136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.862280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.862455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.862480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.862636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.862732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.862757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.862922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.863052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.863077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.863175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.863277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.498 [2024-11-26 15:51:13.863303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.498 qpair failed and we were unable to recover it. 00:27:22.498 [2024-11-26 15:51:13.863452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.863592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.863617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.863750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.863865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.863890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.864062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.864186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.864211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.864339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.864456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.864483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.864628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.864772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.864805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.864933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.865068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.865093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.865194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.865350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.865378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.865516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.865630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.865657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.865818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.865919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.865943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.866143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.866279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.866321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.866458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.866570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.866597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.866732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.866889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.866914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.867041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.867196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.867223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.867383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.867540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.867564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.867701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.867819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.867851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.867975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.868091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.868119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.868257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.868404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.868432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.868582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.868695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.868720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.868853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.869019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.869047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.869167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.869281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.869308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.869427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.869551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.869578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.869727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.869836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.869862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.869967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.870088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.870115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.870298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.870473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.870497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.870604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.870736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.870762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.870900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.871006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.871030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.871164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.871258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.871283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.871376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.871521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.871549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.499 qpair failed and we were unable to recover it. 00:27:22.499 [2024-11-26 15:51:13.871699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.871812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.499 [2024-11-26 15:51:13.871837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.871968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.872061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.872086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.872236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.872388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.872416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.872559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.872704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.872732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.872844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.872998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.873023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.873122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.873252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.873276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.873378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.873505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.873532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.873654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.873813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.873838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.873971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.874068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.874093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.874221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.874353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.874377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.874537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.874691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.874717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.874814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.874971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.874999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.875112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.875240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.875267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.875424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.875552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.875576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.875750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.875854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.875879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.876036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.876142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.876170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.876290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.876400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.876429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.876592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.876711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.876737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.876887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.877033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.877061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.877197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.877316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.877344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.877487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.877620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.877645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.877781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.877888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.877914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.878024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.878161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.878185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.878356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.878487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.878511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.878658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.878789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.878817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.878951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.879057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.879082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.879197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.879320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.879345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.500 qpair failed and we were unable to recover it. 00:27:22.500 [2024-11-26 15:51:13.879476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.500 [2024-11-26 15:51:13.879633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.879676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.879813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.879916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.879941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.880076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.880185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.880209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.880382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.880525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.880552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.880725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.880872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.880899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.881017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.881150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.881177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.881332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.881465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.881491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.881650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.881772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.881801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.881950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.882094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.882121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.882231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.882347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.882374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.882529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.882646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.882675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.882794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.882931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.882956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.883111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.883255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.883283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.883393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.883505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.883532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.883651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.883766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.883791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.883928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.884095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.884120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.884233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.884415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.884442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.884577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.884710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.884736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.884871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.884977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.885001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.885158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.885339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.885363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.885467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.885615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.885643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.885805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.885948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.885976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.886154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.886285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.886310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.501 qpair failed and we were unable to recover it. 00:27:22.501 [2024-11-26 15:51:13.886483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.886599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.501 [2024-11-26 15:51:13.886628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.790 qpair failed and we were unable to recover it. 00:27:22.790 [2024-11-26 15:51:13.886760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.886901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.886929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.790 qpair failed and we were unable to recover it. 00:27:22.790 [2024-11-26 15:51:13.887078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.887243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.887293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.790 qpair failed and we were unable to recover it. 00:27:22.790 [2024-11-26 15:51:13.887453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.887565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.887590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.790 qpair failed and we were unable to recover it. 00:27:22.790 [2024-11-26 15:51:13.887700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.887804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.887847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.790 qpair failed and we were unable to recover it. 00:27:22.790 [2024-11-26 15:51:13.887989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.888130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.888158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.790 qpair failed and we were unable to recover it. 00:27:22.790 [2024-11-26 15:51:13.888271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.888375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.888402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.790 qpair failed and we were unable to recover it. 00:27:22.790 [2024-11-26 15:51:13.888556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.888684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.888716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.790 qpair failed and we were unable to recover it. 00:27:22.790 [2024-11-26 15:51:13.888890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.889044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.889069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.790 qpair failed and we were unable to recover it. 00:27:22.790 [2024-11-26 15:51:13.889200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.889348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.889375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.790 qpair failed and we were unable to recover it. 00:27:22.790 [2024-11-26 15:51:13.889496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.889612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.889639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.790 qpair failed and we were unable to recover it. 00:27:22.790 [2024-11-26 15:51:13.889771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.889883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.889909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.790 qpair failed and we were unable to recover it. 00:27:22.790 [2024-11-26 15:51:13.890043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.890184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.890212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.790 qpair failed and we were unable to recover it. 00:27:22.790 [2024-11-26 15:51:13.890360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.890488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.890514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.790 qpair failed and we were unable to recover it. 00:27:22.790 [2024-11-26 15:51:13.890690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.790 [2024-11-26 15:51:13.890801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.890827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.890930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.891063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.891088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.891195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.891360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.891385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.891520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.891670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.891705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.891823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.891941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.891969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.892096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.892234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.892259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.892391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.892517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.892545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.892706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.892884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.892909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.893027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.893155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.893183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.893308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.893435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.893460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.893605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.893777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.893805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.893931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.894078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.894106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.894263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.894394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.894419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.894521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.894670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.894700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.894863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.894982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.895009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.895124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.895241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.895269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.895401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.895520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.895549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.895708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.895843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.895868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.895993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.896107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.896134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.896277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.896417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.896446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.791 qpair failed and we were unable to recover it. 00:27:22.791 [2024-11-26 15:51:13.896619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.791 [2024-11-26 15:51:13.896730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.896759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.896912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.897012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.897037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.897160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.897272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.897315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.897428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.897607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.897647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.897766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.897880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.897909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.898024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.898152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.898178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.898307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.898454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.898480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.898627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.898769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.898798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.898922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.899039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.899066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.899194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.899327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.899352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.899522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.899641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.899668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.899801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.899917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.899945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.900065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.900210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.900237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.900394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.900528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.900553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.900677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.900832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.900859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.901033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.901148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.901176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.901315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.901438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.901466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.901598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.901733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.901759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.901863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.902010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.902037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.902177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.902348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.902373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.792 qpair failed and we were unable to recover it. 00:27:22.792 [2024-11-26 15:51:13.902504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.792 [2024-11-26 15:51:13.902653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.902680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.902819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.902946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.902971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.903144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.903244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.903268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.903397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.903520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.903548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.903699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.903836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.903860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.903969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.904078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.904102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.904204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.904345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.904372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.904488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.904647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.904674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.904798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.904913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.904942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.905074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.905228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.905253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.905401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.905553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.905580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.905727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.905850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.905874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.905999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.906105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.906129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.906234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.906366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.906391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.906554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.906672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.906705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.906857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.906979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.907007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.907125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.907240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.907267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.907412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.907550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.907575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.907741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.907870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.907895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.908011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.908123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.793 [2024-11-26 15:51:13.908150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.793 qpair failed and we were unable to recover it. 00:27:22.793 [2024-11-26 15:51:13.908302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.908416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.908443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.908599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.908726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.908752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.908879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.909014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.909041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.909167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.909313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.909340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.909448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.909597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.909624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.909768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.909880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.909905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.910057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.910179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.910206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.910334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.910444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.910471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.910583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.910714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.910740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.910851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.910988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.911013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.911118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.911242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.911270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.911409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.911566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.911593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.911747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.911875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.911900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.912059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.912158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.912184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.912315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.912455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.912482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.912655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.912785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.912814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.912920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.913077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.913105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.913232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.913335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.913360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.913507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.913692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.913717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.913850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.913973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.794 [2024-11-26 15:51:13.914001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.794 qpair failed and we were unable to recover it. 00:27:22.794 [2024-11-26 15:51:13.914105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.914250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.914278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.914399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.914535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.914560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.914692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.914823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.914848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.914975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.915113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.915140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.915243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.915359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.915388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.915538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.915673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.915704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.915848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.915966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.915994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.916141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.916260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.916287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.916415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.916603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.916628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.916765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.916868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.916893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.917045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.917158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.917185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.917297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.917466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.917494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.917631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.917818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.917846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.917999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.918100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.918124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.918291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.918405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.918433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.918546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.918691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.918720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.918831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.919005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.919030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.919143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.919248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.919272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.919373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.919529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.919558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.919711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.919838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.795 [2024-11-26 15:51:13.919863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.795 qpair failed and we were unable to recover it. 00:27:22.795 [2024-11-26 15:51:13.919989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.920141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.920167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.920269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.920375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.920398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.920511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.920616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.920656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.920775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.920917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.920943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.921088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.921212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.921239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.921389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.921531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.921555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.921722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.921834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.921860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.921986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.922141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.922167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.922291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.922404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.922430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.922558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.922657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.922681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.922840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.922946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.922973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.923092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.923239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.923266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.923443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.923546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.923571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.923707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.923845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.923886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.924033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.924141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.924170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.796 [2024-11-26 15:51:13.924318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.924469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.796 [2024-11-26 15:51:13.924497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.796 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.924626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.924782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.924807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.924911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.925046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.925071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.925204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.925361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.925385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.925493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.925648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.925676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.925806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.925912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.925936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.926067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.926189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.926214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.926336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.926484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.926509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.926639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.926759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.926787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.926916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.927035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.927063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.927189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.927297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.927322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.927503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.927622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.927654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.927765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.927869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.927897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.928021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.928202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.928229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.928361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.928494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.928521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.928705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.928822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.928850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.928979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.929121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.929149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.929304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.929411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.929438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.929558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.929720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.929745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.929866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.930038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.930065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.797 qpair failed and we were unable to recover it. 00:27:22.797 [2024-11-26 15:51:13.930182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.930361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.797 [2024-11-26 15:51:13.930386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.930496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.930596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.930643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.930792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.930893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.930918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.931018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.931153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.931178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.931317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.931444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.931471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.931593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.931756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.931782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.931909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.932009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.932034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.932157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.932267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.932294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.932441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.932588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.932612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.932721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.932816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.932842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.932993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.933134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.933159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.933309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.933455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.933482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.933608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.933731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.933759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.933885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.934006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.934034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.934162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.934259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.934284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.934415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.934562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.934589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.934708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.934821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.934848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.934995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.935137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.935165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.935295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.935429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.935455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.935585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.935684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.935715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.798 qpair failed and we were unable to recover it. 00:27:22.798 [2024-11-26 15:51:13.935844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.798 [2024-11-26 15:51:13.935970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.935997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.936178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.936286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.936311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.936446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.936554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.936579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.936725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.936876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.936901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.937084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.937191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.937218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.937340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.937489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.937513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.937641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.937778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.937804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.937928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.938095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.938123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.938266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.938427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.938452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.938577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.938680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.938709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.938816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.938918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.938942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.939095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.939231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.939256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.939354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.939454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.939498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.939660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.939768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.939793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.939932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.940064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.940089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.940222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.940396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.940421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.940579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.940711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.940737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.940840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.941002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.941027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.941168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.941327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.941370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.941490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.941661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.941694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.799 qpair failed and we were unable to recover it. 00:27:22.799 [2024-11-26 15:51:13.941830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.799 [2024-11-26 15:51:13.941947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.941972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.942120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.942269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.942296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.942416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.942540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.942569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.942694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.942804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.942829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.942956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.943052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.943077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.943174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.943285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.943310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.943415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.943532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.943557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.943703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.943834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.943861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.944039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.944210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.944237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.944373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.944520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.944547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.944668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.944774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.944799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.944898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.945055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.945082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.945256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.945392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.945424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.945547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.945696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.945724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.945858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.945993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.946017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.946122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.946231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.946255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.946386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.946560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.946587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.946711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.946836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.946863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.946981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.947111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.947136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.947251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.947356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.800 [2024-11-26 15:51:13.947384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.800 qpair failed and we were unable to recover it. 00:27:22.800 [2024-11-26 15:51:13.947529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.947639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.947666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.947791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.947940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.947965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.948098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.948207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.948232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.948398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.948500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.948526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.948632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.948758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.948787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.948914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.949043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.949083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.949234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.949392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.949416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.949572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.949713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.949741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.949853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.949983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.950010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.950200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.950352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.950379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.950515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.950649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.950674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.950812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.950970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.950995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.951110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.951253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.951282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.951483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.951599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.951626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.951750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.951864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.951888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.952012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.952128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.952157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.952330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.952479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.952506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.952613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.952770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.952796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.952894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.953004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.953029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.953145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.953252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.801 [2024-11-26 15:51:13.953277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.801 qpair failed and we were unable to recover it. 00:27:22.801 [2024-11-26 15:51:13.953377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.953533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.953561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.953706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.953888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.953913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.954040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.954162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.954187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.954364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.954502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.954527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.954668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.954794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.954822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.954928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.955041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.955081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.955189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.955287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.955311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.955408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.955504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.955529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.955662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.955808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.955835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.955989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.956143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.956167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.956286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.956395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.956419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.956541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.956647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.956674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.956845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.956962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.956989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.957109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.957231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.957260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.957418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.957523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.957548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.957706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.957841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.957869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.957975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.958145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.958172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.958294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.958436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.958463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.958594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.958698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.958723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.958869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.958978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.802 [2024-11-26 15:51:13.959019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.802 qpair failed and we were unable to recover it. 00:27:22.802 [2024-11-26 15:51:13.959151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.959273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.959302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.959419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.959535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.959563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.959725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.959831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.959856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.959961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.960090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.960120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.960230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.960348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.960375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.960491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.960674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.960704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.960807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.960941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.960966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.961121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.961294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.961321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.961426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.961573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.961613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.961737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.961877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.961902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.962011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.962110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.962134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.962259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.962377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.962401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.962506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.962603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.962629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.962743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.962887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.962913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.963032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.963160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.963185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.963294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.963450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.803 [2024-11-26 15:51:13.963477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.803 qpair failed and we were unable to recover it. 00:27:22.803 [2024-11-26 15:51:13.963598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.963753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.963780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.963892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.964047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.964074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.964251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.964381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.964405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.964532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.964651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.964679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.964861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.964959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.964984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.965165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.965302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.965329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.965452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.965595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.965620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.965775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.965885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.965913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.966072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.966167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.966192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.966368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.966510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.966538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.966703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.966809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.966834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.966956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.967064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.967091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.967207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.967359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.967386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.967506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.967647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.967674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.967811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.967921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.967945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.968079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.968194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.968221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.968341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.968485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.968512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.968657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.968766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.968791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.968927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.969037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.969062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.969175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.969331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.969359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.804 qpair failed and we were unable to recover it. 00:27:22.804 [2024-11-26 15:51:13.969493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.804 [2024-11-26 15:51:13.969607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.969635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.969786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.969889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.969914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.970045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.970149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.970175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.970276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.970378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.970403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.970520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.970649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.970678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.970859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.971053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.971078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.971184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.971317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.971342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.971535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.971660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.971690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.971836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.972003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.972028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.972126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.972227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.972252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.972398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.972504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.972529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.972717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.972895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.972920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.973058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.973215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.973242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.973355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.973474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.973503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.973669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.973834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.973878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.973992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.974138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.974166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.974286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.974418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.974442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.974555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.974708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.974736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.974917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.975021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.975050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.975161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.975266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.975291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.805 qpair failed and we were unable to recover it. 00:27:22.805 [2024-11-26 15:51:13.975417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.805 [2024-11-26 15:51:13.975551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.975579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.975695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.975821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.975849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.976020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.976180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.976223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.976345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.976465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.976493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.976636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.976771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.976797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.976898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.977047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.977074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.977200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.977307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.977332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.977469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.977609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.977637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.977752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.977900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.977933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.978088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.978212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.978239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.978358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.978455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.978479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.978611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.978735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.978765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.978916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.979061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.979089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.979248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.979373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.979398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.979501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.979605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.979630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.979754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.979866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.979894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.980017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.980142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.980170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.980275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.980425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.980451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.980593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.980708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.980733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.980848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.980966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.806 [2024-11-26 15:51:13.980994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.806 qpair failed and we were unable to recover it. 00:27:22.806 [2024-11-26 15:51:13.981138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.981259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.981287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.981428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.981530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.981558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.981695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.981802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.981826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.981929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.982038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.982062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.982211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.982352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.982379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.982531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.982635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.982659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.982800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.982898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.982922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.983031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.983131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.983156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.983283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.983421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.983449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.983625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.983744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.983773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.983928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.984030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.984055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.984204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.984353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.984380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.984522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.984641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.984668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.984812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.984964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.984991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.985141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.985280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.985304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.985462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.985585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.985613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.985758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.985924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.985949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.986081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.986222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.986246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.986358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.986458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.986483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.986612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.986752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.807 [2024-11-26 15:51:13.986778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.807 qpair failed and we were unable to recover it. 00:27:22.807 [2024-11-26 15:51:13.986936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.987083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.987110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.987288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.987412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.987437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.987571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.987669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.987701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.987812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.987932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.987959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.988074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.988212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.988239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.988389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.988496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.988522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.988659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.988774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.988799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.988926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.989034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.989061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.989256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.989355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.989380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.989482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.989607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.989635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.989765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.989907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.989932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.990045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.990212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.990239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.990387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.990511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.990535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.990664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.990849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.990877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.991027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.991167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.991192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.991383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.991486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.991511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.991632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.991797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.991822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.991964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.992084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.992111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.992240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.992369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.992393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.992537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.992707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.808 [2024-11-26 15:51:13.992738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.808 qpair failed and we were unable to recover it. 00:27:22.808 [2024-11-26 15:51:13.992849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.992946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.992971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.993100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.993202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.993227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.993345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.993469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.993494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.993619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.993786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.993811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.993918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.994028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.994071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.994198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.994320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.994347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.994527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.994632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.994657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.994800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.994935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.994959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.995112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.995223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.995250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.995351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.995488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.995515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.995682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.995793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.995817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.995951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.996064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.996091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.996251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.996385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.996410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.996565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.996719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.996747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.996883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.997018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.997042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.997162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.997310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.997340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.997493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.997602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.997627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.997751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.997891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.997918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.998039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.998168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.998192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.998311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.998420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.809 [2024-11-26 15:51:13.998448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.809 qpair failed and we were unable to recover it. 00:27:22.809 [2024-11-26 15:51:13.998556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:13.998704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:13.998732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:13.998878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:13.999032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:13.999058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:13.999193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:13.999292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:13.999316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:13.999436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:13.999565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:13.999589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:13.999694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:13.999864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:13.999892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:14.000029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.000173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.000201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:14.000323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.000458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.000483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:14.000620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.000743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.000771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:14.000927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.001038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.001066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:14.001217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.001398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.001422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:14.001580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.001710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.001739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:14.001861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.001978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.002006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:14.002158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.002280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.002309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:14.002427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.002570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.002598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:14.002745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.002844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.002869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:14.003055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.003169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.003196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.810 qpair failed and we were unable to recover it. 00:27:22.810 [2024-11-26 15:51:14.003351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.810 [2024-11-26 15:51:14.003509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.003534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.003673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.003819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.003846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.003981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.004074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.004098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.004206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.004359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.004388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.004547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.004702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.004728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.004863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.004981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.005009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.005133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.005239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.005264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.005401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.005522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.005550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.005701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.005866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.005891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.006048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.006159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.006186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.006315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.006446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.006471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.006590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.006741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.006766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.006880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.006980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.007005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.007138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.007264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.007289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.007395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.007522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.007551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.007694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.007858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.007886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.008002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.008129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.008154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.008264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.008360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.008401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.008570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.008700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.008743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.008845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.008988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.811 [2024-11-26 15:51:14.009016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.811 qpair failed and we were unable to recover it. 00:27:22.811 [2024-11-26 15:51:14.009121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.009301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.009329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.009451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.009604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.009631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.009761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.009870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.009895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.010040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.010179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.010208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.010324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.010513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.010540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.010695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.010810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.010837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.010970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.011109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.011134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.011271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.011394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.011421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.011542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.011690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.011719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.011834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.011979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.012007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.012131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.012243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.012268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.012403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.012566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.012594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.012713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.012870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.012894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.013003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.013128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.013158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.013311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.013403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.013428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.013588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.013699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.013728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.013848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.013975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.014003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.014121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.014277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.014304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.014454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.014587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.014612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.014739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.014868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.812 [2024-11-26 15:51:14.014893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.812 qpair failed and we were unable to recover it. 00:27:22.812 [2024-11-26 15:51:14.015026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.015167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.015194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.015339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.015485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.015513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.015664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.015778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.015805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.015976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.016120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.016147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.016295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.016417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.016444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.016605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.016749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.016777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.016933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.017067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.017091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.017224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.017335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.017362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.017479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.017595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.017622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.017745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.017889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.017917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.018093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.018189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.018214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.018363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.018463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.018489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.018625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.018737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.018766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.018904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.019047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.019074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.019232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.019331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.019355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.019480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.019604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.019632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.019781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.019906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.019934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.020073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.020221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.020246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.020342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.020467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.020491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.813 [2024-11-26 15:51:14.020653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.020778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.813 [2024-11-26 15:51:14.020806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.813 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.020948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.021095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.021120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.021257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.021362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.021405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.021571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.021743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.021769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.021873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.021989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.022016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.022160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.022280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.022307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.022452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.022604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.022632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.022770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.022872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.022897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.023064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.023249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.023273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.023403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.023529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.023555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.023670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.023796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.023824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.023957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.024065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.024090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.024243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.024363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.024391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.024539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.024690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.024718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.024874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.024979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.025004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.025109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.025211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.025235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.025365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.025486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.025515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.025641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.025763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.025789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.025915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.026025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.026053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.026207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.026342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.026367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.814 [2024-11-26 15:51:14.026536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.026638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.814 [2024-11-26 15:51:14.026663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.814 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.026800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.026975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.027000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.027106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.027227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.027256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.027418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.027576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.027601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.027737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.027849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.027874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.028026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.028180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.028205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.028331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.028444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.028472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.028657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.028818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.028843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.028958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.029087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.029112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.029228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.029402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.029430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.029540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.029684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.029719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.029844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.029950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.029975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.030076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.030217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.030241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.030360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.030507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.030535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.030717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.030821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.030846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.030957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.031066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.031090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.031229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.031385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.031410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.031520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.031644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.031694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.031817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.031928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.031955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.032074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.032208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.032233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.815 [2024-11-26 15:51:14.032357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.032480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.815 [2024-11-26 15:51:14.032507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.815 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.032645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.032770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.032799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.032943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.033068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.033095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.033221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.033334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.033359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.033467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.033566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.033591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.033752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.033882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.033910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.034055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.034173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.034201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.034349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.034450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.034476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.034597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.034738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.034767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.034922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.035037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.035064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.035209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.035332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.035360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.035485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.035620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.035645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.035778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.035909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.035934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.036056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.036171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.036199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.036344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.036468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.036495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.036625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.036730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.036755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.036885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.037021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.037049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.816 [2024-11-26 15:51:14.037191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.037371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.816 [2024-11-26 15:51:14.037403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.816 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.037521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.037681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.037730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.037835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.037942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.037966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.038120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.038271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.038299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.038412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.038546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.038574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.038720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.038859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.038883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.038994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.039125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.039149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.039263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.039389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.039417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.039601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.039721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.039763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.039894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.040008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.040035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.040165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.040294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.040325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.040445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.040584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.040611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.040749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.040901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.040927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.041035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.041130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.041155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.041263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.041397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.041422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.041574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.041692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.041720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.041872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.041990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.042019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.042162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.042286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.042314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.042435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.042540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.042564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.042670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.042796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.042824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.042970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.043104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.043132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.043248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.043375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.043403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.817 qpair failed and we were unable to recover it. 00:27:22.817 [2024-11-26 15:51:14.043583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.043708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.817 [2024-11-26 15:51:14.043734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.043862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.044048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.044072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.044173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.044276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.044301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.044444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.044622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.044647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.044779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.044934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.044976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.045130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.045262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.045287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.045432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.045580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.045605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.045718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.045825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.045851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.045975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.046118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.046143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.046281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.046438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.046462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.046588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.046716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.046744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.046887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.047015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.047040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.047147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.047244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.047269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.047365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.047461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.047486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.047632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.047805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.047831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.047941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.048089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.048116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.048247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.048403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.048427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.048529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.048632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.048657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.048793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.048914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.048949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.049110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.049237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.049267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.049456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.049589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.049618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.049735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.049925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.049954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.818 qpair failed and we were unable to recover it. 00:27:22.818 [2024-11-26 15:51:14.050089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.818 [2024-11-26 15:51:14.050237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.050272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.050390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.050508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.050536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.050674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.050852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.050884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.051053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.051165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.051196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.051348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.051487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.051516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.051632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.051827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.051858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.051988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.052121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.052150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.052285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.052415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.052448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.052558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.052702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.052738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.052874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.053016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.053045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.053179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.053314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.053341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.053548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.053661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.053699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.053821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.053973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.054006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.054198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.054294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.054320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.054449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.054569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.054599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.054735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.054876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.054903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.055032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.055131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.055175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.055355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.055463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.055499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.055659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.055805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.055834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.056018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.056182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.056208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.056348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.056498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.056527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.056649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.056801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.056830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.819 qpair failed and we were unable to recover it. 00:27:22.819 [2024-11-26 15:51:14.056972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.057077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.819 [2024-11-26 15:51:14.057103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.057254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.057400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.057436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.057580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.057702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.057736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.057915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.058071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.058097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.058260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.058392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.058438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.058629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.058766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.058797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.058939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.059088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.059120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.059284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.059403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.059433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.059625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.059738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.059769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.059905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.060057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.060086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.060213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.060322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.060350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.060507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.060645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.060672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.060817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.060926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.060955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.061143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.061268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.061302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.061464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.061589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.061615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.061731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.061862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.061892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.062010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.062121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.062151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.062291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.062447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.062479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.062667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.062812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.062841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.062982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.063105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.063137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.063294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.063424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.063450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.063567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.063735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.063762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.063899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.064007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.064033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.064164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.064273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.820 [2024-11-26 15:51:14.064299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.820 qpair failed and we were unable to recover it. 00:27:22.820 [2024-11-26 15:51:14.064440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.064546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.064572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.064749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.064916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.064945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.065111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.065262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.065295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.065451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.065641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.065672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.065832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.065932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.065959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.066101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.066261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.066295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.066465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.066569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.066595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.066735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.066851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.066882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.067018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.067183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.067209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.067333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.067505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.067534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.067665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.067824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.067853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.068015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.068134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.068165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.068309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.068451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.068478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.068609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.068758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.068785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.068919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.069071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.069100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.069219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.069374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.069409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.069551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.069667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.069699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.069859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.069982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.070011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.070185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.070312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.070340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.070473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.070653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.070682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.070835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.070942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.070969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.071107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.071231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.071262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.071418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.071577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.071616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.821 qpair failed and we were unable to recover it. 00:27:22.821 [2024-11-26 15:51:14.071776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.821 [2024-11-26 15:51:14.071905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.071938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.072070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.072172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.072199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.072361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.072498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.072526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.072633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.072766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.072793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.072970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.073094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.073129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.073285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.073387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.073414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.073580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.073717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.073765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.073884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.074003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.074032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.074187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.074341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.074370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.074542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.074679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.074717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.074891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.075058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.075087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.075208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.075397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.075430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.075555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.075712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.075750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.075888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.076022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.076052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.076173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.076302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.076330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.076489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.076647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.076676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.076842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.076958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.076987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.077134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.077303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.077346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.077501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.077595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.077621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.077771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.077904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.822 [2024-11-26 15:51:14.077932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.822 qpair failed and we were unable to recover it. 00:27:22.822 [2024-11-26 15:51:14.078090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.078222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.078253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.078383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.078487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.078514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.078656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.078840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.078871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.079006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.079118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.079148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.079353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.079469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.079496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.079626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.079737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.079768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.079928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.080131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.080180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.080304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.080453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.080482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.080602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.080720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.080754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.080922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.081070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.081115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.081292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.081431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.081460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.081573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.081700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.081748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.081889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.081992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.082017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.082151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.082263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.082287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.082471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.082699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.082751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.082916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.083047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.083074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.083203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.083302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.083326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.083434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.083578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.083603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.083755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.083894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.083920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.084024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.084175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.084203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.084391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.084506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.084531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.084695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.084803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.084828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.084942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.085078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.823 [2024-11-26 15:51:14.085103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.823 qpair failed and we were unable to recover it. 00:27:22.823 [2024-11-26 15:51:14.085255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.085388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.085416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.085551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.085692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.085717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.085860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.085995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.086035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.086205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.086342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.086369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.086530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.086693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.086719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.086846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.086975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.087000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.087106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.087237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.087263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.087424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.087579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.087607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.087749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.087877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.087902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.088063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.088191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.088235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.088386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.088498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.088523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.088650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.088784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.088810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.088918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.089133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.089157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.089359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.089485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.089526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.089692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.089833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.089858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.089987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.090139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.090166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.090285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.090422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.090450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.090584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.090697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.090723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.090857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.090989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.091014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.091126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.091234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.091258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.091391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.091500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.091525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.091631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.091741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.091767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.091879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.092012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.092037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.092170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.092323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.092350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.824 qpair failed and we were unable to recover it. 00:27:22.824 [2024-11-26 15:51:14.092545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.092661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.824 [2024-11-26 15:51:14.092694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.092823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.092963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.092987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.093122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.093286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.093328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.093484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.093634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.093662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.093847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.093957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.093983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.094095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.094246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.094274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.094399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.094506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.094531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.094723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.094941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.094966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.095112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.095282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.095310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.095489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.095653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.095677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.095839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.095971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.095995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.096146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.096266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.096293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.096433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.096613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.096638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.096741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.096882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.096908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.097010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.097116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.097140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.097274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.097427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.097454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.097605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.097714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.097742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.097894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.098009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.098034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.098242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.098355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.098379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.098483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.098578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.098602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.098744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.098897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.098922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.099053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.099211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.099235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.099353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.099461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.099485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.099618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.099754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.099784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.099916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.100028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.100052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.825 qpair failed and we were unable to recover it. 00:27:22.825 [2024-11-26 15:51:14.100186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.825 [2024-11-26 15:51:14.100323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.100347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.100481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.100585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.100609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.100723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.100884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.100908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.101045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.101173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.101197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.101334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.101466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.101491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.101626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.101746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.101772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.101901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.102061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.102086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.102191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.102289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.102314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.102476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.102611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.102640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.102781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.102890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.102915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.103030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.103134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.103158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.103269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.103398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.103422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.103559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.103664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.103699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.103834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.103969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.103994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.104151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.104252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.104276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.104379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.104491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.104516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.104644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.104796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.104821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.104957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.105062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.105087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.105221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.105329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.105357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.105461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.105567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.105591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.105702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.105808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.105832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.105971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.106082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.106106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.106207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.106336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.106361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.106469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.106568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.106593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.826 [2024-11-26 15:51:14.106719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.106850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.826 [2024-11-26 15:51:14.106875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.826 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.107011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.107141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.107165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.107295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.107428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.107452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.107558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.107657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.107682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.107854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.107956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.107985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.108114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.108247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.108273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.108382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.108507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.108532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.108636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.108748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.108775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.108887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.108985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.109009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.109118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.109227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.109252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.109352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.109479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.109503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.109640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.109774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.109799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.109947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.110092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.110116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.110248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.110354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.110380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.110511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.110616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.110641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.110816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.110947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.110972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.111080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.111215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.111239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.111348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.111459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.111484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.111618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.111728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.111754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.111878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.112018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.112044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.112157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.112288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.112313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.112430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.112538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.112563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.112725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.112832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.112856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.112965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.113089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.113114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.827 qpair failed and we were unable to recover it. 00:27:22.827 [2024-11-26 15:51:14.113249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.827 [2024-11-26 15:51:14.113355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.113379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.113492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.113627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.113652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.113814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.113951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.113976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.114087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.114242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.114266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.114397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.114538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.114563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.114709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.114818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.114842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.114939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.115091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.115116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.115327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.115436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.115461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.115569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.115670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.115700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.115809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.115946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.115971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.116113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.116251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.116275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.116416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.116625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.116649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.116796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.116903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.116927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.117038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.117170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.117195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.117327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.117455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.117480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.117615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.117726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.117752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.117875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.118085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.118110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.118240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.118373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.118397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.118529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.118657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.118682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.118836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.118946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.118970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.119075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.119179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.119205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.119420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.119537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.119564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.119753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.119882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.119907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.120068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.120174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.120198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.120334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.120468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.120492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.120624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.120725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.120751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.120911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.121041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.121065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.121184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.121340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.121365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.121500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.121636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.121660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.121779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.121880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.121905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.122041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.122180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.122205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.122319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.122477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.122502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.122626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.122742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.122767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.122929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.123084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.123108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.123243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.123354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.123380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.828 [2024-11-26 15:51:14.123489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.123631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.828 [2024-11-26 15:51:14.123655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.828 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.123768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.123923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.123947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.124085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.124296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.124320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.124450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.124607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.124631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.124766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.124896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.124921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.125052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.125158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.125182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.125307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.125440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.125466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.125626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.125799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.125825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.125940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.126044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.126071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.126176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.126306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.126332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.126472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.126588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.126613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.126749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.126879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.126903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.127013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.127119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.127145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.127281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.127378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.127403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.127540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.127641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.127665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.127782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.127886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.127913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.128055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.128168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.128194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.128298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.128428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.128453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.128595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.128738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.128764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.128874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.129002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.129026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.129175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.129280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.129306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.129442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.129569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.129594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.129709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.129845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.129871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.129973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.130068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.130093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.130202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.130309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.130333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.130446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.130554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.130579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.130683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.130826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.130851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.130957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.131060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.131084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.131225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.131326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.131351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.131492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.131623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.131648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.131762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.131880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.131905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.132039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.132141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.132166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.132275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.132375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.132401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.132570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.132674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.132709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.132820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.132923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.132949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.133054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.133164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.133189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.829 qpair failed and we were unable to recover it. 00:27:22.829 [2024-11-26 15:51:14.133323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.829 [2024-11-26 15:51:14.133433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.133462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.133580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.133682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.133714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.133822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.133925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.133951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.134051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.134152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.134178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.134271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.134376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.134401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.134535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.134654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.134681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.134811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.134914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.134939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.135070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.135174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.135199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.135304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.135408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.135434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.135548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.135692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.135718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.135848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.135954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.135979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.136094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.136226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.136251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.136352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.136453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.136477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.136591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.136749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.136775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.136881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.137020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.137045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.137149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.137283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.137307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.137444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.137555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.137579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.137719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.137826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.137851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.137959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.138068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.138095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.138241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.138413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.138440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.138585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.138722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.138750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.138924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.139059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.139083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.139251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.139358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.139383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.139566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.139740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.139768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.139917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.140089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.140116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.140307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.140462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.140487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.140617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.140758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.140784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.140945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.141071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.141099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.141274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.141446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.141474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.141626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.141780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.141806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.141914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.142025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.142050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.142164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.142306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.142334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.142446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.142563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.142590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.142767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.142913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.142941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.143126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.143283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.143325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.830 qpair failed and we were unable to recover it. 00:27:22.830 [2024-11-26 15:51:14.143495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.830 [2024-11-26 15:51:14.143626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.143651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.143788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.143891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.143915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.144075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.144221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.144248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.144392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.144501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.144526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.144683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.144840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.144864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.144962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.145117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.145145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.145324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.145477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.145504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.145627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.145789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.145815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.145951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.146161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.146218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.146358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.146514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.146538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.146708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.146842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.146867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.147005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.147140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.147181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.147304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.147417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.147445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.147614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.147814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.147870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.148078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.148257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.148303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.148438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.148569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.148594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.148748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.148894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.148923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.149057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.149176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.149203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.149385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.149533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.149560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.149710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.149846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.149870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.149995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.150117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.150146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.150300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.150445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.150472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.150628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.150789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.150816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.150917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.151025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.151050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.151180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.151333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.151357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.151485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.151634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.151663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.151810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x165b600 is same with the state(5) to be set 00:27:22.831 [2024-11-26 15:51:14.152013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.152223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.152251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.152398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.152556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.152582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.152731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.152845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.152870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.153010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.153115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.153140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.153301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.153433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.153457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.831 qpair failed and we were unable to recover it. 00:27:22.831 [2024-11-26 15:51:14.153594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.831 [2024-11-26 15:51:14.153703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.153731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.153892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.154018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.154046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.154164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.154312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.154340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.154464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.154616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.154641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.154784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.154915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.154940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.155116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.155271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.155299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.155445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.155570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.155595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.155762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.155867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.155892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.156039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.156153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.156181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.156302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.156449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.156477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.156662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.156804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.156830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.156941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.157106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.157134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.157282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.157401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.157428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.157546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.157744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.157770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.157884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.158039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.158068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.158191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.158362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.158394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.158601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.158732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.158759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.158886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.159013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.159040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.159191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.159333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.159361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.159499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.159631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.159656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.159820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.159932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.159957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.160142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.160291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.160318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.160526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.160669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.160705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.160829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.160964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.160989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.161127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.161285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.161326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.161520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.161696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.161725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.161876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.162030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.162058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.162207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.162324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.162351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.162474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.162616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.162641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.162807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.162942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.162968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.163164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.163325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.163370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.163538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.163736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.163779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.163915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.164093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.164120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.164262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.164411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.164453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.164657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.164810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.164836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.164973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.165088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.165115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.832 qpair failed and we were unable to recover it. 00:27:22.832 [2024-11-26 15:51:14.165227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.832 [2024-11-26 15:51:14.165395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.165422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.165575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.165709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.165734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.165903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.166061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.166113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.166284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.166428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.166468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.166644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.166785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.166810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.166968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.167132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.167194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.167316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.167484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.167512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.167659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.167761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.167786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.167917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.168079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.168107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.168227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.168381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.168408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.168532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.168694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.168722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.168875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.169002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.169026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.169177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.169291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.169318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.169455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.169575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.169602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.169765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.169891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.169915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.170077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.170235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.170276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.170512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.170647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.170675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.170805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.170909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.170933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.171092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.171251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.171276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.171385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.171512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.171537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.171698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.171878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.171906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.172045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.172235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.172294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.172426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.172595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.172620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.172800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.172931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.172956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.173086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.173270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.173295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.173456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.173598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.173642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.173863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.174025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.174050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.174210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.174352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.174380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.174499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.174636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.174660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.174780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.174940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.174993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.175165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.175271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.175303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.175454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.175579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.175604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.175754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.175898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.175926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.176098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.176239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.176267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.176421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.176553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.176579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.833 qpair failed and we were unable to recover it. 00:27:22.833 [2024-11-26 15:51:14.176762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.176895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.833 [2024-11-26 15:51:14.176921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.177073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.177216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.177243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.177406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.177537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.177561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.177720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.177843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.177871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.177980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.178090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.178118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.178275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.178404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.178429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.178611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.178721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.178750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.178863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.178986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.179013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.179136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.179238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.179264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.179417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.179609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.179635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.179768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.179916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.179943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.180098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.180262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.180286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.180465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.180625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.180649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.180785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.180983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.181008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.181114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.181251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.181276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.181402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.181547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.181572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.181692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.181850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.181878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.182035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.182160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.182185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.182309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.182451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.182479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.182630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.182786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.182812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.182920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.183049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.183075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.183234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.183352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.183379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.183522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.183668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.183705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.183834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.183990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.184015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.184207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.184347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.184371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.184527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.184700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.184729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.184911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.185024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.185049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.185180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.185275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.185300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.185460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.185615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.185642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.185777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.185888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.185912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.186079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.186238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.186267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.186381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.186527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.186555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.186682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.186808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.186833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.186974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.187103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.187128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.187262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.187370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.187395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.187529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.187660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.187692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.834 qpair failed and we were unable to recover it. 00:27:22.834 [2024-11-26 15:51:14.187798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.834 [2024-11-26 15:51:14.187958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.187985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.188102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.188234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.188261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.188446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.188543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.188567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.188705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.188863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.188888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.189049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.189191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.189219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.189336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.189492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.189516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.189702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.189845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.189872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.189983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.190129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.190154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.190322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.190493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.190521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.190670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.190810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.190839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.190961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.191098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.191130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.191284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.191421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.191446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.191583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.191733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.191761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.191909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.192047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.192074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.192191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.192350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.192375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.192511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.192683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.192719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.192892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.193046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.193079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.193245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.193352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.193376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.193522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.193633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.193660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.193818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.193940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.193968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.194118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.194245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.194274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.194373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.194532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.194559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.194733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.194902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.194929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.195077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.195182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.195209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.195362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.195486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.195513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.195661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.195811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.195838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.195972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.196081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.196108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.196374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.196516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.196544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.196680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.196810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.196838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.196994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.197093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.197117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.197226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.197356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.197383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.197522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.197675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.197710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.835 qpair failed and we were unable to recover it. 00:27:22.835 [2024-11-26 15:51:14.197871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.198002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.835 [2024-11-26 15:51:14.198027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.198229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.198351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.198376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.198504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.198610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.198635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.198737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.198864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.198888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.199009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.199158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.199186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.199325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.199465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.199492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.199646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.199793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.199834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.199979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.200112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.200139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.200292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.200431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.200472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.200608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.200713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.200739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.200874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.201014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.201038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.201190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.201331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.201359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.201539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.201671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.201720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.201884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.201982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.202007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.202160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.202344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.202369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.202501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.202604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.202630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.202793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.202928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.202952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.203071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.203219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.203246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.203400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.203530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.203555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.203712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.203858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.203887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.204040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.204186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.204215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.204374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.204497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.204522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.204670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.204813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.204841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.204983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.205130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.205157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.205341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.205448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.205473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.205609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.205758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.205786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.205941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.206098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.206123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.206284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.206415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.206457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.206606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.206717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.206744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.206889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.207044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.207072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.207189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.207316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.207340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:22.836 [2024-11-26 15:51:14.207455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.207600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.836 [2024-11-26 15:51:14.207627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:22.836 qpair failed and we were unable to recover it. 00:27:23.131 [2024-11-26 15:51:14.207755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.207862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.207888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.131 qpair failed and we were unable to recover it. 00:27:23.131 [2024-11-26 15:51:14.208023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.208180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.208204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.131 qpair failed and we were unable to recover it. 00:27:23.131 [2024-11-26 15:51:14.208329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.208476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.208503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.131 qpair failed and we were unable to recover it. 00:27:23.131 [2024-11-26 15:51:14.208648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.208780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.208808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.131 qpair failed and we were unable to recover it. 00:27:23.131 [2024-11-26 15:51:14.208964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.209090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.209115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.131 qpair failed and we were unable to recover it. 00:27:23.131 [2024-11-26 15:51:14.209285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.209415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.209441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.131 qpair failed and we were unable to recover it. 00:27:23.131 [2024-11-26 15:51:14.209630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.209759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.209785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.131 qpair failed and we were unable to recover it. 00:27:23.131 [2024-11-26 15:51:14.209926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.210052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.210081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.131 qpair failed and we were unable to recover it. 00:27:23.131 [2024-11-26 15:51:14.210246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.210400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.210425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.131 qpair failed and we were unable to recover it. 00:27:23.131 [2024-11-26 15:51:14.210532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.210665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.210697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.131 qpair failed and we were unable to recover it. 00:27:23.131 [2024-11-26 15:51:14.210829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.210932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.210957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.131 qpair failed and we were unable to recover it. 00:27:23.131 [2024-11-26 15:51:14.211054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.211185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.211209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.131 qpair failed and we were unable to recover it. 00:27:23.131 [2024-11-26 15:51:14.211326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.211507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.211532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.131 qpair failed and we were unable to recover it. 00:27:23.131 [2024-11-26 15:51:14.211696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.211814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.131 [2024-11-26 15:51:14.211839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.131 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.211966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.212118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.212145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.212294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.212428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.212455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.212612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.212709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.212735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.212860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.213042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.213067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.213180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.213326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.213354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.213510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.213617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.213641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.213752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.213902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.213929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.214052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.214208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.214232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.214338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.214466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.214490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.214614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.214745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.214773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.214914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.215075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.215099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.215255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.215363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.215387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.215520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.215631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.215658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.215807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.215968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.215996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.216158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.216294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.216318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.216442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.216589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.216616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.216735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.216876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.216903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.217039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.217148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.217173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.217337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.217491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.217518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.217642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.217822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.217850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.218007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.218119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.218143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.132 [2024-11-26 15:51:14.218271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.218419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.132 [2024-11-26 15:51:14.218446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.132 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.218598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.218769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.218797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.218964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.219064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.219088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.219235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.219434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.219464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.219633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.219789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.219817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.219982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.220118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.220161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.220364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.220492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.220521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.220700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.220832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.220858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.221014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.221146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.221173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.221415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.221549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.221579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.221772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.221891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.221918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.222060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.222224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.222252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.222430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.222577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.222609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.222796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.222929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.222955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.223071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.223206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.223233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.223356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.223505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.223535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.223683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.223838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.223865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.224047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.224200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.224228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.224393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.224543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.224573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.224679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.224838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.224867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.133 qpair failed and we were unable to recover it. 00:27:23.133 [2024-11-26 15:51:14.224978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.133 [2024-11-26 15:51:14.225121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.225148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.225284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.225461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.225486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.225625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.225771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.225797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.225958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.226077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.226104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.226273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.226447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.226477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.226652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.226786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.226812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.226978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.227087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.227130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.227273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.227448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.227473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.227611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.227791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.227817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.227989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.228150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.228177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.228314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.228478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.228506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.228655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.228823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.228853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.228966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.229080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.229106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.229248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.229398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.229426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.229593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.229733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.229759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.229867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.230001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.230026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.230183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.230295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.230323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.230515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.230621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.230645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.230768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.230905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.230930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.231107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.231245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.231274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.134 qpair failed and we were unable to recover it. 00:27:23.134 [2024-11-26 15:51:14.231432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.231577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.134 [2024-11-26 15:51:14.231603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.231729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.231838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.231862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.232017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.232193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.232241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.232400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.232529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.232558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.232720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.232850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.232892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.233049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.233152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.233180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.233353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.233492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.233516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.233651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.233769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.233794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.233902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.234055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.234082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.234233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.234377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.234402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.234540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.234643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.234667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.234838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.234967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.235008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.235126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.235298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.235325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.235469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.235607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.235634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.235794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.235901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.235926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.236055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.236216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.236243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.236425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.236529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.236554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.236699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.236861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.236889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.237042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.237223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.237248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.237379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.237512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.237537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.237671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.237812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.237837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.237975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.238138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.238165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.238322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.238486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.238527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.238678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.238856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.238880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.135 [2024-11-26 15:51:14.239010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.239124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.135 [2024-11-26 15:51:14.239152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.135 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.239306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.239436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.239460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.239613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.239794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.239824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.239961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.240107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.240135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.240286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.240416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.240440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.240614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.240777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.240807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.240980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.241121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.241149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.241297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.241457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.241498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.241617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.241760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.241789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.241972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.242095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.242119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.242254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.242420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.242445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.242598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.242715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.242744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.242921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.243037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.243064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.243191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.243319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.243344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.243477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.243638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.243663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.243854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.243988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.244013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.244122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.244233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.244258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.244377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.244522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.244549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.244692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.244826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.244851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.244956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.245093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.245118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.245248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.245399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.245427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.245579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.245723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.245751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.245904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.246011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.246037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.246138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.246261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.246286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.246391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.246498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.246523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.136 qpair failed and we were unable to recover it. 00:27:23.136 [2024-11-26 15:51:14.246660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.246804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.136 [2024-11-26 15:51:14.246829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.246940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.247073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.247100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.247246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.247392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.247420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.247566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.247711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.247736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.247894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.248016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.248043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.248195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.248299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.248328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.248461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.248649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.248674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.248848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.248995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.249022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.249200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.249342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.249369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.249504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.249654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.249681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.249850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.250025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.250054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.250204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.250349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.250376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.250497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.250667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.250699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.250889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.251084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.251137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.251252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.251371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.251398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.137 [2024-11-26 15:51:14.251581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.251755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.137 [2024-11-26 15:51:14.251789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.137 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.251911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.252026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.252054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.252206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.252313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.252338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.252496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.252672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.252708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.252836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.252986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.253029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.253160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.253297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.253321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.253430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.253592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.253616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.253779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.253924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.253951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.254084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.254238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.254263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.254367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.254474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.254499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.254648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.254796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.254825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.254983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.255112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.255136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.255265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.255400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.255425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.255603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.255748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.255799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.255928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.256051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.256081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.256262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.256361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.256386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.256592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.256713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.256749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.256889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.257049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.257076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.257207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.257363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.257388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.257542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.257694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.257732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.138 qpair failed and we were unable to recover it. 00:27:23.138 [2024-11-26 15:51:14.257880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.258027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.138 [2024-11-26 15:51:14.258055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.258210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.258340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.258365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.258475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.258623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.258651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.258815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.258953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.258978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.259080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.259210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.259235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.259370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.259492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.259519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.259666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.259815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.259843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.260003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.260113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.260139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.260263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.260436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.260461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.260587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.260737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.260766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.260944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.261070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.261110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.261256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.261408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.261435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.261581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.261708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.261737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.261884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.261985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.262010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.262131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.262338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.262363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.262520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.262632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.262659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.262796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.262929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.262955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.263166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.263343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.263367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.263499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.263654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.263678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.263892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.264081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.264127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.264269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.264441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.264469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.264612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.264749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.264775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.264877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.265008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.265034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.139 qpair failed and we were unable to recover it. 00:27:23.139 [2024-11-26 15:51:14.265219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.139 [2024-11-26 15:51:14.265374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.265401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.265544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.265679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.265714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.265866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.265999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.266024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.266214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.266347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.266371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.266493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.266651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.266678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.266842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.266979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.267003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.267168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.267306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.267333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.267491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.267627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.267652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.267796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.267895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.267924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.268087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.268248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.268273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.268408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.268556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.268583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.268769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.268937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.268965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.269080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.269221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.269248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.269422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.269528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.269555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.269704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.269832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.269857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.270016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.270124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.270151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.270288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.270438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.270465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.270618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.270733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.270758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.270893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.271002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.271026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.271137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.271332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.271359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.271538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.271638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.271664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.271808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.271941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.271966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.272117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.272238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.272263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.272393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.272492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.272517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.272653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.272811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.272839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.273013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.273164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.140 [2024-11-26 15:51:14.273189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.140 qpair failed and we were unable to recover it. 00:27:23.140 [2024-11-26 15:51:14.273316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.273466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.273494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.273661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.273831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.273856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.273989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.274124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.274153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.274291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.274451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.274476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.274603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.274814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.274840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.274942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.275098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.275123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.275281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.275456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.275483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.275654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.275815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.275841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.275986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.276184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.276218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.276428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.276550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.276591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.276736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.276906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.276934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.277082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.277226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.277254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.277410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.277540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.277565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.277722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.277904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.277932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.278049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.278165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.278192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.278320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.278482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.278507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.278652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.278842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.278871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.279010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.279152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.279181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.279339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.279467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.279491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.141 [2024-11-26 15:51:14.279623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.279759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.141 [2024-11-26 15:51:14.279788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.141 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.279937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.280102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.280130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.280285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.280417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.280443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.280596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.280731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.280756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.280921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.281099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.281158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.281317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.281426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.281452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.281582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.281677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.281732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.281890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.282008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.282036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.282180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.282276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.282301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.282451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.282602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.282630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.282786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.282915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.282941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.283113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.283227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.283251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.283352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.283507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.283532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.283681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.283838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.283866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.284028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.284139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.284172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.284366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.284475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.284500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.284675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.284806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.284834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.284951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.285107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.285132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.285295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.285447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.285474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.285596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.285755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.285781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.142 qpair failed and we were unable to recover it. 00:27:23.142 [2024-11-26 15:51:14.285909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.142 [2024-11-26 15:51:14.286011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.286036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.286167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.286295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.286320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.286449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.286577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.286605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.286743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.286875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.286900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.287055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.287195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.287223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.287375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.287502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.287530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.287681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.287827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.287852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.288005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.288111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.288138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.288255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.288407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.288432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.288534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.288668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.288700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.288874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.288986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.289013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.289166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.289267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.289292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.289451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.289552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.289577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.289693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.289788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.289813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.289936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.290085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.290113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.290249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.290379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.290404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.290562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.290671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.290717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.290889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.291007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.143 [2024-11-26 15:51:14.291032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.143 qpair failed and we were unable to recover it. 00:27:23.143 [2024-11-26 15:51:14.291131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.291264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.291289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.291425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.291596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.291622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.291734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.291905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.291932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.292116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.292223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.292249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.292374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.292526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.292567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.292735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.292866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.292891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.293035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.293142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.293167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.293379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.293537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.293571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.293727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.293871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.293901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.294066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.294175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.294201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.294362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.294540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.294568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.294741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.294852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.294882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.295045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.295180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.295209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.295344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.295499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.295527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.295647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.295807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.295833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.295998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.296172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.296203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.296349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.296495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.296525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.296668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.296838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.296863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.296974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.297109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.297133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.297282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.297431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.297459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.297635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.297765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.297791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.297976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.298127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.298154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.298366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.298517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.298544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.298700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.298834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.298859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.144 qpair failed and we were unable to recover it. 00:27:23.144 [2024-11-26 15:51:14.298973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.144 [2024-11-26 15:51:14.299134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.299158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.299368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.299586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.299613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.299759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.299904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.299932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.300087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.300229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.300254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.300385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.300497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.300524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.300677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.300828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.300853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.300958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.301096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.301120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.301254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.301434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.301462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.301582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.301788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.301814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.301954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.302112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.302136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.302291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.302434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.302462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.302602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.302756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.302782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.302914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.303038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.303063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.303191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.303311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.303339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.303519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.303620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.303647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.303813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.303927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.303953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.304112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.304218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.304246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.304359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.304493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.304521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.304709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.304846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.304889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.305009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.305207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.305240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.305430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.305538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.145 [2024-11-26 15:51:14.305565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.145 qpair failed and we were unable to recover it. 00:27:23.145 [2024-11-26 15:51:14.305680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.305814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.305838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.305986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.306100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.306129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.306283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.306419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.306448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.306584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.306715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.306741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.306869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.307015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.307042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.307161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.307306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.307333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.307463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.307619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.307644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.307807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.307920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.307945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.308075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.308235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.308260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.308392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.308525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.308550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.308656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.308772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.308797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.308906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.309090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.309117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.309296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.309450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.309477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.309602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.309791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.309817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.309947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.310134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.310162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.310317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.310443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.310468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.310600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.310705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.310741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.310887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.311044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.311071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.311223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.311321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.311345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.146 [2024-11-26 15:51:14.311499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.311646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.146 [2024-11-26 15:51:14.311673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.146 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.311874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.312067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.312114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.312271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.312399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.312438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.312588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.312728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.312756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.312913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.313113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.313140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.313288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.313447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.313472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.313633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.313791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.313816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.313949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.314097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.314124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.314247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.314356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.314382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.314546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.314700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.314729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.314917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.315019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.315043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.315174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.315269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.315294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.315460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.315618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.315643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.315786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.315922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.315947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.316084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.316179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.316204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.316383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.316531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.316558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.316707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.316886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.316911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.317052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.317153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.317178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.317318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.317461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.317489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.317640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.317809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.317834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.317940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.318104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.318128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.318326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.318489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.318513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.147 qpair failed and we were unable to recover it. 00:27:23.147 [2024-11-26 15:51:14.318660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.147 [2024-11-26 15:51:14.318802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.318827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.318924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.319087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.319112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.319301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.319460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.319485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.319621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.319783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.319809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.319944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.320076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.320101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.320261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.320369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.320396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.320525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.320721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.320746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.320873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.321007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.321031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.321187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.321332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.321359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.321511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.321670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.321713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.321839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.321999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.322023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.322150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.322267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.322291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.322469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.322626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.322673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.322855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.322989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.323032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.323183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.323339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.323364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.323499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.323657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.323695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.323861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.323961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.323986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.324117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.324232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.324260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.324363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.324507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.324535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.324665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.324841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.324866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.325030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.325212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.325239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.325354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.325464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.325491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.325639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.325792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.325818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.325987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.326126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.326153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.326293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.326460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.326485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.326621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.326748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.326773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.326962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.327136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.327163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.148 qpair failed and we were unable to recover it. 00:27:23.148 [2024-11-26 15:51:14.327340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.148 [2024-11-26 15:51:14.327484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.327511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.327661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.327829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.327870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.328027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.328163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.328187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.328360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.328500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.328527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.328682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.328828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.328853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.328950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.329103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.329131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.329304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.329453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.329482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.329629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.329766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.329791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.329923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.330074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.330101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.330258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.330392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.330416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.330548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.330658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.330683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.330886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.330977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.331002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.331140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.331272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.331300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.331420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.331549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.331578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.331747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.331888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.331913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.332065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.332205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.332232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.149 [2024-11-26 15:51:14.332356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.332515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.149 [2024-11-26 15:51:14.332540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.149 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.332710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.332852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.332879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.332982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.333107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.333134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.333258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.333419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.333443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.333599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.333767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.333795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.333951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.334117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.334141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.334275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.334405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.334429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.334568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.334679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.334715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.334908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.335064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.335089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.335237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.335371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.335412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.335555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.335732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.335760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.335873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.335998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.336025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.336185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.336346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.336371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.336530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.336694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.336719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.336818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.336910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.336950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.337083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.337193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.337218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.337375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.337499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.337526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.337709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.337854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.337879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.338019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.338153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.338178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.338332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.338472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.338499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.150 qpair failed and we were unable to recover it. 00:27:23.150 [2024-11-26 15:51:14.338648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.150 [2024-11-26 15:51:14.338807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.338843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.338998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.339134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.339159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.339286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.339456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.339483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.339624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.339746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.339774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.339900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.340032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.340057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.340179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.340324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.340351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.340462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.340607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.340634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.340755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.340892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.340916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.341050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.341236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.341263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.341439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.341584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.341612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.341807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.341942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.341971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.342138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.342239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.342265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.342413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.342558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.342582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.342741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.342920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.342947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.343069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.343213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.343240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.343354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.343497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.343524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.343677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.343802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.343827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.343978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.344123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.344151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.344273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.344444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.344472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.344619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.344723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.344752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.151 qpair failed and we were unable to recover it. 00:27:23.151 [2024-11-26 15:51:14.344904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.345058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.151 [2024-11-26 15:51:14.345083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.345238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.345421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.345446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.345570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.345706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.345732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.345894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.346039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.346068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.346208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.346353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.346380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.346534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.346672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.346703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.346865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.347023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.347050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.347196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.347299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.347326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.347500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.347679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.347713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.347888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.348008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.348037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.348216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.348326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.348353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.348537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.348664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.348694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.348875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.348978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.349002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.349136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.349292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.349319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.349477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.349579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.349604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.349738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.349871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.349896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.350031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.350165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.350190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.350355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.350489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.350534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.350774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.350945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.350973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.351115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.351267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.351291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.351424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.351583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.351624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.351807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.351972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.351997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.352118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.352260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.352287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.352476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.352647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.352674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.352821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.352967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.352994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.353148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.353280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.353305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.152 qpair failed and we were unable to recover it. 00:27:23.152 [2024-11-26 15:51:14.353472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.152 [2024-11-26 15:51:14.353599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.353624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.353821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.353980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.354005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.354189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.354330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.354357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.354500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.354631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.354655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.354769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.354911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.354935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.355113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.355263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.355290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.355470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.355601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.355641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.355817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.355975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.356000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.356173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.356322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.356350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.356506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.356639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.356663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.356828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.356934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.356959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.357058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.357192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.357216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.357349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.357482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.357506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.357663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.357816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.357842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.357989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.358095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.358123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.358279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.358415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.358443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.358604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.358763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.358792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.358969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.359083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.359125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.359295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.359420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.359463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.359608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.359745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.359783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.359960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.360126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.360151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.360284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.360445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.360470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.360634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.360774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.360801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.153 qpair failed and we were unable to recover it. 00:27:23.153 [2024-11-26 15:51:14.360954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.153 [2024-11-26 15:51:14.361101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.361128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.361287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.361421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.361462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.361634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.361808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.361836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.361948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.362056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.362083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.362261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.362401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.362425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.362561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.362739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.362767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.362937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.363075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.363102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.363256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.363398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.363423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.363547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.363691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.363716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.363840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.363975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.364002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.364134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.364266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.364291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.364439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.364555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.364583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.364699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.364847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.364874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.365031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.365163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.365187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.365324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.365455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.365479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.365620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.365735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.365764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.365918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.366055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.366080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.366210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.366365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.366392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.366512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.366665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.366701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.154 [2024-11-26 15:51:14.366881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.367013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.154 [2024-11-26 15:51:14.367038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.154 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.367164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.367270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.367295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.367411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.367564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.367588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.367726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.367840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.367865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.368031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.368126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.368150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.368280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.368377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.368401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.368509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.368615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.368639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.368741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.368853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.368878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.368972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.369102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.369126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.369229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.369339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.369364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.369498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.369654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.369679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.369796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.369932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.369957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.370088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.370221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.370246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.370386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.370518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.370543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.370676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.370796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.370821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.370927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.371038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.371064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.371163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.371297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.155 [2024-11-26 15:51:14.371322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.155 qpair failed and we were unable to recover it. 00:27:23.155 [2024-11-26 15:51:14.371453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.371557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.371581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.371718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.371821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.371847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.371964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.372056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.372080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.372183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.372286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.372311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.372410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.372515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.372540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.372649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.372774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.372799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.372933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.373048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.373073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.373183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.373284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.373313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.373444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.373610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.373634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.373763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.373864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.373889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.374016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.374148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.374175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.374307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.374440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.374464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.374577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.374709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.374734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.374844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.374977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.375002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.375105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.375238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.375264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.375397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.375507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.375531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.375666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.375783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.375808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.375915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.376025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.376050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.376150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.376275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.376299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.376433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.376598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.376622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.376752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.376849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.376874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.376983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.377089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.377113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.377244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.377372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.377396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.377499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.377653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.377677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.377832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.377945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.377969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.378062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.378167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.156 [2024-11-26 15:51:14.378192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.156 qpair failed and we were unable to recover it. 00:27:23.156 [2024-11-26 15:51:14.378291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.378400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.378426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.378540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.378671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.378703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.378819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.378932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.378957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.379057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.379183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.379207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.379315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.379446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.379470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.379581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.379740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.379766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.379927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.380021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.380045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.380147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.380279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.380304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.380415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.380540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.380564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.380673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.380791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.380816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.380912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.381020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.381044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.381213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.381348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.381373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.381494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.381593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.381617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.381754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.381851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.381876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.381991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.382091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.382115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.382289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.382423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.382447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.382554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.382683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.382714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.382815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.382913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.382937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.383083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.383214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.383238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.383366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.383477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.383501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.383636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.383775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.383800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.383911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.384040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.384065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.384189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.384310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.384335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.157 [2024-11-26 15:51:14.384467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.384591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.157 [2024-11-26 15:51:14.384615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.157 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.384754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.384859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.384884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.384996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.385099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.385124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.385231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.385366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.385390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.385561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.385703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.385728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.385829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.385930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.385954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.386056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.386158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.386183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.386311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.386413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.386438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.386566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.386693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.386719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.386815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.386924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.386953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.387065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.387177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.387201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.387306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.387421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.387445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.387580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.387707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.387732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.387839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.387948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.387973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.388103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.388215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.388239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.388347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.388456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.388481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.388615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.388725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.388751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.388855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.388961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.388985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.389093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.389191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.389215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.389330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.389439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.389469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.389626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.389766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.389792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.158 [2024-11-26 15:51:14.389927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.390027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.158 [2024-11-26 15:51:14.390051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.158 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.390204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.390303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.390327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.390437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.390581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.390605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.390716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.390826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.390851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.390992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.391094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.391118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.391224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.391337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.391362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.391463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.391560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.391585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.391719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.391832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.391858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.391971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.392072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.392097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.392212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.392319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.392344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.392484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.392586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.392613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.392719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.392833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.392857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.392993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.393158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.393183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.393322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.393453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.393479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.393578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.393679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.393711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.393836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.393968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.393992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.394095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.394202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.394226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.394363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.394493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.394518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.394682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.394822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.394847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.394990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.395096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.395121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.395229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.395386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.395410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.395516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.395619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.395644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.159 qpair failed and we were unable to recover it. 00:27:23.159 [2024-11-26 15:51:14.395764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.159 [2024-11-26 15:51:14.395877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.395902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.396010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.396110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.396135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.396246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.396378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.396403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.396562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.396665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.396696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.396804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.396899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.396924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.397046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.397172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.397196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.397304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.397467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.397491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.397602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.397732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.397758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.397888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.398024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.398048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.398178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.398320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.398345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.398476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.398568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.398593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.398722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.398830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.398855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.398962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.399067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.399092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.399222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.399316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.399340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.399448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.399557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.399582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.399693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.399827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.399852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.399950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.400061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.400086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.400219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.400324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.400353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.400472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.400576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.400602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.400705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.400831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.400856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.400961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.401120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.401145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.401251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.401385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.401409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.401525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.401633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.401659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.401845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.401960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.401984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.402120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.402233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.402257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.402391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.402492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.402516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.402635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.402775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.402801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.402934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.403034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.403063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.160 qpair failed and we were unable to recover it. 00:27:23.160 [2024-11-26 15:51:14.403196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.160 [2024-11-26 15:51:14.403325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.403350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.403455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.403584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.403609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.403710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.403814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.403838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.403950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.404051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.404075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.404180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.404315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.404340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.404475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.404589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.404613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.404739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.404850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.404875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.404983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.405094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.405118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.405251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.405357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.405382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.405498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.405613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.405640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.405850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.405955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.405980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.406090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.406216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.406241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.406371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.406476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.406501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.406603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.406732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.406757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.406868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.406996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.407020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.407154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.407257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.407282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.407413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.407534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.407559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.407696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.407807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.407831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.407947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.408101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.408125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.408266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.408371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.408396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.408508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.408637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.408662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.408800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.408907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.408932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.409029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.409137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.161 [2024-11-26 15:51:14.409161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.161 qpair failed and we were unable to recover it. 00:27:23.161 [2024-11-26 15:51:14.409260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.409401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.409426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.409532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.409665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.409712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.409842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.409979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.410003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.410163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.410269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.410293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.410428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.410562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.410587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.410696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.410857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.410881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.411013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.411117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.411141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.411274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.411375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.411400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.411534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.411663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.411696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.411807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.411944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.411968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.412075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.412206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.412231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.412334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.412444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.412468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.412606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.412718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.412743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.412870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.413005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.413029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.413156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.413287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.413311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.413414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.413541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.413565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.413667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.413782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.413807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.413917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.414044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.414070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.414166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.414290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.414315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.414448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.414562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.414587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.414697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.414792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.414817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.414969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.415106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.415131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.415236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.415333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.415358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.162 qpair failed and we were unable to recover it. 00:27:23.162 [2024-11-26 15:51:14.415483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.162 [2024-11-26 15:51:14.415627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.415656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.415781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.415887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.415911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.416025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.416129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.416154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.416269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.416430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.416455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.416558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.416716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.416746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.416847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.416956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.416980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.417112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.417210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.417234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.417392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.417528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.417553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.417715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.417817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.417842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.417952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.418072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.418097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.418196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.418356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.418381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.418489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.418590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.418615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.418717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.418825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.418850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.418978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.419078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.419102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.419215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.419327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.419351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.419462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.419594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.419618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.419717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.419814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.419839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.419997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.420123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.420147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.420283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.420418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.420444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.420588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.420719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.420745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.420842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.420974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.420998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.421123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.421254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.421279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.421414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.421524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.421549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.421654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.421768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.421793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.163 qpair failed and we were unable to recover it. 00:27:23.163 [2024-11-26 15:51:14.421897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.163 [2024-11-26 15:51:14.421997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.422021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.422185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.422316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.422342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.422456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.422573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.422598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.422707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.422816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.422841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.422946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.423083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.423107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.423213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.423348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.423372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.423501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.423604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.423628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.423763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.423897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.423922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.424022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.424155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.424181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.424279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.424412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.424436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.424536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.424662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.424693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.424797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.424938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.424963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.425096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.425191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.425216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.425340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.425498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.425523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.425677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.425806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.425832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.425957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.426061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.426086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.426248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.426347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.426372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.426475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.426583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.426607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.426722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.426858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.426882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.427012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.427117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.427142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.427269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.427371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.427396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.427503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.427667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.427698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.427836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.427933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.427958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.428087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.428185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.428211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.428354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.428512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.428537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.428667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.428782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.428807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.428906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.429032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.429057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.429166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.429267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.429291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.164 [2024-11-26 15:51:14.429401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.429502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.164 [2024-11-26 15:51:14.429527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.164 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.429621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.429751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.429777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.429878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.429987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.430012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.430141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.430252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.430281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.430416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.430562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.430586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.430698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.430814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.430838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.430945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.431106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.431130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.431236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.431365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.431390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.431517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.431622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.431647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.431818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.431946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.431970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.432074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.432183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.432209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.432317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.432446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.432472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.432569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.432708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.432734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.432875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.433003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.433028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.433141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.433247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.433272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.433393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.433529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.433554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.433692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.433840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.433864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.433968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.434130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.434154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.434266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.434379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.434405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.434512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.434619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.434644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.434817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.434972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.434997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.435107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.435205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.435230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.435334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.435443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.435470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.435571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.435697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.435723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.435858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.435963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.435988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.436098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.436205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.436230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.436331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.436453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.436478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.436587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.436698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.436724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.436844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.436973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.436997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.437110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.437244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.437269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.165 qpair failed and we were unable to recover it. 00:27:23.165 [2024-11-26 15:51:14.437381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.165 [2024-11-26 15:51:14.437540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.437564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.437709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.437845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.437870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.437981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.438082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.438106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.438212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.438346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.438370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.438488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.438637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.438664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.438802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.438905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.438929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.439050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.439162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.439187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.439312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.439423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.439448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.439603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.439714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.439741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.439873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.439982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.440007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.440136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.440245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.440270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.440380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.440522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.440547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.440652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.440797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.440823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.440959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.441066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.441090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.441236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.441381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.441405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.441539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.441673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.441713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.441819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.441941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.441965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.442072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.442205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.442230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.442344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.442463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.442487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.442621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.442721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.442747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.442885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.443019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.166 [2024-11-26 15:51:14.443043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.166 qpair failed and we were unable to recover it. 00:27:23.166 [2024-11-26 15:51:14.443149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.443251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.443276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.443391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.443528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.443553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.443714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.443861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.443886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.443986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.444088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.444117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.444254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.444361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.444385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.444492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.444603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.444628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.444739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.444897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.444922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.445029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.445158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.445183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.445315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.445449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.445474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.445620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.445727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.445753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.445886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.445995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.446019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.446149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.446243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.446267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.446385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.446514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.446539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.446674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.446793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.446822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.446931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.447037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.447062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.447205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.447340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.447365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.447499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.447601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.447625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.447737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.447843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.447868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.447983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.448110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.448134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.448249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.448350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.448374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.448475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.448640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.448665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.448782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.448886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.448910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.449016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.449108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.449133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.449261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.449354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.449379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.449491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.449621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.449646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.167 qpair failed and we were unable to recover it. 00:27:23.167 [2024-11-26 15:51:14.449768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.449880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.167 [2024-11-26 15:51:14.449905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.450036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.450163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.450187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.450327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.450438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.450463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.450574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.450678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.450712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.450812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.450967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.450991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.451118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.451250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.451275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.451407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.451513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.451538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.451683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.451813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.451839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.451940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.452065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.452089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.452194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.452299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.452323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.452494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.452593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.452618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.452727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.452824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.452849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.452987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.453118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.453143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.453250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.453382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.453406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.453537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.453672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.453705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.453851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.453975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.453999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.454107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.454232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.454257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.454368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.454506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.454530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.454629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.454762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.454787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.454924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.455061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.455086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.455216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.455313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.455338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.455435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.455537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.455562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.455698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.455805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.455830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.455965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.456070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.456095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.456228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.456337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.456362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.456509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.456624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.456651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.456813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.456925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.456949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.457077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.457207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.457231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.457364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.457529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.457553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.457652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.457775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.457801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.457902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.458003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.458028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.458142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.458248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.458272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.168 qpair failed and we were unable to recover it. 00:27:23.168 [2024-11-26 15:51:14.458403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.458513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.168 [2024-11-26 15:51:14.458537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.458700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.458815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.458840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.458970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.459068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.459093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.459224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.459346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.459370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.459471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.459609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.459634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.459765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.459882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.459906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.460011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.460119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.460143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.460248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.460346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.460375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.460538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.460639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.460663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.460804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.460917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.460941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.461074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.461206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.461230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.461360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.461471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.461497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.461641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.461742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.461768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.461905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.462018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.462044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.462175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.462288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.462314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.462426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.462530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.462557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.462693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.462811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.462837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.462932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.463078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.463104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.463222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.463356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.463382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.463489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.463592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.463618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.463794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.463904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.463930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.464055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.464152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.464178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.464289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.464425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.464450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.464562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.464707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.464734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.464871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.465001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.465027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.465150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.465285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.465310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.465443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.465552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.465578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.465716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.465817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.465843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.465979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.466122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.466148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.466311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.466449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.466474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.466607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.466771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.466798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.466940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.467039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.467065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.467192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.467356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.467382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.169 [2024-11-26 15:51:14.467480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.467611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.169 [2024-11-26 15:51:14.467637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.169 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.467737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.467898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.467924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.468046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.468176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.468202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.468314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.468509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.468538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.468658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.468789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.468815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.468969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.469104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.469139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.469279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.469461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.469509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.469622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.469744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.469775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.469921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.470035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.470066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.470195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.470357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.470389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.470532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.470642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.470670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.470811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.470961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.471008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.471198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.471349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.471377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.471535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.471673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.471708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.471867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.472045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.472075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.472258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.472475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.472508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.472639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.472804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.472832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.472966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.473105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.473131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.473335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.473503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.473552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.473706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.473829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.473857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.473995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.474098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.474124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.474292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.474524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.170 [2024-11-26 15:51:14.474575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.170 qpair failed and we were unable to recover it. 00:27:23.170 [2024-11-26 15:51:14.474751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.474887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.474913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.475045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.475212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.475240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.475400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.475532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.475561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.475752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.475869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.475896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.476048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.476159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.476184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.476336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.476457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.476486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.476658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.476780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.476806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.476939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.477063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.477089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.477213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.477386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.477414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.477526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.477701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.477745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.477853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.478001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.478027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.478153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.478298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.478326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.478474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.478601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.478628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.478770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.478900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.478926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.479085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.479221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.479250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.479396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.479518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.479547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.479679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.479824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.479851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.479986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.480099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.480125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.480250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.480365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.480393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.480613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.480801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.480828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.480982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.481158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.481187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.481308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.481431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.481462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.481613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.481741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.481768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.481876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.482023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.482048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.482188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.482293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.482319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.482457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.482622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.482648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.482800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.482961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.482986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.171 [2024-11-26 15:51:14.483103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.483211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.171 [2024-11-26 15:51:14.483237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.171 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.483364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.483510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.483538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.483698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.483832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.483858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.484007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.484163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.484189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.484299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.484431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.484457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.484563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.484697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.484724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.484882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.485035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.485065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.485203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.485332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.485357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.485511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.485673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.485710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.485883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.486066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.486091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.486221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.486369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.486397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.486594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.486735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.486762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.486894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.487057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.487084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.487243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.487373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.487400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.487534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.487647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.487673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.487825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.487982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.488011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.488136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.488277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.488310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.488442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.488582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.488607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.488757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.488876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.488904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.489051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.489222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.489247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.489380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.489515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.489542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.489728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.489859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.489887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.490022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.490166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.490194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.490352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.490479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.490506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.490701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.490833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.490861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.491020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.491144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.491169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.491269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.491432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.491461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.491586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.491740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.491766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.491876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.492052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.492081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.492232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.492339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.492364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.492527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.492671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.492730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.492862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.493014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.493042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.493169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.493330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.493355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.493550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.493660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.493694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.493829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.493938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.493987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.172 qpair failed and we were unable to recover it. 00:27:23.172 [2024-11-26 15:51:14.494127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.172 [2024-11-26 15:51:14.494263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.494289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.494418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.494605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.494638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.494804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.494944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.494970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.495074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.495205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.495231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.495347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.495474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.495499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.495635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.495745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.495770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.495906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.496025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.496051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.496190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.496363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.496391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.496530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.496675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.496730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.496868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.496975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.497002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.497136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.497284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.497311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.497488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.497662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.497701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.497868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.498005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.498030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.498141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.498318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.498345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.498520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.498669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.498703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.498849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.498992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.499034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.499160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.499298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.499325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.499476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.499618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.499647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.499785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.499921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.499947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.500077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.500238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.500263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.500423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.500612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.500641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.500809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.500943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.500979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.501142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.501280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.501308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.501440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.501618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.501647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.501791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.501927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.501952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.502087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.502232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.502259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.502417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.502555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.502580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.502741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.502875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.502902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.503056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.503208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.503237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.503349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.503485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.503512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.503639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.503775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.503800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.503932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.504066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.504096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.504213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.504357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.504387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.504543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.504707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.504733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.173 [2024-11-26 15:51:14.504865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.505031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.173 [2024-11-26 15:51:14.505061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.173 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.505206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.505401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.505430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.505565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.505710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.505736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.505847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.505985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.506010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.506115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.506214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.506239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.506402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.506505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.506531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.506647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.506870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.506897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.507033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.507148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.507175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.507340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.507513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.507541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.507654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.507824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.507850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.508029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.508152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.508182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.508355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.508496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.508539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.508659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.508812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.508840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.508963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.509080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.509110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.509242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.509376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.509401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.509530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.509695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.509722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.509832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.509964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.509989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.510122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.510252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.510278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.510432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.510593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.510643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.510829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.511015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.511044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.511187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.511312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.511338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.511475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.511621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.511648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.511803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.511924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.511957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.512114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.512272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.512315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.512451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.512603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.512632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.512789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.512950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.512992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.513145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.513301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.513344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.513459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.513604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.513632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.513760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.513902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.174 [2024-11-26 15:51:14.513930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.174 qpair failed and we were unable to recover it. 00:27:23.174 [2024-11-26 15:51:14.514114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.514242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.514283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.514441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.514631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.514659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.514819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.514959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.515002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.515159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.515255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.515281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.515417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.515541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.515570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.515737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.515880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.515906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.516014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.516142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.516168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.516304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.516448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.516476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.516634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.516828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.516855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.516964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.517097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.517123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.517276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.517418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.517447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.517560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.517693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.517739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.517842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.517958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.517983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.518093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.518197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.518223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.518326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.518452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.518478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.518607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.518741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.518768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.518915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.519034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.519063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.519202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.519379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.519405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.519547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.519646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.519672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.519881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.520020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.520047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.520202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.520330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.520355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.520512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.520645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.520670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.520840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.520967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.520997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.521149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.521277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.521306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.521455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.521594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.521620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.521749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.521861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.521887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.522020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.522178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.522204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.522329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.522460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.522486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.175 qpair failed and we were unable to recover it. 00:27:23.175 [2024-11-26 15:51:14.522656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.175 [2024-11-26 15:51:14.522800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.522826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.522984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.523139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.523165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.523272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.523380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.523406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.523547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.523656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.523695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.523871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.524005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.524034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.524193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.524327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.524353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.524477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.524605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.524634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.524822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.524932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.524957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.525096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.525203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.525229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.525380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.525521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.525549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.525703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.525834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.525862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.525990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.526150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.526175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.526361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.526531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.526559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.526721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.526894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.526921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.527074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.527199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.527224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.527345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.527460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.527489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.527643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.527782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.527808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.527924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.528084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.528110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.528245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.528381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.528409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.528548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.528668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.528707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.528865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.528977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.529002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.529156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.529284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.529313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.529464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.529640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.529668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.529821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.529956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.529982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.530121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.530276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.530304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.530476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.530634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.530659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.530810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.530932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.530957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.531066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.531218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.531246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.531361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.531514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.531554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.531707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.531876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.531903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.532091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.532227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.532256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.532399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.532522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.532555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.532697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.532837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.532862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.533020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.533185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.533214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.533364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.533502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.533529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.533668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.533786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.533811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.176 qpair failed and we were unable to recover it. 00:27:23.176 [2024-11-26 15:51:14.533994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.176 [2024-11-26 15:51:14.534166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.534194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.534386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.534519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.534544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.534652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.534776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.534804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.534960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.535131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.535159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.535307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.535451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.535479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.535630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.535774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.535805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.535916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.536029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.536054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.536162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.536311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.536339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.536478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.536639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.536665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.536807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.536949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.536976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.537162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.537304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.537333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.537460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.537552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.537578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.537735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.537885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.537914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.538101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.538243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.538284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.538415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.538553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.538578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.538715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.538870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.538902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.539036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.539209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.539238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.539397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.539499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.539524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.539671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.539829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.539857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.540006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.540179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.540207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.540365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.540522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.540565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.540716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.540890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.540918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.541038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.541212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.541236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.541393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.541503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.541529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.541693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.541844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.541872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.542019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.542135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.542168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.542355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.542464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.542489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.542679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.542848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.542877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.543047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.543192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.543220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.543353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.543486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.543512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.543671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.543801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.543830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.544009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.544183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.544211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.544341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.544471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.544496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.544628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.544744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.544773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.544889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.545037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.545064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.545222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.545389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.545415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.545572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.545718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.545747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.545901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.546047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.546074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.546236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.546375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.546412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.546608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.546748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.546774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.546956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.547127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.177 [2024-11-26 15:51:14.547155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.177 qpair failed and we were unable to recover it. 00:27:23.177 [2024-11-26 15:51:14.547282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.547435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.547460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.547593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.547720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.547750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.547902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.548023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.548051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.548234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.548338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.548363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.548469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.548625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.548650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.548831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.548978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.549008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.549142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.549270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.549296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.549458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.549600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.549625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.549805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.549979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.550007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.550159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.550295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.550321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.550509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.550647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.550672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.550871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.551035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.551061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.551171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.551327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.551352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.551487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.551602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.551633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.551805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.551979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.552004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.552136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.552276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.552302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.552462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.552573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.552603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.552732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.552879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.552908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.553067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.553171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.553206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.553370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.553506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.553531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.553695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.553815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.553844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.553985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.554120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.554146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.554298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.554448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.554476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.554631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.554811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.554841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.554966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.555082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.555108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.555248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.555407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.555436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.555580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.555756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.555782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.555927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.556064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.556105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.556233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.556414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.556445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.178 [2024-11-26 15:51:14.556575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.556709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.178 [2024-11-26 15:51:14.556748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.178 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-26 15:51:14.556954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-26 15:51:14.557066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-26 15:51:14.557095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-26 15:51:14.557212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-26 15:51:14.557388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-26 15:51:14.557417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-26 15:51:14.557597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-26 15:51:14.557738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.557765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.557906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.558041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.558068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.558202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.558356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.558390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.558525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.558719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.558747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.558911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.559049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.559101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.559233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.559351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.559380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.559533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.559639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.559667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.559818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.559925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.559952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.560086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.560205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.560234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.560395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.560568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.560597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.560770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.560900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.560926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.561058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.561164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.561191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.561360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.561538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.561572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.561696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.561833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.561865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.562018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.562141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.562172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.562298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.562412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.562451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.562614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.562778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.562808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.562926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.563118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.563152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.563382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.563548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.563577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.563761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.563877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.563908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.564045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.564205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.564235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.564403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.564569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.564600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.564766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.564901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.564931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.565074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.565203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.565237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.565403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.565532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.565561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.565674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.565844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.565873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-26 15:51:14.565996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.566172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-26 15:51:14.566202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.566360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.566518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.566548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.566674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.566795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.566826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.566986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.567131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.567162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.567321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.567483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.567512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.567620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.567770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.567798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.567909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.568038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.568068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.571812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.571944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.571975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.572118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.572236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.572263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.572409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.572553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.572587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.572764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.572878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.572907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.573047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.573178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.573205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.573370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.573489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.573519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.573653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.573768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.573797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.574005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.574167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.574219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.574397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.574592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.574622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.574755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.574854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.574881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.575006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.575137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.575170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.575343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.575501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.575532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.575723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.575869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.575900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.576017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.576129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.576156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.576298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.576447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.576480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.576663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.576834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.576866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.577028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.577165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.577213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.577337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.577497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.577531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.577661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.577798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.577826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.577956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.578115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.578163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.578352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.578502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.578532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.578700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.578857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-26 15:51:14.578885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-26 15:51:14.579024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.579163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.579195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.579361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.579533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.579563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.579725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.579876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.579903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.580036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.580181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.580208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.580370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.580519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.580548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.580680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.580836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.580863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.580978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.581118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.581150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.581317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.581462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.581492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.581616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.581812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.581841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.581974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.582107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.582134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.582296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.582444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.582477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.582628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.582768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.582800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.582926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.583064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.583094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.583274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.583424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.583460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.583619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.583798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.583828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.583955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.584107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.584150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.584297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.584444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.584476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.584624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.584774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.584809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.584965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.585078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.585108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.585281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.585458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.585491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.585608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.585731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.585761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.585924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.586065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.586096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.586220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.586375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.586409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.586558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.586722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.586753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.586894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.587011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.587042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.587160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.587319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.587353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.587471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.587579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.587609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.587755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.587869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.587899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.588101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.588229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-26 15:51:14.588266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-26 15:51:14.588437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.588600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.588627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.588771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.588890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.588917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.589061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.589220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.589250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.589416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.589594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.589625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.589768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.589903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.589950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.590072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.590233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.590267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.590425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.590569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.590598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.590756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.590887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.590930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.591088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.591238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.591268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.591384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.591542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.591570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.591676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.591837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.591873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.592003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.592192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.592222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.592368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.592501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.592531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.592716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.592904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.592935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.593115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.593248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.593280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.593394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.593552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.593583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.593759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.593876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.593907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.594079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.594198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.594229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.594404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.594547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.594581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.594748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.594885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.594916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.595040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.595218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.595249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.595413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.595567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.595599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.595773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.595910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.595940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.596131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.596256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.596293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.596450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.596562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.596591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.596782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.596920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.596981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.597151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.597305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.597336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.597483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.597638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.597668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-26 15:51:14.597877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.598008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-26 15:51:14.598051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.598208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.598399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.598425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.598561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.598739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.598771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.598912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.599051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.599077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.599241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.599353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.599385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.599542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.599717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.599755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.599931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.600036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.600064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.600181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.600292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.600336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.600489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.600614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.600645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.600811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.600947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.600977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.601128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.601328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.601359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.601517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.601628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.601657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.601861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.602002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.602048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.602204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.602344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.602375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.602540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.602732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.602767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.602881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.603030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.603059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.603202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.603317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.603351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.603510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.603663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.603704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.603881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.603985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.604016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.604174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.604294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.604326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.604451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.604628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.604657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.604822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.604963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.604991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.605143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.605280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.605328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.605485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.605645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.605676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.466 qpair failed and we were unable to recover it. 00:27:23.466 [2024-11-26 15:51:14.605850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.466 [2024-11-26 15:51:14.605962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.605990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.606146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.606255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.606285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.606407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.606558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.606593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.606739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.606872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.606899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.607068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.607208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.607248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.607439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.607575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.607606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.607747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.607874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.607904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.608027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.608144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.608175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.608369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.608494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.608524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.608665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 985840 Killed "${NVMF_APP[@]}" "$@" 00:27:23.467 [2024-11-26 15:51:14.608809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.608844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.608971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 15:51:14 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:23.467 [2024-11-26 15:51:14.609100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.609128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 15:51:14 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:23.467 [2024-11-26 15:51:14.609264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 15:51:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:23.467 [2024-11-26 15:51:14.609383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.609413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 15:51:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:23.467 [2024-11-26 15:51:14.609558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 15:51:14 -- common/autotest_common.sh@10 -- # set +x 00:27:23.467 [2024-11-26 15:51:14.609669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.609705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.609844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.609984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.610014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.610132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.610266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.610294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.610435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.610533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.610561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.610702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.610831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.610857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.610972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.611096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.611122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.611285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.611413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.611450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.611613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.611776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.611803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.611911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.612072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.612102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.612215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.612346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.612375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.612492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.612643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.612669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.612813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.612947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.612977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.613116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.613247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.613272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.613428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 15:51:14 -- nvmf/common.sh@469 -- # nvmfpid=986767 00:27:23.467 15:51:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:23.467 [2024-11-26 15:51:14.613592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.613637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 wit 15:51:14 -- nvmf/common.sh@470 -- # waitforlisten 986767 00:27:23.467 h addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-26 15:51:14.613807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 15:51:14 -- common/autotest_common.sh@829 -- # '[' -z 986767 ']' 00:27:23.467 [2024-11-26 15:51:14.613959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-26 15:51:14.613997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 15:51:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:23.468 [2024-11-26 15:51:14.614129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 15:51:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:23.468 [2024-11-26 15:51:14.614312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.614355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 15:51:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:23.468 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.614488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 15:51:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:23.468 [2024-11-26 15:51:14.614638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 15:51:14 -- common/autotest_common.sh@10 -- # set +x 00:27:23.468 [2024-11-26 15:51:14.614666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.614793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.614928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.614953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.615063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.615173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.615198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.615302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.615418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.615443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.615588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.615736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.615763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.615915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.616031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.616055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.616165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.616303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.616327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.616490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.616591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.616617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.616758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.616865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.616891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.617028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.617166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.617190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.617296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.617398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.617423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.617556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.617655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.617680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.617839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.617956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.617981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.618080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.618195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.618219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.618359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.618484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.618509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.618619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.618776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.618802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.618932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.619039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.619065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.619226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.619334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.619359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.619491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.619614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.619639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.619783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.619914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.619939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.620070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.620203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.620229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.620345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.620471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.620496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.620634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.620760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.620786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.620883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.620983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.621009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.621139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.621242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.621267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.621366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.621523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.621548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-26 15:51:14.621659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.621793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-26 15:51:14.621819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.621922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.622046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.622071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.622180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.622307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.622332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.622479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.622652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.622696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.622826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.622939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.622972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.623127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.623298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.623345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.623532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.623680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.623723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.623839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.623998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.624045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.624190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.624336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.624383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.624504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.624636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.624664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.624783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.624906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.624932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.625099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.625265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.625310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.625487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.625618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.625644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.625772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.625898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.625927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.626112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.626261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.626294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.626445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.626556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.626586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.626723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.626845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.626871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.627019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.627152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.627177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.627323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.627436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.627464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.627568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.627682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.627722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.627832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.627948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.627975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.628085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.628211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.628241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.628348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.628491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.628521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.628654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.628803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.628831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.628963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.629065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.629091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.629200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.629342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.629368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.629498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.629598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.629624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.629765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.629907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.629935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-26 15:51:14.630066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.630202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-26 15:51:14.630231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.630375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.630491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.630522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.630634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.630777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.630809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.630952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.631072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.631100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.631236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.631385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.631412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.631527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.631650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.631677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.631819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.631960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.631987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.632125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.632231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.632257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.632408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.632521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.632551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.632714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.632852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.632880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.633003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.633116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.633142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.633265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.633397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.633426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.633567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.633729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.633755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.633875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.634018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.634045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.634156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.634312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.634338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.634479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.634615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.634648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.634769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.634910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.634938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.635075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.635180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.635206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.635307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.635445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.635475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.635616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.635755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.635785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.635922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.636058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.636087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.636232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.636354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.636381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.636534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.636664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.636700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.636824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.636920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.636946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.637052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.637158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.637183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.637294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.637403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.637439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.637548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.637684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.637715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.637827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.637923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.637947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.638084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.638219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-26 15:51:14.638244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-26 15:51:14.638349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.638480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.638505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.638608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.638752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.638777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.638877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.639009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.639033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.639140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.639271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.639294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.639430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.639537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.639563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.639697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.639807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.639831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.639993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.640122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.640151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.640313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.640469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.640494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.640601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.640712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.640739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.640898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.641030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.641054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.641283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.641397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.641420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.641517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.641645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.641669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.641834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.641940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.641966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.642112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.642215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.642241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.642389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.642492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.642517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.642619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.642738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.642764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.642869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.642998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.643027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.643188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.643330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.643353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.643457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.643573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.643597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.643735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.643841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.643864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.643976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.644109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.644135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.644248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.644381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.644404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.644519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.644644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.644667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.644775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.644877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.644901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-26 15:51:14.645019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-26 15:51:14.645119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.645145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.645282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.645413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.645437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.645554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.645693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.645718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.645831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.645937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.645963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.646096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.646205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.646229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.646382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.646489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.646512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.646610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.646722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.646748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.646878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.646982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.647007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.647165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.647261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.647285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.647418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.647526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.647550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.647654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.647763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.647788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.647913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.648043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.648067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.648172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.648299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.648324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.648460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.648567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.648592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.648703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.648809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.648833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.648937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.649044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.649068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.649206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.649358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.649383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.649498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.649631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.649654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.649780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.649894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.649920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.650038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.650140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.650164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.650263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.650387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.650412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.650522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.650656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.650681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.650783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.650882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.650907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.651022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.651154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.651179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.651281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.651439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.651463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.651574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.651681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.651724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.651863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.651990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.652014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.652143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.652268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.652293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.652439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.652538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-26 15:51:14.652562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-26 15:51:14.652701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.652803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.652828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.652922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.653055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.653080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.653214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.653319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.653343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.653449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.653583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.653608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.653774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.653891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.653915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.654016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.654122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.654146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.654274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.654408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.654433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.654540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.654643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.654668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.654798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.654931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.654955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.655093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.655251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.655275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.655380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.655489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.655514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.655645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.655752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.655777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.655910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.656039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.656064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.656173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.656299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.656324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.656461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.656569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.656594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.656705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.656844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.656868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.656999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.657121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.657146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.657248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.657374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.657400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.657511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.657640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.657663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.657774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.657806] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:23.473 [2024-11-26 15:51:14.657888] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:23.473 [2024-11-26 15:51:14.657897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.657921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.658051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.658149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.658173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.658318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.658427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.658452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.658560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.658694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.658718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.658827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.658937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.658961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.659098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.659219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.659243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.659373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.659504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.659528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.659715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.659822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.659848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-26 15:51:14.659977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.660113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-26 15:51:14.660139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.660248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.660378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.660404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.660541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.660678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.660710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.660849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.660978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.661002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.661109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.661263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.661288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.661396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.661527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.661553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.661701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.661809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.661833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.661964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.662129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.662153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.662256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.662388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.662413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.662546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.662653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.662677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.662821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.662953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.662978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.663103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.663231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.663256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.663385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.663531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.663556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.663696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.663830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.663856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.664017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.664147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.664171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.664274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.664407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.664433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.664582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.664717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.664742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.664859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.665016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.665040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.665162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.665297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.665321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.665454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.665617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.665642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.665788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.665896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.665921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.666026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.666168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.666194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.666353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.666482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.666506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.666638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.666742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.666769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.666903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.667010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.667034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.667140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.667299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.667323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.667424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.667530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.667555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.667730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.667858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.667882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.668042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.668170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.668194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-26 15:51:14.668301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-26 15:51:14.668428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.668452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.668567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.668697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.668722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.668883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.669041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.669065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.669221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.669330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.669354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.669461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.669581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.669604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.669769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.669894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.669918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.670027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.670156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.670179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.670316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.670429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.670454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.670577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.670711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.670737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.670878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.671007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.671031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.671191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.671296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.671321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.671453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.671553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.671577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.671709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.671812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.671836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.671938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.672095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.672119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.672227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.672358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.672382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.672519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.672623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.672649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.672777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.672908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.672933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.673098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.673206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.673235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.673395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.673524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.673548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.673679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.673782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.673808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.673966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.674102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.674127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.674231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.674363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.674389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.674535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.674659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.674683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.674804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.674940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.674965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.675099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.675228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.675252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-26 15:51:14.675355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-26 15:51:14.675458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.675482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.675611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.675710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.675735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.675867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.675975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.676003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.676133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.676293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.676316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.676479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.676608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.676632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.676762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.676866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.676892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.677054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.677188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.677213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.677335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.677443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.677467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.677569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.677700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.677726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.677860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.677991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.678016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.678113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.678241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.678266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.678371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.678506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.678531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.678674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.678813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.678844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.679000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.679157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.679181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.679317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.679452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.679476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.679639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.679770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.679797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.679961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.680118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.680142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.680254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.680356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.680382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.680500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.680656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.680680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.680868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.680999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.681024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.681131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.681231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.681255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.681364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.681496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.681520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.681618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.681752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.681782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.681910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.682015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.682041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.682152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.682291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.682315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.682453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.682581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.682608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.682746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.682878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.682903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.683035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.683135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.683160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.683320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.683453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-26 15:51:14.683476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-26 15:51:14.683631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.683762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.683787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.683896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.684025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.684049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.684182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.684333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.684358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.684464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.684621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.684645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.684786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.684916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.684941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.685046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.685181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.685206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.685342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.685476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.685501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.685636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.685766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.685791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.685948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.686045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.686072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.686200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.686360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.686385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.686496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.686631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.686655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.686760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.686892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.686916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.687056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.687193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.687217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.687361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.687459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.687484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.687622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.687732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.687758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.687902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.688039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.688063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.688170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.688299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.688324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.688481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.688589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.688614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.688730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.688859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.688884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.688999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.689099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.689123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.689257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.689388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.689415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.689515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.689626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.689651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.689784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.689920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.689944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.690067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.690202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.690226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.690336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.690465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.690490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.690591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.690733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.690758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.690864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.691023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.691048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.691148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.691281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.691306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-26 15:51:14.691420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-26 15:51:14.691539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.691563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.691669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.691836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.691862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.691993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.692157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.692181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.692318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.692450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.692475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.692585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.692725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.692750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.692852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.692978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.693002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.693116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.693217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.693243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.693367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.693493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.693518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.693657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.693780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.693805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.693914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.694074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.694098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.694235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.694369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.694393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.694497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.694602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.694625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.694746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.694861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.694885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.695050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.695212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.695236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.695371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.695468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.695492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.695632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.695772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.695797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.695935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.696059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.696083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.696187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.696317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.696340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.696447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.696605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.696630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.696762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.696926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.696950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.697088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 EAL: No free 2048 kB hugepages reported on node 1 00:27:23.478 [2024-11-26 15:51:14.697195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.697219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.697355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.697466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.697490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.697595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.697753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.697777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.697889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.698022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.698045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.698177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.698311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.698335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.698467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.698602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.698627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.698764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.698926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.698949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.699055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.699208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.699232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-26 15:51:14.699346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.699475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-26 15:51:14.699499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.699624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.699733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.699758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.699873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.700032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.700055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.700191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.700323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.700346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.700450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.700584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.700609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.700708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.700873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.700898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.701018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.701152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.701177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.701312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.701417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.701443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.701586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.701715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.701740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.701904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.702065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.702088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.702195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.702356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.702380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.702514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.702650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.702674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.702795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.702902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.702926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.703063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.703195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.703219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.703367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.703501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.703527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.703660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.703818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.703844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.703953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.704091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.704116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.704238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.704370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.704394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.704530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.704698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.704723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.704876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.705006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.705030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.705169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.705304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.705328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.705434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.705560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.705584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.705716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.705879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.705904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.706051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.706194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.706219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.706353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.706496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.706520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.706659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.706819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.706844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.706963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.707093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.707117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.707231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.707371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.707397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.707548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.707654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.707679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-26 15:51:14.707859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-26 15:51:14.707993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.708017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.708138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.708251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.708276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.708384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.708517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.708541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.708682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.708829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.708853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.708994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.709129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.709154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.709262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.709384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.709408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.709543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.709699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.709735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.709889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.710022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.710046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.710178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.710308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.710332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.710469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.710577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.710602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.710737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.710847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.710872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.710988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.711124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.711148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.711262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.711394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.711418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.711525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.711665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.711694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.711807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.711949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.711974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.712139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.712235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.712260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.712392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.712531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.712556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.712655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.712774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.712799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.712936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.713066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.713090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.713223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.713385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.713410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.713516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.713655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.713679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.713834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.713931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.713956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.714110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.714240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.714264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.714402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.714512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.714542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.714677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.714830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.714855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-26 15:51:14.714967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.715107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-26 15:51:14.715133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.715242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.715378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.715402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.715504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.715609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.715634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.715742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.715846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.715871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.716006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.716138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.716163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.716299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.716403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.716429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.716564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.716697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.716723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.716859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.716991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.717015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.717151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.717287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.717311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.717418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.717550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.717574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.717705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.717839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.717864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.718001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.718109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.718134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.718273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.718401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.718427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.718556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.718684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.718714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.718855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.718991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.719016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.719180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.719310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.719335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.719503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.719604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.719630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.719775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.719907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.719931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.720033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.720191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.720215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.720349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.720454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.720479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.720614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.720721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.720746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.720865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.721010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.721035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.721149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.721319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.721343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.721503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.721634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.721660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.721822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.721917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.721949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.722086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.722183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.722208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.722319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.722454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.722479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.722602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.722731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.722758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.722913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.723043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-26 15:51:14.723069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-26 15:51:14.723203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.723313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.723338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.723470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.723574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.723599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.723713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.723820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.723844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.723953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.724051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.724075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.724244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.724376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.724401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.724539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.724642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.724671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.724814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.724939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.724964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.725095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.725199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.725225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.725339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.725467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.725493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.725608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.725762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.725788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.725926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.726056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.726080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.726217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.726327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.726351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.726513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.726641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.726666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.726811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.726963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.726991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.727106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.727272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.727297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.727404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.727558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.727589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.727727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.727873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.727899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.728011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.728119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.728144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.728287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.728390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.728415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.728574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.728682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.728716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.728859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.728968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.728993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.729099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.729207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.729231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.729329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.729459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.729484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.729619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.729728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.729753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.729882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.730011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.730036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.730173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.730345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.730369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.730510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.730648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.730676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.730799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.730906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.730931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.731028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.731156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-26 15:51:14.731180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-26 15:51:14.731284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.731391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.731417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.731550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.731683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.731717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.731818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.731946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.731971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.732118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.732255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.732279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.732405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.732528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.732553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.732693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.732744] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:23.483 [2024-11-26 15:51:14.732810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.732834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.732945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.733058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.733083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.733220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.733367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.733392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.733493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.733649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.733674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.733823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.733952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.733977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.734143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.734276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.734302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.734448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.734543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.734567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.734681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.734790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.734815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.734954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.735122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.735147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.735275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.735407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.735432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.735550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.735708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.735733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.735902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.736002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.736027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.736190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.736297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.736321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.736483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.736610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.736634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.736773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.736891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.736916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.737048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.737187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.737212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.737320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.737478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.737503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.737632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.737738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.737764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.737861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.737996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.738021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.738162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.738307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.738332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.738473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.738596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.738620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.738739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.738870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.738894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.739030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.739137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.739161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-26 15:51:14.739300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.739409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-26 15:51:14.739434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.739575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.739719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.739745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.739889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.740014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.740039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.740152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.740250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.740276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.740402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.740550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.740575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.740680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.740828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.740852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.740967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.741069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.741093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.741221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.741331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.741355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.741462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.741597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.741622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.741726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.741858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.741883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.742012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.742146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.742171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.742317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.742435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.742460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.742600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.742701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.742726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.742906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.743035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.743060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.743198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.743329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.743353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.743459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.743595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.743620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.743731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.743840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.743865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.743978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.744143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.744167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.744308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.744438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.744462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.744582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.744683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.744718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.744856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.745042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.745066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.745178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.745292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.745316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.745428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.745570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.745594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.745736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.745865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.745890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.745998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.746124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.746148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-26 15:51:14.746278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.746375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-26 15:51:14.746399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.746538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.746695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.746721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.746873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.746980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.747005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.747137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.747269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.747293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.747427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.747535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.747560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.747673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.747814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.747839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.747989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.748124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.748149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.748262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.748387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.748412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.748552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.748658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.748683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.748836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.748945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.748969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.749113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.749251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.749275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.749439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.749557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.749581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.749708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.749843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.749867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.749971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.750081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.750106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.750243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.750349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.750373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.750489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.750624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.750650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.750783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.750891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.750916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.751061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.751200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.751225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.751338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.751450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.751475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.751583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.751725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.751751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.751852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.751986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.752011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.752123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.752284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.752308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.752424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.752526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.752550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.752657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.752818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.752843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.752975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.753072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.753098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.753235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.753391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.753419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.753586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.753741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.753771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.753891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.754001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.754027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.754191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.754301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.754326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-26 15:51:14.754437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.754543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-26 15:51:14.754569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.754708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.754828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.754854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.754962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.755119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.755144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.755254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.755388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.755412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.755518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.755629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.755656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.755801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.755931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.755956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.756081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.756220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.756247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.756382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.756504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.756531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.756678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.756798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.756825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.756962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.757096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.757121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.757254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.757367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.757394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.757538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.757695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.757721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.757883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.758014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.758040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.758176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.758337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.758363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.758480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.758644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.758668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.758804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.758939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.758964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.759079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.759251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.759277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.759428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.759587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.759612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.759746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.759868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.759894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.760030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.760151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.760175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.760288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.760418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.760444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.760589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.760699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.760731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.760869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.761008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.761034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.761162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.761319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.761345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.761456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.761568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.761593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.761709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.761814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.761841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.761956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.762067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.762094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.762207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.762313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.762339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.762469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.762604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.762629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-26 15:51:14.762768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-26 15:51:14.762905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.762931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.763067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.763186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.763210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.763318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.763478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.763503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.763670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.763786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.763812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.763953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.764117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.764141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.764301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.764430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.764454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.764564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.764701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.764730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.764862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.764982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.765007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.765112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.765246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.765272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.765402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.765507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.765532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.765664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.765774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.765801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.765937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.766042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.766067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.766183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.766297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.766323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.766451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.766589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.766614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.766726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.766859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.766885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.767022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.767156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.767180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.767311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.767471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.767496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.767604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.767710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.767735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.767876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.768008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.768033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.768147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.768282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.768307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.768456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.768559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.768584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.768724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.768838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.768862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.768997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.769105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.769130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.769288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.769449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.769475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.769584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.769683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.769722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.769859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.769993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.770019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.770150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.770285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.770310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.770447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.770552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.770581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-26 15:51:14.770693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.770800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-26 15:51:14.770825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.770960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.771073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.771098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.771237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.771351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.771377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.771485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.771609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.771634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.771743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.771893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.771918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.772085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.772212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.772238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.772375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.772474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.772499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.772659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.772815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.772842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.772947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.773080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.773106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.773271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.773388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.773418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.773566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.773701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.773730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.773841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.774007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.774032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.774169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.774271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.774297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.774429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.774531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.774557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.774663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.774772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.774797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.774934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.775065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.775090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.775206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.775334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.775360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.775500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.775596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.775622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.775764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.775871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.775898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.776035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.776171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.776201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.776368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.776501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.776527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.776632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.776745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.776770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.776909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.777014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.777039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.777213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.777342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.777366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.777533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.777700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.777728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.777846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.777982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.778007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.778146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.778287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.778312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.778414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.778577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.778602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.778744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.778853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.778878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-26 15:51:14.779001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.779139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-26 15:51:14.779169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.779269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.779428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.779454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.779586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.779700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.779727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.779867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.780003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.780029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.780170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.780275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.780300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.780407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.780576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.780602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.780776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.780908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.780934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.781071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.781234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.781261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.781411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.781535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.781559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.781672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.781816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.781843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.781954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.782082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.782108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.782249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.782383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.782409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.782551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.782681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.782734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.782870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.782973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.782998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.783140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.783275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.783299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.783435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.783563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.783588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.783707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.783843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.783870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.784008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.784149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.784176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.784314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.784470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.784495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.784613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.784726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.784751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.784915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.785049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.785074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.785189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.785323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.785348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.785449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.785561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.785586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.785731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.785858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.785883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.786029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.786138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.786164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-26 15:51:14.786270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.786403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-26 15:51:14.786428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.786575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.786709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.786734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.786851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.786954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.786978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.787116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.787277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.787303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.787438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.787573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.787599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.787742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.787859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.787884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.788020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.788120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.788144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.788275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.788405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.788430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.788597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.788712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.788737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.788882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.789039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.789063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.789198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.789336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.789362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.789499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.789632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.789657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.789799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.789958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.789983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.790088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.790200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.790226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.790339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.790471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.790496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.790611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.790757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.790784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.790949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.791078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.791103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.791241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.791375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.791401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.791543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.791652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.791678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.791829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.791936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.791961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.792074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.792185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.792211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.792344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.792457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.792483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.792615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.792730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.792757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.792902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.793038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.793063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.793204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.793309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.793335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.793475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.793585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.793611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.793737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.793899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.793924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.794084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.794225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.794250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.794380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.794506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.794531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-26 15:51:14.794683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-26 15:51:14.794797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.794823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.794962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.795063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.795088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.795253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.795411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.795436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.795568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.795701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.795726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.795853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.795986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.796011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.796126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.796229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.796254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.796389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.796520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.796544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.796663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.796780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.796807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.796966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.797081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.797107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.797276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.797439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.797465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.797628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.797739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.797766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.797906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.798047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.798073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.798240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.798384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.798409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.798541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.798675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.798740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.798906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.799037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.799064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.799182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.799288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.799314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.799461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.799593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.799619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.799745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.799912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.799938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.800078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.800238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.800263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.800382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.800546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.800572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.800683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.800792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.800818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.800926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.801060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.801085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.801208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.801373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.801398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.801513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.801616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.801640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.801797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.801931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.801957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.802118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.802220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.802245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.802380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.802517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.802541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.802720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.802842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.802873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.803049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.803188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-26 15:51:14.803214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-26 15:51:14.803356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.803465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.803492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.803606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.803742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.803768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.803933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.804075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.804101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.804265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.804405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.804430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.804568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.804674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.804705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.804848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.805008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.805033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.805138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.805263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.805288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.805398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.805510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.805535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.805699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.805848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.805873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.806040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.806176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.806201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.806312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.806452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.806478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.806581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.806741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.806766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.806932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.807030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.807055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.807207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.807337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.807362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.807502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.807615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.807640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.807753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.807885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.807910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.808056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.808175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.808200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.808360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.808498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.808523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.808654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.808775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.808801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.808913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.809022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.809047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.809186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.809290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.809315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.809448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.809581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.809607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.809745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.809855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.809882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.810025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.810133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.810158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.810282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.810445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.810469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.810609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.810721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.810749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.810868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.810997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.811022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.811150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.811257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.811282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-26 15:51:14.811417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.811531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-26 15:51:14.811556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.811700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.811809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.811835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.811972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.812139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.812164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.812270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.812427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.812452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.812558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.812695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.812721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.812828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.812963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.812988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.813133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.813243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.813269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.813381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.813543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.813568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.813690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.813790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.813816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.813927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.814061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.814086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.814217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.814332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.814358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.814464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.814594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.814619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.814734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.814842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.814867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.815014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.815156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.815181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.815345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.815480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.815505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.815640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.815771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.815797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.815929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.816061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.816086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.816191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.816326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.816351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.816495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.816627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.816652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.816798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.816900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.816925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.817049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.817178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.817207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.817320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.817426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.817453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.817563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.817697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.817723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.817856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.817969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.817994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.818105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.818268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.818293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.818411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.818551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.818576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.818735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.818860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.818888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.819025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.819201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.819228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-26 15:51:14.819369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.819529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-26 15:51:14.819555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.819699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.819811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.819836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.819940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.820046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.820077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.820214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.820356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.820381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.820522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.820662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.820692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.820801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.820942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.820968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.821089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.821195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.821220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.821358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.821504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.821530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.821672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.821792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.821819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.821950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.822086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.822110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.822224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.822357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.822382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.822544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.822676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.822711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.822847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.822983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.823016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.823157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.823262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.823289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.823426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.823546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.823572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.823707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.823808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.823833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.823949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.824079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.824105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.824213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.824350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.824375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.824484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.824589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.824614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.824747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.824855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.824879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.825038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.825144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.825168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.825311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.825428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.825454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.825600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.825713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.825739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.825863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.825996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.826022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.826131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.826245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.826271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.826437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.826552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.826580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.826696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.826841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.826868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.827030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.827139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-26 15:51:14.827164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-26 15:51:14.827329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.827463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.827487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.827599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.827702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.827728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.827890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.828030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.828055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.828195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.828292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.828317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.828427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.828561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.828587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.828708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.828838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.828864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.828987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.829143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.829169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.829275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.829411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.829437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.829545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.829646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.829672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.829809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.829918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.829945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.830084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.830222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.830248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.830359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.830500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.830526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.830663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.830781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.830806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.830914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.831017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.831042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.831150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.831279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.831304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.831476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.831635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.831660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.831778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.831875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.831900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.832030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.832139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.832164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.832278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.832411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.832436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.832536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.832673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.832706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.832840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.833000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.833026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.833141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.833241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.833266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.833405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.833540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.833565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.833701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.833807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.833833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.833996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.834102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.834128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.834267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.834380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.834407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.834550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.834688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.834715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.834824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.834984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.835009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.835142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.835249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.835275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.835416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.835510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.835535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.835637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.835772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-26 15:51:14.835798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-26 15:51:14.835927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.836063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.836089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.836223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.836330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.836356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.836466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.836566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.836593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.836734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.836867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.836892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.837044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.837156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.837181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.837318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.837447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.837472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.837572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.837726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.837752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.837852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.837962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.837986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.838125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.838254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.838279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.838436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.838598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.838623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.838758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.838895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.838922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.839034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.839169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.839194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.839301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.839445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.839470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.839574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.839703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.839730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.839875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.839987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.840012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.840158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.840288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.840312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.840439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.840535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.840560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.840699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.840830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.840855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.840968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.841101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.841126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.841234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.841378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.841403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.841508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.841607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.841634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.841769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.841903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.841928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.842031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.842144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.842169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.842314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.842473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.842499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.842611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.842774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.842800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.842900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.843035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.843060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.843191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.843294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.843319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.843426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.843559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.843585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.843702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.843840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.843866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.843975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.844074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.844099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-26 15:51:14.844224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.844353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-26 15:51:14.844378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.844486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.844587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.844613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.844747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.844850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.844875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.845037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.845199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.845224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.845395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.845522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.845547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.845681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.845797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.845822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.845990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.846119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.846144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.846254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.846358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.846384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.846521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.846651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.846677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.846794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.846950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.846975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.847084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.847232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.847258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.847390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.847498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.847525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.847628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.847765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.847791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.847925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.848028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.848054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.848195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.848363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.848389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.848496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.848599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.848624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.848728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.848833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.848858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.848975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.849079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.849104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.849204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.849306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.849332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.849473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.849485] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:23.497 [2024-11-26 15:51:14.849585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.849610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 [2024-11-26 15:51:14.849617] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.849642] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:23.497 [2024-11-26 15:51:14.849656] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:23.497 [2024-11-26 15:51:14.849751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.849883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.849909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.849903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:23.497 [2024-11-26 15:51:14.850020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.849955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:23.497 [2024-11-26 15:51:14.850003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:23.497 [2024-11-26 15:51:14.850006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:23.497 [2024-11-26 15:51:14.850141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.850166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.850310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.850410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.850436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.850551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.850656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.850681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.850799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.850917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.850942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.851059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.851171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.851196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.851338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.851495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.851520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.851639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.851746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.851773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.851907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.852015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.852041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.852189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.852294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.852319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.852419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.852529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.852554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.852657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.852809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.497 [2024-11-26 15:51:14.852834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.497 qpair failed and we were unable to recover it. 00:27:23.497 [2024-11-26 15:51:14.852962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.853074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.853102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.853215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.853316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.853341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.853465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.853569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.853594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.853700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.853807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.853833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.853968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.854066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.854091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.854190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.854333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.854358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.854466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.854573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.854600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.854716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.854825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.854851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.854962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.855076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.855103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.855235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.855336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.855361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.855493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.855604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.855630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.855762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.855865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.855890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.856024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.856147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.856173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.856307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.856408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.856433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.856533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.856672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.856705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.856813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.856924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.856951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.857114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.857220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.857246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.857352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.857454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.857480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.857583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.857700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.857735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.857854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.857989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.858015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.858120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.858233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.858260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.858365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.858474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.858499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.858635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.858750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.858779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.858892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.859054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.859079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.859215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.859319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.859344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.859442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.859576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.859602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.859730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.859838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.859862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.859971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.860111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.860136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.860246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.860359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.860384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.498 [2024-11-26 15:51:14.860491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.860596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.498 [2024-11-26 15:51:14.860622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.498 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.860737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.860848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.860874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.860980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.861095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.861120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.861227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.861334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.861358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.861473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.861574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.861599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.861717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.861849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.861874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.862026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.862144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.862169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.862305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.862437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.862462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.862576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.862675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.862708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.862814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.862919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.862943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.863093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.863198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.863223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.863362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.863459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.863489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.863633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.863773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.863799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.863907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.864008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.864032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.864177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.864284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.864309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.864413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.864518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.864542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.864653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.864765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.864790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.864928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.865042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.865067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.865171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.865284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.865309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.865464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.865579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.865603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.865718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.865851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.865875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.865986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.866088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.866118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.866227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.866374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.866400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.866501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.866637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.866662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.866785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.866882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.866906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.867017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.867111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.867135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.867242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.867356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.867381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.867493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.867637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.867662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.867785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.867890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.867916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.868027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.868167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.868192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.868291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.868403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.868427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.868532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.868667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.868704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.868818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.868923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.868948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.499 [2024-11-26 15:51:14.869085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.869196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.499 [2024-11-26 15:51:14.869222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.499 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.869325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.869422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.869446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.869554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.869655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.869681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.869805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.869911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.869938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.870045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.870194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.870218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.870330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.870428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.870453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.870551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.870695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.870722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.870854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.870994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.871021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.871151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.871257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.871286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.871404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.871505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.871530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.871663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.871773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.871798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.871902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.872044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.872069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.872164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.872257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.872283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.872380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.872542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.872568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.872675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.872779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.872804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.872917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.873046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.873072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.873183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.873339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.873364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.873475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.873587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.873612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.873722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.873888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.873914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.874018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.874125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.874150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.874282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.874421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.874446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.874582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.874715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.874740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.874843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.874949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.874974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.875138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.875244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.875269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.875385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.875496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.875521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.875621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.875752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.875778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.875910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.876005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.876029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.876133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.876243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.876270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.876429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.876536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.876560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.876673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.876783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.876808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.876910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.877011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.877035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.877179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.877311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.877335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.877467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.877565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.877590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.877692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.877802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.877828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.500 qpair failed and we were unable to recover it. 00:27:23.500 [2024-11-26 15:51:14.877959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.500 [2024-11-26 15:51:14.878058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.878083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.878189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.878325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.878350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.878466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.878594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.878618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.878728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.878870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.878895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.879001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.879120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.879145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.879285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.879419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.879444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.879548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.879647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.879672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.879802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.879912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.879938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.880059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.880189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.880214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.880317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.880455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.880480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.880592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.880700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.880725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.880858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.880970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.880995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.881107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.881204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.881229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.881360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.881517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.881542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.881668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.881780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.881807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.881941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.882040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.882065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.882168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.882266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.882290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.882394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.882498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.882525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.882635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.882778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.882804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.882914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.883048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.883074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.883173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.883275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.883302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.883424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.883561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.883586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.883696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.883848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.883873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.883979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.884079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.884104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.884209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.884319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.884347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.884455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.884556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.884581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.884721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.884830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.884855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.884970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.885068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.885093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.885205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.885313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.885339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.885451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.885549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.885574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.885699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.885834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.885860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.501 [2024-11-26 15:51:14.886001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.886113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.501 [2024-11-26 15:51:14.886140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.501 qpair failed and we were unable to recover it. 00:27:23.784 [2024-11-26 15:51:14.886275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.784 [2024-11-26 15:51:14.886378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.784 [2024-11-26 15:51:14.886403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.784 qpair failed and we were unable to recover it. 00:27:23.784 [2024-11-26 15:51:14.886506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.784 [2024-11-26 15:51:14.886606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.784 [2024-11-26 15:51:14.886632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.784 qpair failed and we were unable to recover it. 00:27:23.784 [2024-11-26 15:51:14.886750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.784 [2024-11-26 15:51:14.886859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.784 [2024-11-26 15:51:14.886885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.784 qpair failed and we were unable to recover it. 00:27:23.784 [2024-11-26 15:51:14.887004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.784 [2024-11-26 15:51:14.887112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.784 [2024-11-26 15:51:14.887137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.784 qpair failed and we were unable to recover it. 00:27:23.784 [2024-11-26 15:51:14.887270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.784 [2024-11-26 15:51:14.887381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.887408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.887527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.887626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.887651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.887790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.887910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.887935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.888069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.888181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.888205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.888313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.888420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.888445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.888566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.888676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.888707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.888815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.888930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.888955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.889055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.889164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.889191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.889293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.889421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.889447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.889561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.889672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.889710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.889819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.889957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.889982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.890105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.890207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.890231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.890368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.890468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.890494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.890601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.890726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.890754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.890860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.891003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.891028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.891140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.891265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.891290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.891396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.891512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.891538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.891701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.891802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.891827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.891925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.892053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.892078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.892243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.892371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.892402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.892514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.892646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.892672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.892799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.892949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.892974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.893110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.893243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.893268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.893365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.893477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.893502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.893636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.893738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.893763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.893876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.894011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.894036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.894136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.894229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.894253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.894362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.894462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.894487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.785 qpair failed and we were unable to recover it. 00:27:23.785 [2024-11-26 15:51:14.894632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.894774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.785 [2024-11-26 15:51:14.894802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.894917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.895025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.895050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.895168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.895294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.895318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.895449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.895552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.895577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.895680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.895800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.895827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.895931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.896035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.896060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.896201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.896299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.896324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.896421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.896551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.896576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.896719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.896835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.896860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.896962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.897119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.897145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.897256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.897350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.897374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.897477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.897635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.897660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.897818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.897914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.897938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.898050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.898148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.898173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.898271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.898393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.898417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.898522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.898623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.898647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.898771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.898875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.898900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.899069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.899177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.899202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.899308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.899412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.899436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.899578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.899698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.899724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.899825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.899957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.899982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.900087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.900198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.900223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.900359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.900488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.900513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.900613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.900738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.900764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.900902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.901083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.901108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.901219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.901322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.901348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.901487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.901598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.901624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.901746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.901856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.901881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.901986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.902137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.786 [2024-11-26 15:51:14.902163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.786 qpair failed and we were unable to recover it. 00:27:23.786 [2024-11-26 15:51:14.902269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.902400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.902427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.902589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.902711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.902742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.902845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.902958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.902983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.903112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.903217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.903242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.903373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.903482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.903508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.903619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.903725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.903750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.903855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.903961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.903988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.904122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.904254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.904279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.904411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.904511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.904536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.904673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.904808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.904832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.904935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.905033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.905059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.905194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.905297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.905322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.905431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.905522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.905551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.905700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.905824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.905849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.905945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.906074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.906098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.906230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.906337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.906361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.906478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.906587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.906612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.906729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.906835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.906860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.906993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.907125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.907151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.907254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.907383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.907408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.907544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.907649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.907674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.907808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.907922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.907947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.908096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.908203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.908232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.908349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.908454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.908479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.908616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.908714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.908747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.908853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.908956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.908981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.909078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.909239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.909263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.909365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.909501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.909525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.787 qpair failed and we were unable to recover it. 00:27:23.787 [2024-11-26 15:51:14.909662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.787 [2024-11-26 15:51:14.909792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.909818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.909936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.910049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.910074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.910174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.910274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.910299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.910444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.910548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.910573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.910677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.910801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.910832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.910940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.911040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.911065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.911166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.911294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.911320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.911428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.911541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.911566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.911703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.911848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.911874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.912032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.912139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.912164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.912287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.912386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.912412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.912555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.912680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.912712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.912848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.912946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.912971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.913104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.913242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.913267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.913377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.913513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.913543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.913674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.913808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.913834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.913994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.914108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.914132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.914245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.914380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.914406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.914519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.914652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.914677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.914801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.914909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.914933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.915065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.915171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.915198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.915304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.915436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.915460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.915572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.915674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.915706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.915852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.915962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.915988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.916097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.916230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.916255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.916391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.916491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.916516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.916677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.916799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.916824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.916932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.917039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.917065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.788 qpair failed and we were unable to recover it. 00:27:23.788 [2024-11-26 15:51:14.917201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.917301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.788 [2024-11-26 15:51:14.917326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.917458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.917641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.917667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.917793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.917937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.917962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.918071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.918186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.918212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.918316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.918415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.918440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.918546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.918669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.918702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.918832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.918961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.918987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.919092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.919251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.919276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.919413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.919510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.919535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.919643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.919837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.919868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.920003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.920100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.920125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.920264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.920369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.920394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.920499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.920606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.920632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.920738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.920834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.920860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.920963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.921065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.921090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.921190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.921297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.921323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.921450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.921548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.921573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.921681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.921831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.921857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.921964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.922068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.922092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.922197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.922330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.922355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.922466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.922577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.922602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.922735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.922844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.922870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.922976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.923073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.923098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.789 qpair failed and we were unable to recover it. 00:27:23.789 [2024-11-26 15:51:14.923205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.923308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.789 [2024-11-26 15:51:14.923332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.923466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.923592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.923618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.923727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.923844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.923869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.924005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.924121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.924146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.924251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.924363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.924388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.924498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.924657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.924682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.924792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.924902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.924927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.925063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.925174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.925200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.925337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.925447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.925472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.925578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.925682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.925721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.925835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.925968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.925993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.926101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.926202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.926227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.926328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.926432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.926459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.926566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.926672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.926744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.926860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.927002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.927028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.927125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.927230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.927256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.927390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.927498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.927524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.927635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.927768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.927795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.927932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.928040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.928066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.928169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.928284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.928311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.928420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.928553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.928578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.928681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.928795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.928820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.928926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.929086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.929111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.929219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.929320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.929345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.929453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.929613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.929638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.929848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.929955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.929981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.930114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.930213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.930238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.930371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.930517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.930542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.930652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.930764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-26 15:51:14.930790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-26 15:51:14.930907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.931041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.931066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.931197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.931296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.931322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.931434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.931529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.931555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.931691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.931831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.931856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.931959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.932055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.932080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.932193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.932322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.932346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.932508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.932609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.932634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.932771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.932875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.932900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.933005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.933105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.933130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.933233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.933358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.933382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.933493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.933596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.933622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.933729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.933828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.933853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.933962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.934091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.934115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.934218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.934330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.934356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.934502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.934610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.934635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.934760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.934893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.934918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.935027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.935138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.935163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.935264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.935369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.935393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.935536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.935645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.935670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.935783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.935917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.935942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.936080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.936184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.936209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.936313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.936412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.936437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.936552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.936655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.936679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.936793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.936958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.936983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.937096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.937229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.937253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.937391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.937505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.937530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.937632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.937738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.937764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.937862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.937974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-26 15:51:14.938000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-26 15:51:14.938133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.938269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.938294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.938428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.938536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.938561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.938665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.938826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.938851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.938961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.939094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.939119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.939250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.939349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.939374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.939481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.939595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.939619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.939748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.939853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.939878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.940016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.940154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.940178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.940310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.940413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.940438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.940574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.940710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.940737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.940841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.940976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.941002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.941109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.941275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.941300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.941410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.941551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.941576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.941680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.941791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.941817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.941921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.942052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.942077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.942207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.942302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.942328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.942439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.942543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.942569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.942728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.942861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.942887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.942989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.943102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.943128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.943232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.943365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.943390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.943519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.943650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.943675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.943784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.943881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.943906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.944036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.944138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.944163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.944263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.944396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.944420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.944527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.944634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.944660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.944792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.944916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.944940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.945072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.945172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.945197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.945313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.945411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.945437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-26 15:51:14.945572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.945670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-26 15:51:14.945704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.945828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.945963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.945988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.946098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.946205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.946229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.946333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.946444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.946470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.946586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.946718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.946743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.946874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.946983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.947008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.947142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.947281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.947305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.947410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.947541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.947566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.947740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.947838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.947863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.947996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.948103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.948133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.948271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.948394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.948419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.948551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.948646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.948671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.948776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.948881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.948906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.949012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.949111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.949135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.949244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.949402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.949427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.949557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.949667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.949700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.949819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.949948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.949973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.950107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.950221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.950246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.950353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.950464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.950490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.950604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.950721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.950752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.950859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.950959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.950984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.951148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.951254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.951280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.951431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.951545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.951569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.951718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.951820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.951844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.951953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.952055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.952081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.952212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.952342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.952367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.952508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.952616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.952642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.952763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.952903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.952929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.953043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.953152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.953178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-26 15:51:14.953285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-26 15:51:14.953415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.953445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.953557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.953664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.953697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.953841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.953949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.953974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.954083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.954192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.954219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.954336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.954470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.954495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.954597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.954740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.954765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.954880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.954984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.955010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.955118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.955223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.955249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.955358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.955489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.955515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.955628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.955764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.955790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.955932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.956070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.956101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.956235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.956348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.956373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.956504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.956601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.956626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.956733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.956863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.956889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.957023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.957130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.957154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.957255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.957351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.957377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.957481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.957610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.957636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.957777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.957876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.957901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.958002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.958130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.958155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.958288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.958394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.958421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.958556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.958660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.958694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.958819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.958919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.958945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.959074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.959210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.959235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.959371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.959529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.959554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.959700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.959813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.959838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-26 15:51:14.960002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-26 15:51:14.960134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.960160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.960268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.960375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.960399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.960510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.960636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.960660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.960822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.960954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.960979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.961143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.961277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.961302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.961420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.961559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.961584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.961698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.961805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.961829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.961934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.962093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.962117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.962223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.962353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.962377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.962507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.962604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.962629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.962746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.962882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.962906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.963017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.963157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.963182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.963291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.963393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.963418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.963523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.963681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.963719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.963831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.963958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.963983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.964086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.964214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.964239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.964357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.964485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.964511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.964620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.964758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.964784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.964914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.965016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.965042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.965150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.965278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.965303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.965412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.965514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.965539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.965667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.965805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.965831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.965967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.966065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.966091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.966203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.966335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.966360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.966464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.966564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.966589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.966722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.966832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.966857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.966967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.967066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.967091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.967202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.967309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.967334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-26 15:51:14.967448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.967585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-26 15:51:14.967611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.967757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.967868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.967893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.968036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.968141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.968166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.968274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.968373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.968398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.968528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.968627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.968652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.968800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.968914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.968940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.969080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.969219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.969246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.969388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.969519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.969545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.969654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.969774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.969801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.969905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.970034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.970060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.970169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.970265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.970291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.970422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.970553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.970578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.970711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.970826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.970852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.970954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.971090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.971115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.971245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.971381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.971406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.971539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.971668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.971701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.971805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.971933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.971959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.972064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.972194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.972220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.972353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.972482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.972507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.972633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.972766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.972792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.972925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.973036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.973061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.973156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.973256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.973282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.973385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.973481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.973506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.973633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.973734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.973761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.973892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.973996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.974022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.974129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.974235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.974259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.974370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.974471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.974497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.974670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.974787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.974813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.974925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.975023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.975049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-26 15:51:14.975149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-26 15:51:14.975247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.975272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.975407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.975534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.975559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.975657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.975807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.975834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.975941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.976079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.976104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.976238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.976343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.976368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.976502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.976614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.976640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.976783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.976887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.976911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.977014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.977115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.977140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.977248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.977346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.977371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.977481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.977579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.977605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.977718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.977815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.977841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.977950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.978079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.978104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.978211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.978341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.978366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.978468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.978572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.978596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.978707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.978812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.978836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.978970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.979079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.979104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.979237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.979336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.979361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.979488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.979619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.979644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.979789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.979897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.979923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.980032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.980139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.980165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.980276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.980388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.980413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.980525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.980629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.980654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.980810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.980911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.980936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.981042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.981152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.981177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.981301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.981460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.981486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.981589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.981699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.981725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-26 15:51:14.981838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.981933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-26 15:51:14.981959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.982100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.982194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.982219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.982330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.982488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.982514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.982623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.982736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.982762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.982866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.982979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.983004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.983137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.983239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.983264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.983370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.983475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.983500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.983641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.983791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.983818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.983920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.984045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.984070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.984177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.984283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.984308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.984443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.984554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.984578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.984716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.984819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.984844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.984950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.985052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.985078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.985184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.985319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.985344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.985448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.985579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.985604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.985703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.985838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.985863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.985996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.986096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.986121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.986259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.986354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.986378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.986475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.986602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.986627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.986737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.986850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.986875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.987004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.987112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.987139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.987266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.987370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.987395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-26 15:51:14.987532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.987644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-26 15:51:14.987669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.987786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.987887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.987917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.988057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.988188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.988213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.988319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.988451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.988476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.988586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.988701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.988727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.988846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.988956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.988980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.989081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.989210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.989235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.989367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.989472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.989498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.989637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.989744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.989769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.989874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.990003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.990028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.990168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.990298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.990322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.990459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.990568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.990598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.990731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.990868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.990893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.991027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.991162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.991188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.991296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.991402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.991428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.991563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.991659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.991684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.991807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.991907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.991932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.992069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.992169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.992197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.992306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.992463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.992489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.992616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.992754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.992780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.992890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.992994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.993019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.993157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.993263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.993292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.993431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.993565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.993590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.993737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.993874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.993900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.994037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.994199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.994225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.994334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.994444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.994469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.994595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.994696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.994721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.994860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.994990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.995015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.995148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.995250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.995275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-26 15:51:14.995380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-26 15:51:14.995518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.995543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.995660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.995771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.995798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.995962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.996070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.996099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.996239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.996369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.996394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.996509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.996616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.996641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.996797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.996906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.996931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.997065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.997165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.997190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.997309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.997410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.997436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.997538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.997644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.997669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.997784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.997877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.997902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.998058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.998164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.998190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.998297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.998393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.998418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.998518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.998612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.998637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.998766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.998901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.998927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.999063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.999164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.999190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.999318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.999443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.999469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.999595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.999701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.999729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:14.999836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.999937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:14.999962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:15.000059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.000153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.000178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:15.000286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.000408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.000433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:15.000563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.000659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.000683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:15.000803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.000911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.000936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:15.001043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.001170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.001196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:15.001305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.001401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.001425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:15.001563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.001667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.001698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:15.001816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.001954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.001981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:15.002094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.002204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.002231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:15.002335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.002453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.002480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-26 15:51:15.002580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.002716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-26 15:51:15.002743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.002883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.002993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.003018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.003124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.003250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.003275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.003382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.003489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.003514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.003638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.003798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.003823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.003924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.004028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.004052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.004189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.004290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.004314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.004440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.004544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.004569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.004708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.004817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.004842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.004977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.005084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.005109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.005242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.005351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.005379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.005484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.005607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.005632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.005764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.005864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.005889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.006022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.006124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.006151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.006255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.006360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.006385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.006537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.006642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.006670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.006788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.006915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.006940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.007072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.007175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.007201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.007305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.007415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.007441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.007546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.007708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.007734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.007836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.007938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.007962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.008063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.008176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.008202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.008334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.008462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.008487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.008595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.008704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.008730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.008845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.008992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.009018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.009127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.009227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.009252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.009364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.009495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.009520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.009629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.009765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.009793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.009908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.010010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.010035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-26 15:51:15.010141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-26 15:51:15.010245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.010271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.010407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.010506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.010531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.010636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.010774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.010799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.010901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.011002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.011029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.011135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.011272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.011299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.011407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.011509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.011534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.011637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.011746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.011773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.011884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.011992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.012017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.012117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.012275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.012301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.012435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.012540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.012565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.012714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.012852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.012878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.013008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.013119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.013145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.013295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.013400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.013425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.013537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.013637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.013663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.013782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.013914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.013939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.014046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.014154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.014179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.014299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.014407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.014433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.014563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.014670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.014701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.014834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.014931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.014957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.015089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.015249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.015274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.015377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.015536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.015562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.015662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.015771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.015796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.015893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.016021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.016046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.016155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.016265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.016291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.016410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.016534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.016559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.016695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.016799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.016824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.016930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.017060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.017085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.017190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.017292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.017316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-26 15:51:15.017424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.017550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-26 15:51:15.017576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.017705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.017813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.017839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.017954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.018082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.018107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.018214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.018311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.018336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.018474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.018571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.018595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.018766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.018877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.018902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.019041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.019145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.019170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.019273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.019382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.019407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.019514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.019623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.019648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.019789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.019897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.019921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.020032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.020166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.020191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.020356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.020490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.020517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.020652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.020758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.020784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.020922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.021029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.021055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.021189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.021353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.021379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.021486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.021617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.021641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.021778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.021886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.021911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.022026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.022127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.022152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.022250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.022355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.022380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.022543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.022680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.022739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.022849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.023010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.023035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.023165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.023293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.023318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.023421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.023524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.023549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.023666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.023773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.023798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.023907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.024015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.024042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-26 15:51:15.024156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.024289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-26 15:51:15.024314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.024447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.024557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.024583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.024699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.024860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.024885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.024991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.025100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.025125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.025238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.025338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.025363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.025464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.025592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.025618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.025754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.025859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.025885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.025982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.026092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.026117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.026225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.026330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.026354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.026462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.026569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.026594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.026725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.026833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.026858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.026964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.027059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.027084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.027192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.027349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.027374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.027481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.027582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.027608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.027745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.027857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.027884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.028017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.028126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.028151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.028263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.028366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.028391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.028500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.028661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.028693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.028800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.028893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.028919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.029020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.029130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.029155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.029271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.029396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.029421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.029554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.029683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.029721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.029852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.029956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.029982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.030087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.030219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.030249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.030351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.030479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.030504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.030638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.030754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.030782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.030882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.031013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.031038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.031202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.031308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.031333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-26 15:51:15.031461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.031573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-26 15:51:15.031598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.031700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.031817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.031842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.031947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.032049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.032074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.032179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.032282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.032307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.032416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.032522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.032548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.032709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.032844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.032873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.032986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.033090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.033116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.033247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.033344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.033370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.033502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.033600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.033625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.033742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.033880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.033907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.034018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.034122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.034147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.034249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.034358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.034385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.034494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.034592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.034618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.034751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.034848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.034873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.035010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.035143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.035169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.035271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.035403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.035433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.035544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.035648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.035673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.035791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.035926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.035952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.036062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.036200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.036226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.036325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.036425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.036451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.036588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.036721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.036748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.036851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.036976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.037001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.037098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.037197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.037224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.037354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.037463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.037488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.037601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.037734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.037762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.037874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.038000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.038030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.038131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.038244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.038269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.038380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.038509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.038535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.038640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.038738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.038764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-26 15:51:15.038871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.038973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-26 15:51:15.038998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.039129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.039259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.039285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.039418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.039571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.039596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.039730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.039833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.039857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.039968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.040065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.040091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.040231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.040331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.040356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.040486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.040587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.040613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.040753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.040889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.040914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.041020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.041122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.041147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.041279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.041389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.041414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.041522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.041682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.041717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.041854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.041965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.041990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.042091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.042194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.042219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.042347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.042448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.042474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.042571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.042710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.042735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.042872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.042986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.043011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.043143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.043272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.043297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.043403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.043533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.043559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.043710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.043849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.043875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.043985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.044089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.044114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.044259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.044393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.044419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.044524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.044626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.044652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.044765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.044868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.044893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.045027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.045137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.045165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.045315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.045447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.045471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.045584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.045715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.045741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.045872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.046009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.046034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.046137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.046252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.046278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.046379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.046509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.046533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-26 15:51:15.046662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-26 15:51:15.046799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.046824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.046939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.047073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.047098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.047240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.047342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.047367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.047505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.047610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.047634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.047770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.047928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.047953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.048055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.048186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.048211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.048315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.048473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.048498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.048606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.048709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.048735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.048848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.048952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.048978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.049087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.049186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.049211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.049310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.049443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.049468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.049575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.049681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.049718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.049831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.049969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.049994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.050137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.050242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.050266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.050397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.050531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.050558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.050705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.050815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.050841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.050971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.051077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.051102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.051215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.051317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.051343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.051477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.051589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.051615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.051732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.051839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.051865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.052006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.052110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.052134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.052232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.052326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.052350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.052462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.052565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.052589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.052720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.052814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.052839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.052969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.053073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.053097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.053197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.053340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.053367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-26 15:51:15.053469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.053595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-26 15:51:15.053620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.053720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.053830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.053855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.053970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.054095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.054120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.054225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.054360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.054385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.054484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.054615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.054640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.054747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.054853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.054877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.054984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.055077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.055103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.055234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.055372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.055397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.055506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.055606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.055630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.055747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.055857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.055883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.056052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.056183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.056208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.056346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.056480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.056505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.056621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.056729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.056754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.056894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.057008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.057033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.057161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.057257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.057282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.057396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.057526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.057551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.057651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.057757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.057784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.057916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.058045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.058071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.058205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.058309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.058335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.058440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.058576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.058602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.058710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.058815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.058841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.058952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.059060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.059085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.059191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.059284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.059308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.059433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.059589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.059615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.059725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.059855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.059881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.059994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.060121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.060146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.060251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.060379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.060405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.060536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.060636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-26 15:51:15.060662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-26 15:51:15.060768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.060863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.060888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.060993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.061131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.061157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.061257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.061366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.061393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.061504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.061663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.061695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.061837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.061968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.061993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.062124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.062219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.062244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.062358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.062488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.062513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.062650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.062779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.062805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.062910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.063014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.063040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.063137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.063275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.063299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.063437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.063574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.063599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.063709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.063851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.063877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.064014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.064116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.064140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.064278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.064416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.064441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.064546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.064646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.064672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.064783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.064894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.064920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.065030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.065132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.065159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.065297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.065424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.065449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.065582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.065714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.065741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.065853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.065985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.066010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.066121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.066221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.066247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.066361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.066497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.066522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.066654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.066757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.066784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.066917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.067022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.067048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.067157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.067265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.067290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.067428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.067525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.067551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.067652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.067815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.067844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.067958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.068123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.068148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-26 15:51:15.068249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.068418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-26 15:51:15.068443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.068555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.068664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.068698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.068808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.068935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.068960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.069066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.069226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.069251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.069358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.069468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.069493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.069631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.069765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.069791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.069893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.069995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.070021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.070152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.070290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.070315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.070416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.070523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.070549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.070681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.070792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.070818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.070917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.071013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.071038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.071153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.071263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.071289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.071389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.071485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.071510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.071649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.071798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.071825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.071986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.072091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.072117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.072221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.072354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.072379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.072489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.072591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.072622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.072734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.072864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.072889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.072992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.073118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.073143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.073272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.073387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.073412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.073518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.073620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.073645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.073763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.073867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.073894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.074024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.074152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.074179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.074290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.074420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.074445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.074553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.074695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.074725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.074833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.074994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.075020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.075119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.075228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.075260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.075395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.075525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.075551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.075654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.075802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.075828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-26 15:51:15.075959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-26 15:51:15.076093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.076119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.076227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.076323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.076349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.076456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.076565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.076592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.076705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.076837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.076863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.076970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.077075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.077102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.077237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.077376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.077402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.077507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.077630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.077655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.077769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.077869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.077899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.077999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.078127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.078153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.078291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.078396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.078422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.078568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.078673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.078709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.078824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.078967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.078993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.079091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.079217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.079242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.079347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.079485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.079510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.079644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.079774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.079799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.079933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.080056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.080081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.080185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.080286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.080311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.080415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.080513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.080548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.080693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.080831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.080857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.080989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.081087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.081112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.081217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.081314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.081339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.081466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.081570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.081596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.081699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.081806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.081832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.081942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.082073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.082100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.082198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.082301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.082327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.082438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.082569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.082594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.082706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.082846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.082873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.083003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.083108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.083135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.083253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.083386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-26 15:51:15.083410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-26 15:51:15.083535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.083639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.083664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.083818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.083919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.083944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.084041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.084136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.084161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.084299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.084397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.084423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.084546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.084650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.084675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.084809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.084913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.084938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.085074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.085205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.085230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.085341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.085449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.085474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.085610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.085716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.085742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.085908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.086027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.086052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.086189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.086294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.086320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.086430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.086523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.086548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.086649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.086772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.086798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.086941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.087044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.087070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.087173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.087282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.087308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.087444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.087547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.087572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.087675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.087800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.087826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.087933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.088028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.088053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.088184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.088291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.088318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.088438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.088536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.088561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.088671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.088817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.088843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.088950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.089054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.089081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.089200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.089304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.089330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.089427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.089556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.089581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.089703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.089810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-26 15:51:15.089835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-26 15:51:15.089973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.090102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.090140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.090252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.090363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.090389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.090491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.090627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.090654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.090801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.090936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.090961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.091101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.091229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.091254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.091352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.091489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.091522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.091632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.091732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.091757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.091859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.091988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.092013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.092151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.092252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.092277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.092376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.092474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.092498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.092627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.092770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.092797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.092937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.093069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.093094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.093201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.093309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.093334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.093439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.093575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.093599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.093741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.093874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.093899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.093997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.094105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.094129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.094245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.094369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.094394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.094498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.094596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.094622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.094772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.094903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.094928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.095061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.095163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.095189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.095331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.095433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.095458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.095589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.095695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.095721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.095819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.095950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.095976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.096112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.096214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.096239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.096343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.096438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.096462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.096565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.096702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.096730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.096865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.096970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.096996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.097140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.097243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.097268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-26 15:51:15.097412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.097545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-26 15:51:15.097573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.097683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.097809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.097834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.097970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.098100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.098127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.098261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.098365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.098391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.098490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.098592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.098618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.098752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.098859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.098886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.099042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.099192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.099221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.099328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.099431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.099457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.099572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.099672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.099708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.099809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.099917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.099942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.100083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.100186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.100213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.100348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.100457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.100482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.100580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.100703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.100729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.100840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.100947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.100972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.101083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.101212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.101237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.101341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.101475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.101502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.101632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.101790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.101820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.101957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.102064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.102090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.102206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.102362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.102387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.102486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.102589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.102614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.102730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.102865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.102890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.102991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.103117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.103141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.103271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.103373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.103398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.103523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.103627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.103654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.103765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.103869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.103895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.104033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.104126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.104151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.104262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.104367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.104392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.104493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.104605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.104629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.104729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.104839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.104865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-26 15:51:15.105000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.105098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-26 15:51:15.105122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.105231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.105324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.105348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.105489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.105623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.105648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.105757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.105862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.105888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.105989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.106098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.106123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.106259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.106358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.106383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.106488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.106620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.106646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.106753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.106861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.106887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.106995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.107094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.107119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.107254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.107394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.107418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.107529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.107664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.107697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.107832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.107936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.107961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.108060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.108187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.108211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.108318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.108418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.108443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.108554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.108657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.108681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.108798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.108894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.108918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.109015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.109119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.109144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.109255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.109359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.109384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.109494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.109596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.109620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.109721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.109835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.109859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.109963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.110124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.110148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.110287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.110383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.110407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.110515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.110611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.110635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.110747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.110851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.110875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.110972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.111098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.111121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.111246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.111349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.111374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.111515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.111636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.111660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.111773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.111876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.111905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.112040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.112137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.112161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-26 15:51:15.112277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-26 15:51:15.112437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.112461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.112563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.112700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.112724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.112824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.112918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.112941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.113069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.113220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.113244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.113347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.113475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.113499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.113628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.113728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.113752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.113856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.113960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.113984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.114081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.114209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.114235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.114393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.114500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.114529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.114672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.114778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.114803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.114913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.115011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.115035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.115142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.115294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.115318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.115424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.115558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.115582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.115691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.115792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.115816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.115916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.116047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.116071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.116170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.116269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.116295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.116394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.116491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.116515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.116621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.116742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.116767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.116896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.117034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.117062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.117168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.117283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.117307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.117418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.117514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.117538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.117651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.117774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.117799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.117896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.118029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.118053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.118159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.118268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.118292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.118428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.118524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.118548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.118642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.118765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.118790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.118896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.119003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.119028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.119128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.119264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.119289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.119390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.119480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-26 15:51:15.119508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-26 15:51:15.119638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.119746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.119771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.119874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.119978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.120003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.120162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.120320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.120346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.120447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.120574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.120600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.120733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.120826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.120850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.120950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.121078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.121103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.121210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.121311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.121335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.121440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.121543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.121567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.121705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.121835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.121858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.121965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.122076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.122099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.122204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.122299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.122323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.122429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.122534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.122558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.122659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.122795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.122820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.122953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.123053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.123079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.123182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.123281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.123306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.123440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.123535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.123560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.123658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.123770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.123795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.123923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.124056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.124082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.124180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.124278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.124303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.124410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.124545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.124569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.124699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.124824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.124849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.124953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.125062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.125086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.125192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.125297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.125322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.125426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.125549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.125574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.125694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.125821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.125845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-26 15:51:15.125949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-26 15:51:15.126052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.126076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.126171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.126307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.126331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.126433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.126541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.126566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.126668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.126781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.126805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.126933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.127028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.127052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.127188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.127282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.127306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.127412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.127568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.127591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.127716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.127844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.127869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.127997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.128088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.128112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.128214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.128318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.128342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.128480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.128585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.128609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.128747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.128881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.128906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.129048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.129186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.129212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.129314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.129448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.129472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.129599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.129702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.129727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.129834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.129938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.129962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.130122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.130222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.130246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.130381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.130483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.130507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.130624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.130722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.130749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.130852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.130956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.130981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.131087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.131182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.131206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.131315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.131443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.131467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.131561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.131662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.131691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.131853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.131963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.131987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.132096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.132192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.132216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.132344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.132474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.132498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.132596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.132701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.132726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.132827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.132952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.132977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.133106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.133197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.818 [2024-11-26 15:51:15.133222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.818 qpair failed and we were unable to recover it. 00:27:23.818 [2024-11-26 15:51:15.133319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.133476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.133500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.133637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.133744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.133769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.133865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.134016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.134040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.134141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.134235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.134260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.134363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.134461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.134484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.134609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.134771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.134796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.134904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.135015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.135040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.135169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.135276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.135299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.135404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.135533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.135557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.135657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.135796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.135822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.135929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.136058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.136082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.136181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.136338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.136362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.136463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.136589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.136612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.136718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.136823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.136847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.136944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.137038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.137062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.137195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.137295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.137320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.137436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.137535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.137559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.137667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.137824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.137849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.137958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.138095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.138119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.138256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.138352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.138375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.138482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.138640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.138663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.138774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.138875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.138899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.139002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.139103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.139127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.139263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.139362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.139387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.139516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.139646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.139669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.139774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.139902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.139926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.140072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.140169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.140193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.140297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.140432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.140456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.819 qpair failed and we were unable to recover it. 00:27:23.819 [2024-11-26 15:51:15.140555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.140717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.819 [2024-11-26 15:51:15.140741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.140876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.140979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.141004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.141129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.141235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.141260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.141372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.141475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.141500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.141635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.141739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.141764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.141902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.142004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.142029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.142142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.142237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.142262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.142394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.142519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.142544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.142640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.142756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.142782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.142912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.143045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.143071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.143174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.143306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.143331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.143438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.143539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.143565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.143677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.143781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.143806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.143933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.144044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.144068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.144170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.144275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.144300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.144408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.144545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.144569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.144670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.144845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.144870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.144980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.145080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.145105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.145236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.145367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.145392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.145495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.145624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.145649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.145817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.145922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.145947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.146042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.146142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.146166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.146261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.146390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.146415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.146552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.146693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.146719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.146859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.146988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.147012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.147142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.147300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.147325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.147459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.147563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.147587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.147703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.147839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.147864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.147973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.148081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.148106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.820 qpair failed and we were unable to recover it. 00:27:23.820 [2024-11-26 15:51:15.148241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.820 [2024-11-26 15:51:15.148367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.148392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.148486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.148583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.148607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.148708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.148808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.148834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.148950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.149079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.149103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.149230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.149335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.149360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.149462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.149560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.149584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.149708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.149838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.149862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.149990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.150114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.150137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.150238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.150370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.150395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.150527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.150630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.150656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.150793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.150901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.150925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.151051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.151156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.151180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.151309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.151400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.151424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.151584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.151676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.151706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.151808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.151941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.151965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.152094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.152226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.152251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.152354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.152488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.152513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.152616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.152753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.152778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.152881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.153008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.153033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.153138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.153238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.153266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.153377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.153482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.153508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.153610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.153744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.153770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.153875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.153976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.154000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.154101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.154236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.154261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.154370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.154471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.154498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.821 qpair failed and we were unable to recover it. 00:27:23.821 [2024-11-26 15:51:15.154635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.821 [2024-11-26 15:51:15.154769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.154794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.154898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.155002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.155027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.155130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.155257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.155281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.155415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.155517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.155541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.155669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.155836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.155865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.156003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.156103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.156127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.156230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.156333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.156357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.156482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.156606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.156630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.156733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.156829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.156853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.156947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.157073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.157097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.157225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.157359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.157385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.157479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.157574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.157598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.157706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.157836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.157860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.157965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.158090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.158113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.158212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.158309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.158340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.158452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.158590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.158614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.158716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.158852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.158877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.158988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.159120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.159145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.159254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.159347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.159371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.159480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.159583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.159610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.159718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.159845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.159870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.159980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.160083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.160107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.160237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.160332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.160357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.160493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.160620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.160645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.160759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.160859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.160888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.161001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.161124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.161149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.161277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.161412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.161436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.161563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.161657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.161682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.161804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.161908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.822 [2024-11-26 15:51:15.161933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.822 qpair failed and we were unable to recover it. 00:27:23.822 [2024-11-26 15:51:15.162060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.162161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.162186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.162322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.162425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.162448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.162563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.162666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.162698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.162806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.162935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.162959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.163062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.163155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.163178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.163277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.163408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.163432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.163575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.163681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.163712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.163840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.163945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.163969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.164065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.164170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.164194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.164291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.164420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.164444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.164550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.164677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.164708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.164816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.164920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.164946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.165045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.165149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.165174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.165309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.165410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.165434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.165565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.165680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.165713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.165855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.165957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.165981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.166094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.166192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.166216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.166348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.166451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.166474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.166577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.166679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.166710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.166817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.166908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.166931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.167064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.167166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.167192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.167303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.167399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.167423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.167537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.167639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.167664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.167777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.167913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.167940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.168073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.168198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.168222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.168327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.168445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.168470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.168572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.168675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.168707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.168824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.168923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.168948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.823 qpair failed and we were unable to recover it. 00:27:23.823 [2024-11-26 15:51:15.169041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.169143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.823 [2024-11-26 15:51:15.169168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.169264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.169392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.169416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.169520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.169629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.169653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.169788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.169895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.169918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.170022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.170150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.170175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.170285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.170417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.170441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.170541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.170643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.170667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.170799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.170898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.170923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.171051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.171210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.171234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.171335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.171468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.171493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.171597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.171706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.171732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.171838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.171941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.171966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.172070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.172171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.172197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.172293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.172385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.172408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.172521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.172627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.172652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.172788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.172886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.172911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.173038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.173138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.173161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.173290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.173383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.173406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.173519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.173655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.173680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.173788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.173918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.173942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.174044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.174150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.174174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.174300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.174410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.174434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.174568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.174672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.174700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.174838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.174967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.174991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.175091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.175247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.175271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.175373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.175480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.175504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.175607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.175733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.175757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.175863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.176019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.176044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.176152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.176251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.176276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.824 qpair failed and we were unable to recover it. 00:27:23.824 [2024-11-26 15:51:15.176402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.824 [2024-11-26 15:51:15.176507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.176532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.176628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.176764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.176790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.176923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.177015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.177039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.177171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.177299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.177324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.177451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.177580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.177605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.177715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.177808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.177833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.177948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.178045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.178069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.178204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.178302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.178327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.178435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.178538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.178562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.178696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.178799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.178826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.178966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.179062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.179087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.179192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.179324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.179348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.179475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.179595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.179619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.179726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.179855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.179880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.179990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.180123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.180149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.180287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.180381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.180406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.180514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.180606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.180630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.180739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.180837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.180861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.180967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.181094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.181117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.181162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x165b600 (9): Bad file descriptor 00:27:23.825 [2024-11-26 15:51:15.181334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.181462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.181493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.181634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.181765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.181792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.181905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.182036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.182061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.182167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.182267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.182293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.182398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.182499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.182524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.182625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.182753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.182779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.182919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.183023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.183048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.183181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.183308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.183333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.183429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.183526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.183551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.825 qpair failed and we were unable to recover it. 00:27:23.825 [2024-11-26 15:51:15.183656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.183789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.825 [2024-11-26 15:51:15.183815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.183927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.184056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.184081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.184187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.184311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.184336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.184501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.184597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.184622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.184726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.184863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.184891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.185033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.185162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.185188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.185288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.185393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.185418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.185525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.185633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.185658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.185802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.185906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.185931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.186063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.186195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.186220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.186317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.186413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.186438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.186540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.186645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.186669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.186792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.186926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.186952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.187088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.187188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.187215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.187327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.187435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.187461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.187561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.187699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.187725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.187856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.188023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.188048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.188176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.188283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.188310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.188407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.188518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.188546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.188692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.188799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.188825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.188954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.189055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.189080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.189186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.189348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.189373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.189485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.189589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.189614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.189728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.189836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.189864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.190027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.190122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.190148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.826 [2024-11-26 15:51:15.190249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.190375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.826 [2024-11-26 15:51:15.190401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.826 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.190508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.190614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.190641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.190773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.190875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.190901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.191012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.191108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.191134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.191296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.191404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.191431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.191533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.191660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.191691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.191842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.191943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.191969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.192078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.192175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.192200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.192310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.192440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.192466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.192569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.192667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.192703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.192845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.192945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.192971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.193080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.193207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.193232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.193331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.193439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.193465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.193602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.193730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.193757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.193860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.193996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.194022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.194159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.194257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.194283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.194390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.194520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.194546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.194652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.194763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.194791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.194925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.195027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.195052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.195159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.195264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.195289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.195389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.195510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.195535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.195642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.195779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.195805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.195908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.196006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.196031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.196169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.196296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.196322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.196451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.196556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.196583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.196719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.196829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.196855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.196988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.197098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.197123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.197255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.197362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.197389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.197521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.197619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.197644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.197795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.197895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.197921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.198036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.198138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.827 [2024-11-26 15:51:15.198166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.827 qpair failed and we were unable to recover it. 00:27:23.827 [2024-11-26 15:51:15.198297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.198412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.198438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.198546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.198645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.198670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.198796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.198939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.198967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.199077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.199231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.199261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.199376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.199482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.199508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.199677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.199795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.199822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.199926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.200030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.200055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.200154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.200287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.200313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.200423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.200559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.200585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.200700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.200839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.200866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.200992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.201126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.201151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.201258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.201355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.201380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.201493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.201587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.201612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.201743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.201875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.201901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.202009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.202113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.202138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.202245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.202382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.202408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.202529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.202699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.202728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.202836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.202946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.202971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.203106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.203206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.203230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.203340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.203446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.203471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.203575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.203694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.203719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.203821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.203957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.203981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.204078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.204204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.204228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.204330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.204429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.204454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.204555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.204653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.204678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.204823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.204930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.204955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.205051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.205151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.205177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.205282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.205383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.205407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.205511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.205605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.205630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.205738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.205841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.205866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.205964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.206121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.206145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.828 qpair failed and we were unable to recover it. 00:27:23.828 [2024-11-26 15:51:15.206249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.828 [2024-11-26 15:51:15.206349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.206374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.829 qpair failed and we were unable to recover it. 00:27:23.829 [2024-11-26 15:51:15.206484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.206595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.206621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.829 qpair failed and we were unable to recover it. 00:27:23.829 [2024-11-26 15:51:15.206732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.206839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.206864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.829 qpair failed and we were unable to recover it. 00:27:23.829 [2024-11-26 15:51:15.206967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.207097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.207125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.829 qpair failed and we were unable to recover it. 00:27:23.829 [2024-11-26 15:51:15.207229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.207359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.207389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.829 qpair failed and we were unable to recover it. 00:27:23.829 [2024-11-26 15:51:15.207495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.207600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.207632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:23.829 qpair failed and we were unable to recover it. 00:27:23.829 [2024-11-26 15:51:15.207742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.207877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.207903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.829 qpair failed and we were unable to recover it. 00:27:23.829 [2024-11-26 15:51:15.208016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.208117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.208143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.829 qpair failed and we were unable to recover it. 00:27:23.829 [2024-11-26 15:51:15.208248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.208390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.208416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.829 qpair failed and we were unable to recover it. 00:27:23.829 [2024-11-26 15:51:15.208550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.208682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.208712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.829 qpair failed and we were unable to recover it. 00:27:23.829 [2024-11-26 15:51:15.208822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.208925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.829 [2024-11-26 15:51:15.208952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:23.829 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-26 15:51:15.209090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-26 15:51:15.209197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-26 15:51:15.209223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-26 15:51:15.209336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-26 15:51:15.209470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-26 15:51:15.209495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-26 15:51:15.209598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-26 15:51:15.209702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-26 15:51:15.209730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-26 15:51:15.209832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-26 15:51:15.209971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.210002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.210134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.210234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.210259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.210360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.210459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.210486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.210591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.210732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.210758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.210856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.210957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.210983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.211097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.211234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.211261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.211401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.211561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.211587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.211695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.211798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.211824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.211939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.212065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.212095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.212211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.212311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.212337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.212479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.212611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.212641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.212756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.212868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.212894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.213001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.213096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.213122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.213220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.213348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.213373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.213479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.213581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.213607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.213747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.213856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.213881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.213986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.214121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.214147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.214282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.214380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.214406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.214508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.214666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.214698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.214811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.214940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.214965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.215072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.215179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.215209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.215338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.215435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.215460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.215564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.215666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.215697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.215829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.215928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.215953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.216053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.216178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.216203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.216304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.216408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.216434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.216538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.216644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.216670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.216785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.216887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.216912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-26 15:51:15.217008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.217137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-26 15:51:15.217162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.217298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.217398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.217423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.217524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.217625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.217650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.217769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.217908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.217934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.218075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.218209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.218234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.218336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.218446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.218472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.218577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.218679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.218713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.218826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.218965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.218991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.219121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.219225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.219250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.219354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.219463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.219490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.219590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.219721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.219748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.219858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.219962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.219987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.220118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.220247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.220272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.220413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.220544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.220569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.220672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.220785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.220811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.220925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.221050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.221075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.221188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.221320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.221345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.221444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.221545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.221570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.221679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.221793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.221819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.221930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.222026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.222051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.222149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.222304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.222329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.222462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.222566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.222591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.222698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.222804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.222828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.222931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.223059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.223083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.223217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.223316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.223341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.223454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.223560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.223586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.223695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.223830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.223855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.223959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.224063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.224090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.224221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.224330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-26 15:51:15.224356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-26 15:51:15.224465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.224568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.224593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.224699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.224833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.224858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.224959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.225052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.225077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.225204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.225340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.225366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.225466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.225597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.225622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.225759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.225864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.225889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.226002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.226107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.226132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.226237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.226369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.226395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.226496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.226653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.226678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.226814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.226926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.226952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.227055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.227162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.227189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.227295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.227430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.227456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.227566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.227701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.227727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.227831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.227938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.227965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.228078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.228209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.228235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.228334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.228462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.228487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.228589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.228715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.228741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.228874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.229012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.229038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.229145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.229247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.229272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.229402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.229536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.229561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.229661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.229805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.229831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.229962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.230096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.230123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.230223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.230318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.230343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.230475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.230579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.230604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.230717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.230823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.230848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.230952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.231052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.231077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.231189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.231284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.231310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.231416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.231513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-26 15:51:15.231538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-26 15:51:15.231669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.231814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.231840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.231972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.232107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.232133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.232229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.232327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.232353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.232463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.232567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.232593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.232699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.232804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.232830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.232940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.233070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.233095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.233211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.233344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.233369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.233497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.233597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.233621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.233722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.233832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.233857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.234014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.234121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.234145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.234248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.234383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.234407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.234509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.234642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.234666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.234774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.234873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.234897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.235028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.235135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.235160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.235293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.235398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.235422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.235527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.235631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.235657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.235783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.235893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.235917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.236018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.236150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.236174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.236306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.236417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.236442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.236540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.236674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.236707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.236839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.236965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.236990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.237101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.237229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.237254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.237358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.237463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.237488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.237617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.237750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.237776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.237907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.238008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.238033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.238171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.238271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.238294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.238396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.238532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.238557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.238695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.238862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.238886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-26 15:51:15.238990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.239096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-26 15:51:15.239120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.239226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.239353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.239378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.239502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.239604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.239629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.239726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.239834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.239858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.239957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.240083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.240107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.240231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.240357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.240381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.240519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.240611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.240635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.240745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.240849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.240873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.240974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.241076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.241101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.241208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.241316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.241340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.241466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.241572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.241596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.241699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.241821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.241846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.241959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.242050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.242074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.242167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.242269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.242292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.242398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.242509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.242533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.242642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.242747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.242772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.242897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.243000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.243025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.243154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.243265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.243290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.243394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.243492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.243516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.243644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.243750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.243776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.243909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.244006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.244030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.244140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.244236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.244260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.244386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.244516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.244541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-26 15:51:15.244639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.244746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-26 15:51:15.244771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.244894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.244992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.245016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.245145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.245276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.245300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.245410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.245512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.245536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.245650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.245755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.245779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.246021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.246120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.246145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.246281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.246381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.246405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.246540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.246677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.246708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.246845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.246942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.246966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.247076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.247183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.247207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.247325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.247452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.247476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.247712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.247872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.247897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.247995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.248093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.248117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.248225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.248323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.248347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.248453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.248583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.248607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.248733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.248867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.248897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.249056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.249186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.249210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.249315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.249424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.249448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.249601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.249706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.249731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.249826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.249929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.249955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.250121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.250221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.250244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.250348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.250449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.250473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.250576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.250672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.250701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.250803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.250897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.250922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.251054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.251188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.251213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.251314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.251413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.251442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.251580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.251700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.251726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.251828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.251968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.251992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.252154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.252251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.252275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-26 15:51:15.252403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-26 15:51:15.252509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.252534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.252643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.252752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.252778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.252876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.252968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.252993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.253100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.253223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.253247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.253378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.253481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.253506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.253606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.253709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.253734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.253836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.253939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.253968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.254106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.254197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.254220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.254322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.254426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.254451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.254583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.254714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.254738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.254847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.254943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.254966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.255097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.255227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.255252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.255352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.255478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.255502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.255605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.255710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.255735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.255833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.255936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.255960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.256067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.256200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.256225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.256327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.256456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.256485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.256581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.256733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.256758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.256860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.256963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.256988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.257103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.257203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.257227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.257358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.257459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.257484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.257592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.257698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.257724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.257853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.257945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.257970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.258075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.258208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.258232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.258331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.258426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.258450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.258606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.258709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.258735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.258981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.259114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.259138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.259272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.259400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.259424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.259525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.259631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-26 15:51:15.259655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-26 15:51:15.259814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.259911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.259936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.260065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.260157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.260182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.260291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.260440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.260465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.260566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.260670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.260701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.260839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.260934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.260958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.261114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.261253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.261278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.261378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.261480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.261504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.261611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.261757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.261782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.261902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.262023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.262046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.262143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.262303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.262328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.262460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.262556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.262579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.262710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.262812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.262837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.262948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.263047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.263070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.263172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.263274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.263299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.263433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.263565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.263590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.263710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.263840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.263865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.263971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.264096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.264121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.264218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.264322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.264348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.264483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.264616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.264642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.264751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.264859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.264884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.265015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.265109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.265134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.265267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.265395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.265420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.265520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.265650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.265674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.265815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.265914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.265939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.266053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.266214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.266238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.266342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.266451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.266477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.266607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.266717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.266743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.266859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.267016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.267041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-26 15:51:15.267147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.267246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-26 15:51:15.267270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.267367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.267463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.267488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.267618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.267725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.267750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.267853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.267982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.268007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.268131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.268256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.268281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.268416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.268522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.268548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.268692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.268790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.268814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.268914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.269041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.269066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.269195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.269295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.269319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.269458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.269562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.269586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.269698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.269797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.269822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.269933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.270034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.270058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.270190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.270285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.270309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.270411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.270510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.270534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.270698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.270805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.270829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.270925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.271029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.271053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.271149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.271253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.271279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.271381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.271536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.271560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.271662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.271802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.271828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.271958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.272072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.272097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.272229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.272330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.272354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.272468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.272598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.272623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.272788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.272892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.272918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.273026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.273171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.273195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.273334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.273458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.273482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.273608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.273733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.273759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.273871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.273969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.273993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.274091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.274265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.274290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.274385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.274483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.274509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-26 15:51:15.274645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.274750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-26 15:51:15.274775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.274938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.275057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.275086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.275201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.275328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.275353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.275466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.275571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.275596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.275709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.275836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.275861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.275976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.276076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.276101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.276209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.276315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.276340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.276436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.276578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.276603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.276753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.276898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.276923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.277037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.277170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.277195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.277323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.277429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.277454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.277558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.277677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.277708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.277807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.277908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.277933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.278041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.278198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.278223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.278352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.278455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.278480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.278610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.278711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.278738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.278837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.278943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.278967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.279076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.279218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.279243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.279371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.279476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.279501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.279637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.279741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.279767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.279912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.280045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.280070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.280199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.280307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.280336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.280483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.280613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.280638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.280767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.280871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.280896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.281001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.281100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.281125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-26 15:51:15.281228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-26 15:51:15.281336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.281361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.281498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.281606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.281630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.281760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.281864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.281889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.282017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.282113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.282139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.282238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.282336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.282361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.282467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.282628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.282653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.282765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.282868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.282897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.283062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.283167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.283191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.283303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.283431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.283456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.283564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.283704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.283730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.283847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.284010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.284034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.284137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.284263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.284288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.284395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.284526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.284551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.284692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.284791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.284816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.284919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.285015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.285040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.285168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.285266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.285291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.285387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.285516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.285541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.285676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.285782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.285807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.285913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.286007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.286031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.286138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.286243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.286268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.286397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.286524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.286549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.286679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.286782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.286807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.286907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.287036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.287061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.287168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.287272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.287297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.287411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.287543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.287567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.287711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.287813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.287838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.287945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.288048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.288073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.288187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.288329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.288354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-26 15:51:15.288489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-26 15:51:15.288621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.288646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.288755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.288883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.288908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.289011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.289165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.289190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.289316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.289412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.289437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.289596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.289695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.289721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.289816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.289951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.289976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.290082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.290208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.290233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.290332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.290424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.290449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.290547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.290678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.290707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.290815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.290920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.290944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.291076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.291177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.291203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.291334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.291428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.291452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.291557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.291655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.291680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.291807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.291916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.291941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.292099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.292204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.292229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.292361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.292494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.292518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.292615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.292723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.292748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.292873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.292969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.292994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.293088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.293216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.293240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.293345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.293451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.293475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.293609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.293715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.293740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.293849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.293956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.293980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.294107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.294235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.294259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.294391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.294521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.294544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.294677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.294791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.294815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.294962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.295100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.295124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.295264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.295363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.295388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.295496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.295630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.295654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.295808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.295930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.295955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-26 15:51:15.296057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-26 15:51:15.296161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.296191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.296301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.296438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.296462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.296592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.296694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.296720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.296828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.296931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.296955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.297052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.297189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.297213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.297320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.297415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.297440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.297569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.297676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.297708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.297813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.297948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.297971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.298067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.298175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.298199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.298306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.298440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.298463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.298621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.298725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.298750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.298859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.298961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.298985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.299097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.299195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.299219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.299319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.299412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.299436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.299571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.299705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.299730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.299858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.300018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.300042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.300150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.300255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.300279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.300386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.300518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.300542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.300676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.300787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.300812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.300910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.301035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.301059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.301224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.301325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.301349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.301485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.301596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.301621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.301720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.301849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.301873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.301977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.302079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.302103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.302229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.302333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.302357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.302464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.302594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.302618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.302725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.302835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.302860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.302991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.303098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.303122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-26 15:51:15.303228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.303358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-26 15:51:15.303381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.303506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.303613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.303637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.303776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.303882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.303907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.304050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.304149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.304173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.304304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.304395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.304419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.304530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.304658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.304683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.304795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.304891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.304915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.305021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.305128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.305152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.305282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.305378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.305402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.305510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.305633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.305657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.305790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.305920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.305945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.306042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.306171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.306195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.306333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.306439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.306463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.306567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.306710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.306735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.306871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.307005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.307028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.307131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.307230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.307255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.307385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.307516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.307540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.307646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.307817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.307842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.307947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.308052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.308076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.308184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.308313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.308337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.308447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.308582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.308607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.308714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.308814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.308838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.308970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.309062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.309086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.309216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.309352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.309380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-26 15:51:15.309483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.309606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-26 15:51:15.309630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.309752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.309856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.309880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.310014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.310112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.310135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.310237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.310367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.310390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.310526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.310655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.310679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.310831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.310934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.310958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.311075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.311168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.311193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.311296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.311391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.311415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.311541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.311676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.311716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.311822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.311977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.312002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.312120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.312245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.312270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.312368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.312476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.312501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.312630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.312734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.312760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.312920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.313022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.313047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.313158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.313256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.313279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.313371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.313505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.313529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.313626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.313730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.313756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.313861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.313957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.313982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.314117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.314249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.314274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.314411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.314540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.314564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.314672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.314805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.314830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.314938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.315031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.315056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.315159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.315253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.315277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.315381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.315511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.315535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.315634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.315762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-26 15:51:15.315787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-26 15:51:15.315902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.316000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.316025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.316139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.316266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.316290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.316393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.316491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.316515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.316632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.316728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.316754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.316861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.317022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.317046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.317181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.317287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.317311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.317407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.317572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.317597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.317701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.317830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.317855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.318014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.318118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.318143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.318242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.318372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.318397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.318497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.318589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.318614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.318735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.318838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.318862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.318959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.319064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.319088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.319220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.319344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.319369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.319494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.319597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.319621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.319724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.319834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.319858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.319993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.320102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.320127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.320261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.320363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.320388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.320514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.320611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.320635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.320741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.320843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.320867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.320996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.321094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.321117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.321221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.321319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.321343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.321459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.321563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.321587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.321724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.321857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.321881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.321991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.322093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.322117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.322253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.322374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.322402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.322545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.322642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.322666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.322779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.322883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.322907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-26 15:51:15.323010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.323107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-26 15:51:15.323131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.323264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.323394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.323418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.323553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.323656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.323680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.323819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.323953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.323976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.324109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.324209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.324233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.324338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.324468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.324493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.324631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.324760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.324786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.324894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.325008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.325032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.325153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.325258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.325283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.325384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.325536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.325560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.325662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.325796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.325821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.325920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.326028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.326052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.326209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.326309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.326334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.326470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.326567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.326592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.326707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.326845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.326870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.326977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.327071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.327095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.327225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.327321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.327346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.327459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.327559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.327584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.327696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.327799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.327824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.327929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.328037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.328062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.328159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.328290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.328314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.328408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.328515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.328540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.328667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.328771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.328796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.328903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.329007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.329031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.329130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.329255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.329279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.329392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.329487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.329511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.329616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.329717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.329742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.329843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.329975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.329999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.330104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.330239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.330263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-26 15:51:15.330381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.330488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-26 15:51:15.330513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.330622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.330738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.330763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.330895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.330997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.331021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.331124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.331236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.331260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.331352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.331460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.331484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.331583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.331709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.331735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.331874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.331987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.332011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.332119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.332216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.332240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.332348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.332443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.332469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.332572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.332671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.332703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.332804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.332918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.332942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.333057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.333161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.333186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.333293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.333394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.333419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.333515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.333626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.333651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.333790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.333896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.333920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.334021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.334155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.334180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.334312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.334414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.334439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.334534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.334634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.334658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.334774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.334873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.334898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.335014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.335106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.335134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.335270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.335380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.335404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.335504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.335610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.335635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.335766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.335872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.335897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.336006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.336140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.336164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.336298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.336396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.336420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.336519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.336624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.336649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.336766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.336899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.336924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.337054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.337151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.337176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.337285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.337409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.337434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-26 15:51:15.337533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.337636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-26 15:51:15.337665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.337771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.337876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.337900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.338001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.338100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.338124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.338253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.338354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.338378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.338477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.338600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.338625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.338733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.338828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.338853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.338964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.339074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.339099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.339234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.339329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.339353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.339458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.339587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.339612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.339741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.339833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.339857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.339953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.340048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.340073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.340193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.340315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.340339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.340456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.340558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.340583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.340693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.340789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.340814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.340919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.341046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.341071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.341177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.341308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.341334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.341432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.341527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.341552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.341652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.341786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.341812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.341921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.342048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.342073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.342199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.342292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.342317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.342432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.342530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.342554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.342656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.342798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.342824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.342952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.343053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-26 15:51:15.343078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-26 15:51:15.343189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.343285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.343310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.343477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.343577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.343602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.343745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.343846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.343871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.344001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.344133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.344158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.344263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.344366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.344391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.344491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.344592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.344617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.344726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.344863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.344888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.344995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.345138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.345163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.345258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.345377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.345402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.345511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.345622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.345648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.345753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.345855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.345881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.345982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.346091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.346116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.346215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.346319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.346344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.346470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.346571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.346596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.346701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.346803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.346830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.346940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.347053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.347077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.347239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.347341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.347366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.347498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.347627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.347651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.347772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.347908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.347934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.348040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.348163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.348188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.348322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.348412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.348437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.348569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.348673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.348709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.348807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.348907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.348932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.349047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.349178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.349203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.349334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.349442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.349466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-26 15:51:15.349599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.349703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-26 15:51:15.349729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.349823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.350030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.350056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.350166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.350297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.350323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.350436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.350599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.350628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.350768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.350865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.350890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.351036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.351246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.351271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.351400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.351536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.351561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.351717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.351844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.351869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.351967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.352068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.352093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.352225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.352322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.352347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.352504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.352613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.352638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.352744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.352842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.352867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.352977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.353092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.353117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.353254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.353352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.353377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.353522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.353630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.353655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.353798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.353904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.353929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.354080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.354183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.354207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.354314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.354449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.354474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.354613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.354720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.354745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.354859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.354951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.354976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.355079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.355179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.355204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.355301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.355434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.355458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.355562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.355696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.355722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.355851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.355992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.356017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.356123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.356233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.356258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.356357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.356463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.356487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.356591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.356697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.356722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.356818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.356951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.356975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.357104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.357206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.357230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-26 15:51:15.357355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-26 15:51:15.357489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.357514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.357612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.357718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.357743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.357880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.357972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.357997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.358108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.358233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.358256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.358358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.358461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.358486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.358591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.358699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.358724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.358834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.358939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.358963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.359089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.359191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.359216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.359324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.359425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.359452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.359617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.359735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.359761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.359869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.359966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.359991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.360106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.360240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.360264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.360376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.360476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.360502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.360602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.360742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.360767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.360907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.361050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.361075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.361180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.361312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.361338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.361442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.361552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.361577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.361707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.361836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.361861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.362025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.362168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.362193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.362295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.362423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.362447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.362563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.362661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.362699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.362812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.362955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.362980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.363073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.363170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.363195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.363293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.363417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.363442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.363542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.363647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.363672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.363776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.363873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.363903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.364030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.364159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.364184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.364310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.364407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.364432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.364561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.364681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.364713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-26 15:51:15.364841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-26 15:51:15.364932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.364957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.365053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.365152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.365178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.365286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.365385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.365411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.365538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.365630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.365655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.365782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.365874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.365898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.366048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.366138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.366162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.366305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.366444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.366469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.366601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.366770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.366796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.366903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.367009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.367034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.367134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.367237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.367261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.367369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.367475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.367500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.367658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.367770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.367795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.367894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.368033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.368057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.368189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.368286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.368310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.368449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.368571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.368595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.368726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.368864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.368889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.369019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.369119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.369144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.369276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.369382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.369407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.369510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.369603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.369627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.369739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.369844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.369869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.369970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.370062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.370087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.370191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.370320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.370345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.370444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.370575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.370600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.370717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.370819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.370844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.370944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.371042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.371067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.371165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.371270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.371294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.371406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.371509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.371534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.371698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.371824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.371848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-26 15:51:15.371946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-26 15:51:15.372081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.372107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.372211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.372317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.372342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.372442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.372557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.372581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.372682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.372816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.372840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.372938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.373038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.373062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.373171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.373294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.373317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.373424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.373549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.373573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.373669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.373770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.373795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.373924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.374020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.374044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.374151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.374281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.374306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.374433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.374561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.374585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.374695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.374829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.374854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.374979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.375074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.375098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.375207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.375341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.375367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.375461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.375595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.375619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.375791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.375892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.375917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.376062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.376190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.376214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.376311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.376436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.376461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.376555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.376680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.376711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.376818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.376917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.376945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.377081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.377220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.377244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.377345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.377467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.377491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.377587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.377718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.377743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.377847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.377942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.377967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.378071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.378228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-26 15:51:15.378253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-26 15:51:15.378359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.378462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.378487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.378614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.378716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.378742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.378851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.378978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.379002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.379099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.379197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.379222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.379328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.379425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.379453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.379556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.379661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.379691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.379795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.379938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.379962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.380092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.380193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.380218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.380321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.380459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.380483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.380590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.380721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.380746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.380870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.380998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.381022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.381120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.381251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.381277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.381379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.381482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.381507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.381613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.381743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.381769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.381904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.382029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.382053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.382183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.382336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.382360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.382468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.382567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.382591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.382702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.382804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.382828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.382934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.383036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.383061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.383219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.383351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.383375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.383478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.383610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.383634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.383743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.383852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.383877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.383982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.384087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.384111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.384222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.384377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.384402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.384509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.384613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.384637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.384770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.384901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.384925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.385032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.385129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.385153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.385284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.385412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.385436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-26 15:51:15.385534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.385635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-26 15:51:15.385660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.385776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.385885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.385910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.386035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.386135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.386160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.386263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.386420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.386445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.386575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.386690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.386715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.386817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.386922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.386947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.387078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.387171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.387196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.387355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.387470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.387495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.387600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.387708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.387734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.387891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.387986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.388011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.388150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.388249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.388273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.388367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.388464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.388489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.388607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.388716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.388742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.388857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.388978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.389003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.389098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.389202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.389227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.389327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.389420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.389444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.389539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.389669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.389720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.389847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.389946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.389971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.390108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.390232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.390257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.390361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.390491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.390514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.390638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.390745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.390771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.390875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.391013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.391038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.391166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.391277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.391302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.391438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.391540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.391565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.391698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.391794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.391820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.391920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.392064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.392088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.392185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.392285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.392309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.392466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.392564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.392595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.392748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.392853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.392878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-26 15:51:15.393009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.393119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-26 15:51:15.393144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.393278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.393407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.393431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.393538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.393652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.393677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.393790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.393896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.393921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.394028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.394133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.394159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.394295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.394405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.394431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.394538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.394664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.394693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.394801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.394896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.394921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.395067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.395165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.395197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.395300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.395406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.395431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.395542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.395642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.395668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.395791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.395916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.395941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.396046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.396150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.396175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.396280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.396435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.396460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.396559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.396702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.396727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.396858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.396987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.397012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.397107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.397235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.397260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.397368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.397478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.397503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.397604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.397702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.397727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.397864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.397974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.397998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.398103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.398202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.398226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.398366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.398471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.398494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.398596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.398720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.398745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.398842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.398941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.398964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.399074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.399171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.399195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.399297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.399407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.399433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.399531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.399666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.399696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.399820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.399928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.399953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.400053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.400167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.400192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-26 15:51:15.400325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.400449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-26 15:51:15.400473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.400586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.400730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.400756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.400897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.401000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.401025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.401130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.401254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.401278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.401414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.401546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.401570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.401666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.401774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.401798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.401901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.402033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.402057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.402154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.402286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.402311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.402415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.402514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.402538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.402669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.402806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.402831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.402959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.403105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.403130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.403246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.403383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.403407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.403500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.403600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.403627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.403735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.403839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.403865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.404004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.404109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.404134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.404234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.404329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.404354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.404459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.404586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.404610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.404720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.404856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.404880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.404987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.405127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.405152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.405284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.405417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.405442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.405543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.405644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.405673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.405806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.405904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.405929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.406066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.406205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.406229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.406362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.406489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.406513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.406652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.406768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.406793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.406903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.407019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-26 15:51:15.407043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-26 15:51:15.407148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.407281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.407305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.407437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.407564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.407588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.407708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.407810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.407834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.407941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.408085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.408109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.408217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.408323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.408348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.408465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.408562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.408587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.408722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.408820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.408846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.408981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.409094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.409130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.409233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.409335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.409360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.409498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.409628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.409664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.409806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.409908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.409932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.410068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.410172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.410197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.410328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.410427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.410452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.410565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.410693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.410719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.410845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.410940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.410965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.411105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.411211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.411236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.411335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.411450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.411474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.411604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.411732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.411757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.411858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.411950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.411975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.412075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.412175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.412200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.412308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.412432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.412456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.412590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.412711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.412737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.412848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.412977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.413007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.413116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.413219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.413245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.413353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.413458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.413482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.413617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.413724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.413750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.413851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.413983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.414008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.414108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.414202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.414226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.414352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.414454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.140 [2024-11-26 15:51:15.414479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.140 qpair failed and we were unable to recover it. 00:27:24.140 [2024-11-26 15:51:15.414614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.414721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.414747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.414870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.414973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.415004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.415101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.415204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.415229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.415366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.415501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.415526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.415655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.415759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.415785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.415887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.415994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.416019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.416158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.416256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.416281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.416380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.416481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.416506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.416606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.416722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.416748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.416886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.416982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.417007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.417132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.417228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.417252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.417351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.417462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.417486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.417587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.417726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.417751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.417873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.418012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.418037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.418147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.418249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.418274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.418402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.418512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.418537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.418668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.418774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.418803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.418913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.419023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.419047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.419155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.419266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.419296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.419402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.419507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.419531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.419658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.419755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.419780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.419913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.420039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.420063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.420165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.420324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.420348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.420444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.420535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.420560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.420663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.420827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.420852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.420961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.421076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.421100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.421210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.421344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.421371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.421482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.421619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.421644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.141 [2024-11-26 15:51:15.421787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.421882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.141 [2024-11-26 15:51:15.421906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.141 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.422050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.422176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.422200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.422305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.422410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.422435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.422569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.422698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.422723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.422824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.422961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.422985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.423126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.423256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.423281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.423382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.423481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.423506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.423607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.423733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.423758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.423856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.423968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.423992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.424124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.424259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.424283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.424410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.424505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.424530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.424628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.424736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.424761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.424867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.424994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.425018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.425116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.425210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.425234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.425371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.425471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.425495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.425592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.425750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.425775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.425908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.426040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.426064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.426168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.426296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.426320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.426449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.426546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.426569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.426673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.426784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.426810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.426917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.427034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.427059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.427190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.427284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.427309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.427415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.427550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.427574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.427703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.427813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.427838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.427975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.428090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.428114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.428274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.428377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.428402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.428537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.428644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.428677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.428801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.428957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.428983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.429097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.429200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.429226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.142 qpair failed and we were unable to recover it. 00:27:24.142 [2024-11-26 15:51:15.429352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.429461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.142 [2024-11-26 15:51:15.429485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.429625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.429735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.429760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.429867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.429971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.429999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.430139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.430233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.430257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.430363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.430489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.430514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.430609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.430725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.430750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.430851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.431009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.431034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.431139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.431241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.431266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.431364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.431468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.431492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.431598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.431753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.431778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.431887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.431985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.432016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.432121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.432222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.432246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.432362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.432491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.432516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.432649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.432815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.432842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.432978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.433086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.433110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.433212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.433319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.433343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.433447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.433573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.433598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.433741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.433905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.433929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.434042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.434174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.434198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.434360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.434462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.434486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.434621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.434759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.434789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.434909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.435016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.435040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.435142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.435269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.435293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.435395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.435488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.435512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.435616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.435729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.435755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.435864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.435963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.435987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.436129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.436285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.436309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.436412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.436521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.436545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.436653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.436761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.436785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.143 qpair failed and we were unable to recover it. 00:27:24.143 [2024-11-26 15:51:15.436896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.436997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.143 [2024-11-26 15:51:15.437021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.437151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.437250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.437275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.437444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.437539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.437563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.437696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.437829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.437854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.437958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.438094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.438119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.438249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.438343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.438368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.438477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.438606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.438632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.438746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.438852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.438877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.439013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.439116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.439141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.439269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.439395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.439420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.439559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.439681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.439712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.439839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.439951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.439975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.440107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.440216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.440239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.440338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.440468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.440493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.440621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.440755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.440780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.440917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.441038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.441063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.441168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.441273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.441298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.441413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.441514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.441538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.441636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.441737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.441761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.441875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.441974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.441998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.442098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.442231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.442256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.442396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.442490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.442514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.442613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.442726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.442750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.442864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.442994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.443019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.443124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.443230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.443255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.144 [2024-11-26 15:51:15.443385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.443485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.144 [2024-11-26 15:51:15.443510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.144 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.443644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.443754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.443780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.443915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.444052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.444077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.444185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.444315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.444340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.444464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.444556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.444580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.444695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.444798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.444823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.444926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.445037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.445061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.445173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.445272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.445297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.445399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.445528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.445552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.445681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.445813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.445838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.445965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.446068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.446093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.446197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.446322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.446347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.446477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.446653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.446678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.446787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.446945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.446968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.447074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.447180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.447204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.447360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.447464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.447488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.447588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.447693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.447719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.447825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.447926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.447956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.448106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.448241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.448266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.448396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.448501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.448525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.448625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.448732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.448757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.448886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.448998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.449022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.449155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.449289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.449314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.449474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.449599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.449624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.449737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.449837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.449862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.449959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.450057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.450082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.450190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.450315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.450340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.450472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.450566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.450591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.450735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.450837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.450863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.145 [2024-11-26 15:51:15.450962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.451089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.145 [2024-11-26 15:51:15.451113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.145 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.451271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.451369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.451394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.451524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.451626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.451650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.451754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.451879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.451904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.452008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.452142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.452167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.452264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.452389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.452413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.452518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.452626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.452651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.452788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.452893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.452918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.453027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.453124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.453149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.453261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.453365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.453391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.453527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.453621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.453645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.453816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.453934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.453962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.454087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.454198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.454223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.454319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.454428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.454454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.454590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.454700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.454726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.454828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.454933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.454958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.455082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.455186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.455213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.455346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.455440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.455466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.455566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.455698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.455729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.455841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.455950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.455976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.456100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.456195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.456220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.456328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.456432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.456457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.456556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.456661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.456694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.456826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.456938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.456963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.457095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.457229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.457254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.457416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.457543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.457568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.457674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.457793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.457818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.457948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.458053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.458080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.458218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.458314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.458339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.146 qpair failed and we were unable to recover it. 00:27:24.146 [2024-11-26 15:51:15.458449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.458550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.146 [2024-11-26 15:51:15.458575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.458710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.458810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.458835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.458970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.459102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.459129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.459264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.459374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.459400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.459497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.459597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.459623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.459735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.459846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.459872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.459971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.460127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.460152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.460253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.460357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.460383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.460483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.460618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.460643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.460779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.460894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.460919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.461042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.461191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.461218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.461330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.461428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.461452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.461551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.461648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.461672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.461791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.461891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.461914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.462008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.462109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.462135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.462236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.462368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.462392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.462500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.462607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.462631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.462764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.462871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.462895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.462992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.463097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.463121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.463255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.463385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.463410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.463521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.463633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.463659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.463778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.463885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.463910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.464049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.464144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.464170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.464280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.464416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.464441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.464543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.464666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.464698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.464802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.464910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.464936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.465041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.465171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.465195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.465294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.465392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.465416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.465513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.465611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.147 [2024-11-26 15:51:15.465634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.147 qpair failed and we were unable to recover it. 00:27:24.147 [2024-11-26 15:51:15.465750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.465859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.465886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.466038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.466172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.466197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.466352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.466449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.466474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.466614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.466732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.466759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.466888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.466990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.467015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.467117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.467214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.467238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.467335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.467441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.467465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.467589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.467719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.467745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.467851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.467958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.467982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.468092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.468198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.468222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.468330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.468434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.468458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.468597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.468699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.468725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.468828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.468930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.468955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.469053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.469151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.469175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.469269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.469380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.469403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.469510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.469629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.469654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.469773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.469875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.469910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.470039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.470142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.470166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.470262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.470390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.470415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.470511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.470635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.470661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.470771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.470865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.470889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.471028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.471165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.471189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.471293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.471399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.471428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.471536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.471628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.471652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.471800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.471915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.471940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.472075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.472182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.472207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.472334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.472462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.472487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.148 qpair failed and we were unable to recover it. 00:27:24.148 [2024-11-26 15:51:15.472584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.148 [2024-11-26 15:51:15.472679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.472711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.472840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.472946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.472971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.473067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.473201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.473225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.473327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.473454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.473478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.473585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.473678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.473713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.473852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.473959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.473983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.474091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.474218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.474244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.474342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.474448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.474473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.474573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.474716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.474741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.474880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.475012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.475036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.475177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.475332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.475357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.475483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.475616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.475641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.475748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.475877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.475901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.476015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.476119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.476143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.476241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.476344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.476374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.476487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.476611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.476637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.476747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.476869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.476894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.476987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.477087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.477111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.477241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.477372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.477397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.477496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.477651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.477676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.477813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.477906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.477931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.478062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.478157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.478181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.478294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.478389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.478414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.478542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.478669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.478709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.478818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.478916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.478945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.479083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.479192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.479216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.479330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.479433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.479458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.149 qpair failed and we were unable to recover it. 00:27:24.149 [2024-11-26 15:51:15.479564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.149 [2024-11-26 15:51:15.479667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.479707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.479984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.480085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.480110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.480236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.480335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.480360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.480464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.480597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.480622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.480752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.480853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.480878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.481015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.481151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.481175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.481317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.481412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.481437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.481567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.481674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.481705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.481824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.481922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.481948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.482057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.482156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.482181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.482282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.482406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.482431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.482535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.482632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.482657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.482769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.482878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.482902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.483042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.483145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.483169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.483304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.483464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.483488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.483618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.483729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.483755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.483862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.484000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.484025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.484131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.484235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.484259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.484381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.484511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.484536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.484694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.484793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.484818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.484946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.485078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.485104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.485241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.485373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.485398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.485527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.485674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.485705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.485836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.485964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.485988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.486117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.486219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.486243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.486344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.486450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.486475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.486603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.486704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.486730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.486837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.486951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.486976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.487111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.487217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.150 [2024-11-26 15:51:15.487242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.150 qpair failed and we were unable to recover it. 00:27:24.150 [2024-11-26 15:51:15.487377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.487481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.487506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.487613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.487727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.487753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.488016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.488151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.488176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.488281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.488379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.488403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.488502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.488638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.488663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.488769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.488905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.488930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.489049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.489150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.489174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.489282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.489386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.489411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.489547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.489704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.489729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.489866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.489967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.489992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.490103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.490200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.490225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.490350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.490483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.490507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.490641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.490744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.490768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.490875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.490975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.490999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.491101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.491202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.491227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.491334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.491435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.491460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.491596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.491723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.491749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.491886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.491993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.492018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.492123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.492268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.492293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.492405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.492515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.492540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.492638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.492767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.492792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.492892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.493064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.493089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.493221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.493429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.493454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.493551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.493656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.493681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.493788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.493891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.493915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.494038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.494167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.494192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.494352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.494453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.494477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.494605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.494734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.494759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.151 [2024-11-26 15:51:15.494902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.495007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.151 [2024-11-26 15:51:15.495034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.151 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.495145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.495303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.495328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.495435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.495543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.495568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.495668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.495773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.495799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.495897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.496023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.496048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.496183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.496297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.496322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.496419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.496516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.496540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.496642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.496753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.496778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.496879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.496983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.497008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.497118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.497228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.497253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.497383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.497515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.497539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.497677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.497782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.497807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.497946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.498053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.498077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.498208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.498333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.498357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.498488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.498589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.498614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.498723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.498856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.498883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.498992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.499095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.499120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.499218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.499345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.499370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.499475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.499588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.499613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.499728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.499825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.499849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.499975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.500106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.500130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.500231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.500333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.500358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.500465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.500598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.500622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.500726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.500859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.500885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.501029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.501133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.501158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.501288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.501381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.501406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.501512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.501639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.501664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.501802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.501940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.501965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.502101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.502197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.502224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.152 qpair failed and we were unable to recover it. 00:27:24.152 [2024-11-26 15:51:15.502332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.152 [2024-11-26 15:51:15.502430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.502455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.502562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.502658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.502683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.502789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.502885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.502909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.503025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.503157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.503182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.503279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.503374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.503397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.503504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.503636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.503661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.503790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.503953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.503978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.504080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.504185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.504210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.504311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.504447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.504473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.504598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.504705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.504731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.504840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.504969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.504999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.505126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.505257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.505281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.505384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.505488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.505515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.505633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.505749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.505776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.505880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.506016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.506041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.506148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.506255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.506281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.506417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.506521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.506546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.506650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.506754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.506779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.506886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.507019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.507043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.507174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.507334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.507358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.507483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.507591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.507615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.507739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.507840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.507864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.507995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.508132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.508157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.508294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.508394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.508418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.508581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.508677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.153 [2024-11-26 15:51:15.508709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.153 qpair failed and we were unable to recover it. 00:27:24.153 [2024-11-26 15:51:15.508809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.509050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.509074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.509171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.509298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.509322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.509479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.509580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.509605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.509741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.509849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.509874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.509971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.510100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.510124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.510220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.510319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.510345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.510449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.510577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.510602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.510731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.510958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.510993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.511098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.511204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.511228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.511369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.511496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.511522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.511634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.511740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.511766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.511892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.512035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.512060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.512165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.512290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.512315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.512412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.512514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.512540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.512643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.512753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.512779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.512906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.513011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.513035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.513141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.513240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.513263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.513372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.513503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.513531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.513640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.513752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.513776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.513881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.513971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.513995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.514129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.514273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.514297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.514429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.514562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.514586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.514721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.514823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.514847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.514980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.515073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.515098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.515225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.515381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.515405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.515564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.515716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.515742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.515873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.515983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.516008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.516142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.516241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.516270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.516403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.516497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.516521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.516619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.516726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.516753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.154 [2024-11-26 15:51:15.516883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.517005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.154 [2024-11-26 15:51:15.517030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.154 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.517126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.517221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.517246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.517351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.517445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.517469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.517572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.517697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.517721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.517825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.517956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.517979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.518123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.518223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.518247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.518372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.518500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.518524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.518657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.518765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.518796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.518931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.519039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.519063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.519167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.519323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.519347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.519456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.519556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.519582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.519748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.519852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.519877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.519978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.520116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.520140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.520239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.520360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.520385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.520518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.520651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.520677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.520789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.520890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.520915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.521032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.521165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.521190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.521292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.521388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.521417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.521528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.521656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.521680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.521789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.521883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.521908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.522023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.522116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.522140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.522253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.522386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.522410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.522511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.522642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.522667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.522776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.522874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.522898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.523008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.523140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.523167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.523271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.523400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.523424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.523533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.523636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.523660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.523774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.523903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.523928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.524041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.524173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.524199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.524308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.524401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.524426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.524528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.524637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.524662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.155 [2024-11-26 15:51:15.524796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.524943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.155 [2024-11-26 15:51:15.524972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.155 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.525086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.525220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.525246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.525358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.525466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.525491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.525626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.525753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.525780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.525880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.526015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.526040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.526147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.526287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.526311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.526414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.526536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.526560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.526697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.526795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.526819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.526919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.527015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.527039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.527145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.527235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.527259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.527374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.527498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.527522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.527656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.527767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.527792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.527892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.528015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.528039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.528143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.528273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.528298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.528406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.528504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.528528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.528629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.528729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.528755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.528858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.528965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.528989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.529092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.529246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.529271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.529394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.529499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.529524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.529653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.529755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.529780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.529882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.529979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.530004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.530146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.530246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.530271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.530372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.530467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.530491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.530596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.530780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.530806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.530909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.531037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.531062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.531174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.531282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.531307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.531417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.531514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.531539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.531637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.531769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.531795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.531922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.532059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.532085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.532190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.532318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.532343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.532443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.532555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.532580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.532710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.532847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.156 [2024-11-26 15:51:15.532872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.156 qpair failed and we were unable to recover it. 00:27:24.156 [2024-11-26 15:51:15.532968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.533074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.533099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.157 qpair failed and we were unable to recover it. 00:27:24.157 [2024-11-26 15:51:15.533200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.533305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.533330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.157 qpair failed and we were unable to recover it. 00:27:24.157 [2024-11-26 15:51:15.533432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.533562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.533586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.157 qpair failed and we were unable to recover it. 00:27:24.157 [2024-11-26 15:51:15.533701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.533813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.533837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.157 qpair failed and we were unable to recover it. 00:27:24.157 [2024-11-26 15:51:15.533936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.534073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.534098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.157 qpair failed and we were unable to recover it. 00:27:24.157 [2024-11-26 15:51:15.534255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.534385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.534411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.157 qpair failed and we were unable to recover it. 00:27:24.157 [2024-11-26 15:51:15.534518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.534614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.534639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.157 qpair failed and we were unable to recover it. 00:27:24.157 [2024-11-26 15:51:15.534739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.534874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.534899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.157 qpair failed and we were unable to recover it. 00:27:24.157 [2024-11-26 15:51:15.535005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.535100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.157 [2024-11-26 15:51:15.535124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.157 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.535227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.535328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.535353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.535485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.535588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.535613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.535748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.535849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.535876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.535993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.536098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.536123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.536259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.536389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.536414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.536521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.536651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.536677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.536817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.536916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.536945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.537059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.537182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.537206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.537333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.537438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.537463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.537561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.537656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.537681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.537794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.537926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.537950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.538058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.538189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.538214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.538344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.538441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.538466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.538571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.538702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.538728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.538851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.538984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.539009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.539109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.539211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.539235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.539367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.539467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.539491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.539596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.539709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.539735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.430 qpair failed and we were unable to recover it. 00:27:24.430 [2024-11-26 15:51:15.539842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.430 [2024-11-26 15:51:15.539948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.539973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.540140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.540241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.540267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.540363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.540463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.540487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.540594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.540727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.540753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.540860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.540977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.541001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.541132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.541237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.541261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.541356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.541467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.541492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.541626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.541752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.541777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.541906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.542030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.542055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.542164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.542267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.542291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.542399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.542494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.542518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.542651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.542790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.542816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.542914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.543018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.543043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.543183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.543319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.543344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.543475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.543607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.543632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.543743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.543851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.543875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.543980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.544115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.544139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.544248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.544352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.544375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.544477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.544607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.544631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.544768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.544870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.544896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.545026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.545126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.545150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.545265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.545363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.545387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.545554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.545648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.545672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.545812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.545908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.545932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.546059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.546196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.546220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.546352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.546447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.546471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.546601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.546702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.546727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.546829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.546932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.546956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.431 [2024-11-26 15:51:15.547081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.547210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.431 [2024-11-26 15:51:15.547234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.431 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.547370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.547476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.547500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.547602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.547729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.547754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.547894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.548020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.548044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.548174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.548272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.548296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.548428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.548555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.548579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.548690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.548795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.548819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.548923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.549025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.549050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.549153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.549279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.549304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.549418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.549529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.549554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.549646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.549753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.549778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.549936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.550041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.550069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.550213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.550345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.550370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.550479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.550582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.550608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.550738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.550867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.550892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.551003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.551156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.551181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.551286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.551394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.551418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.551580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.551721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.551746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.551877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.551980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.552004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.552167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.552266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.552290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.552450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.552554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.552579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.552712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.552840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.552865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.552976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.553143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.553168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.553274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.553382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.553407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.553547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.553651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.553676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.553790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.553895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.553921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.554018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.554146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.554172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.554278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.554413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.554437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.554541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.554668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.554698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.432 [2024-11-26 15:51:15.554831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.554935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.432 [2024-11-26 15:51:15.554959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.432 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.555061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.555160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.555186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.555289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.555413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.555437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.555575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.555710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.555736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.555842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.555945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.555970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.556079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.556209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.556235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.556364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.556492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.556518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.556643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.556739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.556764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.556870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.556994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.557018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.557115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.557255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.557280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.557386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.557522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.557546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.557643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.557761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.557785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.557882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.558003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.558027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.558128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.558230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.558254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.558351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.558473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.558497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.558627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.558744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.558769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.558874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.558981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.559006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.559105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.559206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.559231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.559328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.559432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.559456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.559555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.559656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.559680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.559796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.559922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.559947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.560084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.560182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.560208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.560311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.560442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.560468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.560576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.560697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.560722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.560824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.560929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.560954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.561060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.561192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.561219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.561327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.561420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.561445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.561551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.561650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.561675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.561791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.561917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.561941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-26 15:51:15.562039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.562142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-26 15:51:15.562167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.562295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.562399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.562424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.562518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.562630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.562654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.562767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.562863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.562887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.562994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.563120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.563149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.563258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.563357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.563381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.563488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.563614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.563639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.563745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.563879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.563903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.564000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.564101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.564126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.564261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.564356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.564380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.564483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.564607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.564631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.564794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.564896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.564920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.565049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.565148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.565172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.565319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.565420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.565444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.565538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.565647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.565672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.565809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.565902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.565927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.566035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.566162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.566187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.566326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.566431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.566456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.566562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.566659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.566683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.566802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.566938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.566963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.567075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.567186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.567210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.567316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.567414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.567438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.567539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.567652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.567676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.567781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.567882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.567906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-26 15:51:15.568039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.568141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-26 15:51:15.568165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.568271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.568362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.568387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.568492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.568595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.568620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.568764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.568866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.568891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.569026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.569130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.569155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.569259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.569384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.569408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.569516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.569615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.569641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.569751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.569850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.569876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.569971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.570100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.570125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.570220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.570339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.570364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.570493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.570599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.570625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.570732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.570859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.570883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.570989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.571092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.571116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.571224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.571329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.571353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.571450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.571556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.571580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.571676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.571820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.571844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.571944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.572049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.572074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.572174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.572299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.572322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.572434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.572538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.572563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.572667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.572777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.572803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.572952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.573083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.573108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.573223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.573330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.573357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.573485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.573590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.573615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.573837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.573937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.573962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.574122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.574230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.574255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.574362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.574456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.574482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.574583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.574711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.574737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.574845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.574942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.574967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.575068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.575195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-26 15:51:15.575220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-26 15:51:15.575319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.575449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.575473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.575606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.575745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.575770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.575902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.576030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.576059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.576162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.576265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.576290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.576402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.576525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.576550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.576657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.576787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.576814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.576944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.577073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.577098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.577213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.577346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.577370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.577470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.577570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.577595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.577706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.577834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.577859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.578023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.578121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.578146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.578249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.578344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.578368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.578500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.578600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.578629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.578778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.578912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.578942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.579040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.579133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.579157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.579322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.579436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.579460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.579565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.579705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.579730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.579861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.579991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.580016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.580151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.580263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.580288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.580415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.580509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.580534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.580695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.580792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.580817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.580947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.581102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.581127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.581261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.581357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.581382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.581500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.581596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.581620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.581728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.581827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.581852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.581955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.582057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.582081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.582214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.582341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.582365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.582462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.582587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.582611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-26 15:51:15.582752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.582858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-26 15:51:15.582882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.582986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.583114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.583139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.583239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.583376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.583400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.583537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.583634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.583658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.583790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.583931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.583955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.584058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.584192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.584216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.584330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.584435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.584460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.584595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.584706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.584731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.584860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.585014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.585038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.585176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.585304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.585328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.585431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.585527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.585551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.585660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.585759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.585784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.585891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.585994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.586019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.586147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.586307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.586331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.586465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.586592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.586618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.586753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.586855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.586880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.586981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.587072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.587096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.587232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.587325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.587349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.587457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.587558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.587582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.587682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.587816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.587841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.587935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.588036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.588060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.588168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.588262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.588286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.588394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.588516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.588541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.588648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.588757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.588781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.588901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.588998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.589023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.589150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.589345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.589370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.589481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.589580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.589605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.589729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.589849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.589879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.590015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.590119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.590145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-26 15:51:15.590259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.590359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-26 15:51:15.590385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.590484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.590585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.590610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.590715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.590826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.590852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.590953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.591066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.591091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.591192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.591319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.591344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.591453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.591551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.591577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.591683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.591794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.591826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.591932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.592059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.592084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.592192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.592330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.592358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.592463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.592566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.592593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.592702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.592810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.592835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.592941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.593067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.593093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.593204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.593310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.593337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.593473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.593573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.593598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.593709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.593817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.593843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.593948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.594074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.594099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.594214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.594307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.594338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.594441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.594537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.594562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.594698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.594828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.594854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.594969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.595067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.595092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.595218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.595353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.595378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.595486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.595587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.595612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.595740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.595848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.595874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.596034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.596164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.596190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.596298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.596405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.596431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.596533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.596640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.596665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.596775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.596883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.596913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.597025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.597130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.597156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.597298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.597433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-26 15:51:15.597459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-26 15:51:15.597591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.597698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.597724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.597830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.597938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.597964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.598101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.598213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.598240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.598378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.598509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.598535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.598647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.598792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.598820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.598926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.599057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.599083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.599208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.599342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.599369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.599474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.599580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.599610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.599787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.599915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.599941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.600075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.600199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.600224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.600321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.600421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.600447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.600580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.600677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.600709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.600810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.600946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.600972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.601132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.601236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.601261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.601393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.601490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.601515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.601627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.601738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.601766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.601868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.602000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.602025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.602132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.602230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.602255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.602366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.602497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.602523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.602654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.602775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.602802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.602904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.603008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.603034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.603141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.603242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.603268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.603406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.603511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.603537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.603634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.603740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.603768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-26 15:51:15.603870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.604001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-26 15:51:15.604027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.604130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.604257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.604283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.604383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.604510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.604537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.604639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.604734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.604761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.604862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.604968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.604994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.605150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.605247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.605273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.605400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.605533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.605558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.605696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.605810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.605836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.605940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.606065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.606091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.606225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.606322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.606347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.606479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.606589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.606615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.606722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.606830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.606855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.606966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.607068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.607094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.607222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.607321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.607347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.607446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.607598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.607625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.607726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.607830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.607857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.607969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.608069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.608095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.608223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.608329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.608354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.608454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.608612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.608637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.608755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.608858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.608883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.609010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.609113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.609139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.609246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.609382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.609407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.609506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.609612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.609638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.609747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.609854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.609879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.610023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.610151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.610177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.610308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.610407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.610432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.610537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.610698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.610727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.610859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.610968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.610995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.611105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.611216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.611242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-26 15:51:15.611374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.611471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-26 15:51:15.611496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.611594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.611753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.611779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.611883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.612044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.612069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.612199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.612310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.612335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.612441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.612543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.612568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.612683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.612795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.612821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.612955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.613091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.613116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.613252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.613345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.613371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.613485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.613584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.613609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.613747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.613848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.613874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.613989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.614087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.614113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.614222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.614350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.614376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.614511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.614613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.614638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.614743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.614841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.614867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.614999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.615099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.615125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.615258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.615354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.615379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.615479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.615587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.615615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.615733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.615842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.615873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.615983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.616143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.616168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.616283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.616381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.616407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.616514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.616615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.616641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.616746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.616841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.616867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.616975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.617100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.617125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.617284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.617381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.617407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.617500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.617631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.617657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.617783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.617903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.617933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.618049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.618154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.618180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.618290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.618421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.618446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.618543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.618641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.618666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-26 15:51:15.618781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-26 15:51:15.618888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.618913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.619012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.619108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.619134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.619231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.619364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.619390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.619528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.619631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.619656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.619781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.619881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.619908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.620035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.620131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.620157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.620302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.620417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.620446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.620552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.620681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.620716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.620821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.620935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.620960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.621063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.621167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.621193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.621326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.621455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.621479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.621584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.621697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.621723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.621825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.621926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.621951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.622048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.622143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.622168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.622269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.622402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.622427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.622522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.622617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.622642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.622748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.622862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.622888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.622997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.623101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.623128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.623232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.623355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.623380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.623491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.623594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.623620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.623758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.623897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.623923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.624028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.624125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.624150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.624281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.624416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.624442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.624548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.624671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.624702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.624805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.624939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.624965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.625066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.625196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.625223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.625330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.625466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.625492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.625622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.625759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.625786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-26 15:51:15.625912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.626017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-26 15:51:15.626042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.626141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.626234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.626259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.626378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.626514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.626539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.626647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.626793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.626820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.626926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.627036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.627063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.627197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.627303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.627328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.627430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.627565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.627591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.627694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.627795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.627820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.627929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.628031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.628056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.628182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.628283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.628307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.628407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.628537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.628563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.628675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.628785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.628810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.628940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.629046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.629071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.629181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.629276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.629302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.629402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.629500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.629525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.629624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.629751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.629777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.629883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.629989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.630015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.630126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.630256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.630281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.630391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.630524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.630554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.630697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.630799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.630825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.630931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.631072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.631103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.631231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.631339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.631365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.631469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.631572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.631598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.631719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.631814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.631839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.631944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.632050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.632075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.632199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.632326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.632351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.632468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.632567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.632594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.632721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.632833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.632859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.632964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.633077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.633110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-26 15:51:15.633215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.633346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-26 15:51:15.633372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.633536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.633636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.633661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.633791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.633896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.633922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.634072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.634214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.634241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.634356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.634464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.634491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.634602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.634715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.634743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.634877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.634985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.635012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.635144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.635248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.635274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.635390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.635494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.635521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.635630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.635760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.635792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.635904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.636008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.636035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.636143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.636246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.636273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.636387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.636512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.636537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.636639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.636750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.636777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.636887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.637028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.637053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.637154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.637252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.637278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.637377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.637473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.637498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.637602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.637721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.637748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.637847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.637945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.637970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.638074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.638174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.638204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.638314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.638420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.638446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.638550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.638651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.638677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.638794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.638895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.638921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.639058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.639171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.639196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.639305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.639406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.639432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-26 15:51:15.639564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.639705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-26 15:51:15.639734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.639838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.639947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.639973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.640078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.640175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.640202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.640335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.640439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.640464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.640587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.640690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.640717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.640825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.640926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.640951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.641055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.641188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.641213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.641358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.641459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.641484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.641587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.641726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.641752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.641881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.642014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.642040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.642143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.642275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.642306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.642411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.642510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.642535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.642642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.642748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.642774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.642914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.643069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.643095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.643222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.643328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.643363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.643472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.643576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.643601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.643709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.643817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.643843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.643950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.644083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.644110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.644239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.644352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.644380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.644516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.644614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.644640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.644778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.644874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.644899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.645042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.645174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.645200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.645311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.645414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.645439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.645540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.645662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.645709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.645847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.645989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.646014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.646125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.646226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.646251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.646361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.646503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.646528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.646637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.646744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.646771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.646900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.647001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.647027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-26 15:51:15.647159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-26 15:51:15.647257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.647286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.647410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.647508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.647533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.647643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.647769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.647796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.647912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.648012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.648037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.648135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.648238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.648263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.648359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.648459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.648485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.648606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.648746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.648774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.648874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.649000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.649027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 15:51:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:24.446 [2024-11-26 15:51:15.649126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 15:51:15 -- common/autotest_common.sh@862 -- # return 0 00:27:24.446 [2024-11-26 15:51:15.649235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.649262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 15:51:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:24.446 [2024-11-26 15:51:15.649373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 15:51:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:24.446 [2024-11-26 15:51:15.649503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.649529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 15:51:15 -- common/autotest_common.sh@10 -- # set +x 00:27:24.446 [2024-11-26 15:51:15.649634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.649772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.649798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.649903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.650008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.650034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.650134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.650236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.650262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.650401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.650509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.650535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.650647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.650768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.650795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.650934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.651049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.651074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.651185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.651305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.651332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.651468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.651577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.651603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.651709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.651818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.651844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.651944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.652109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.652135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.652245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.652374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.652400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.652562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.652662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.652707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.652841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.652946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.652972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.653073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.653202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.653228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.653327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.653428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.653453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.653639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.653766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.653793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.653902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.654005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.654031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.654145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.654247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-26 15:51:15.654273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-26 15:51:15.654431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.654562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.654588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.654693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.654794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.654821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.654921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.655033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.655061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.655174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.655306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.655333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.655443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.655563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.655588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.655726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.655835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.655862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.655971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.656129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.656155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.656256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.656395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.656421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.656530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.656635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.656661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.656767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.656907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.656935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.657040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.657183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.657209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.657326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.657466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.657492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.657599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.657701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.657727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.657834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.657938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.657966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.658076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.658211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.658236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.658356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.658452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.658477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.658588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.658729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.658756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.658890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.659007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.659033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.659132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.659269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.659295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.659428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.659537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.659562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.659674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.659795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.659822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.659927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.660041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.660067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.660182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.660313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.660338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc184000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.660443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.660558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.660584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.660698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.660799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.660825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.660935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.661043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.661080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.661213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.661346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.661371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.661472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.661566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.661601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-26 15:51:15.661705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.661849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-26 15:51:15.661876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.661979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.662106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.662131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.662234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.662343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.662369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.662481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.662579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.662604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.662710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.662815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.662841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.662973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.663096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.663121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.663229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.663342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.663368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.663530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.663642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.663667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.663784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.663885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.663911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.664025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.664157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.664188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.664297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.664400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.664425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.664530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.664629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.664654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.664800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.664935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.664961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.665071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.665203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.665230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.665340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.665463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.665488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.665595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.665699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.665725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.665842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.665949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.665975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.666093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.666199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.666224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.666335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.666437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.666462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.666563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.666661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.666709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 15:51:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.666844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 15:51:15 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:24.448 [2024-11-26 15:51:15.666935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.666961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 15:51:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.448 [2024-11-26 15:51:15.667067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 15:51:15 -- common/autotest_common.sh@10 -- # set +x 00:27:24.448 [2024-11-26 15:51:15.667206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.667231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.667371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.667467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.667492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.667604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.667719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.667746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-26 15:51:15.667885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.668046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-26 15:51:15.668071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.668215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.668317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.668342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.668440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.668547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.668573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.668675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.668785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.668811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.668947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.669050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.669078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.669182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.669312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.669338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.669445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.669553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.669579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.669741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.669842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.669867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.669964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.670067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.670092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.670204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.670305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.670330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.670435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.670566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.670591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.670695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.670840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.670865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.670991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.671094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.671121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.671228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.671342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.671367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.671476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.671610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.671635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.671752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.671851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.671878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.671980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.672082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.672107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.672208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.672309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.672333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.672450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.672615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.672640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.672762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.672862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.672887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.673036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.673147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.673174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.673291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.673392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.673419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.673553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.673695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.673722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.673833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.673964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.673989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.674089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.674221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.674246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.674352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.674488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.674513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.674630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.674788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.674814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.674917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.675054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.675079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.675192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.675318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.675344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-26 15:51:15.675479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.675597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-26 15:51:15.675622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.675770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.675878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.675905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.676053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.676187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.676212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.676324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.676458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.676483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.676597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.676721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.676747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.676867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.676964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.676989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.677137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.677237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.677262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.677359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.677509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.677534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.677709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.677842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.677867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.677967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.678109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.678134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.678276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.678407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.678432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.678542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.678656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.678692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.678829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.678931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.678957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.679057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.679184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.679210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.679330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.679475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.679501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.679632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.679782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.679808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.679942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.680106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.680135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.680248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.680352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.680376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.680479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.680609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.680644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.680770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.680902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.680926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.681034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.681137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.681161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.681268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.681377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.681402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.681508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.681637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.681662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.681806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.681917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.681942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.682066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.682194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.682220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.682322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.682467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.682492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.682617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.682774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.682800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.682900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.682994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.683018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.683156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.683273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.683298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-26 15:51:15.683400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-26 15:51:15.683523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.683548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.683692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.683815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.683841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.683946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.684089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.684113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.684223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.684350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.684375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.684499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.684600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.684624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.684743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.684875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.684899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.685066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.685204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.685230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.685338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.685446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.685472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.685649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.685797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.685822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.685928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.686043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.686067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.686182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.686288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.686313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.686411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.686526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.686551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.686698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.686805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.686830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.686941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.687045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.687070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.687182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.687316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.687345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.687449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.687580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.687604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.687725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.687830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.687855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.687982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.688082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.688107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.688262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.688364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.688391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.688511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.688658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.688683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.688832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.688935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.688960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.689072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.689231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.689256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.689390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.689497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.689523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.689622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.689743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.689768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.689877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.689975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.690000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.690114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.690221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.690247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.690381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.690476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.690501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.690608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.690721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.690747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.690847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.690958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-26 15:51:15.690984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-26 15:51:15.691094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.691229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.691253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.691351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.691458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.691491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.691660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 Malloc0 00:27:24.452 [2024-11-26 15:51:15.691829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.691857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.691961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.692100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.692125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 15:51:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.452 [2024-11-26 15:51:15.692233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.692336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.692361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 15:51:15 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 15:51:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.452 [2024-11-26 15:51:15.692503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 15:51:15 -- common/autotest_common.sh@10 -- # set +x 00:27:24.452 [2024-11-26 15:51:15.692605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.692630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.692766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.692922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.692959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.693129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.693274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.693312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.693484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.693613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.693651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.693829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.693984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.694022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.694157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.694286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.694324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.694466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.694569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.694594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.694711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.694850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.694875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.694984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.695099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.695124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.695230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.695340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.695365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.695470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.695541] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:24.452 [2024-11-26 15:51:15.695610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.695633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.695757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.695891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.695915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.696017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.696155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.696186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.696328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.696465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.696489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.696600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.696728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.696754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.696887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.697020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.697053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.697188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.697334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.697359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.697463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.697566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.697590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.697726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.697832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.697857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.697993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.698113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.698137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.698254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.698384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.698408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.698508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.698637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.698662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-26 15:51:15.698798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.698919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-26 15:51:15.698953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.699090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.699191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.699217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.699358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.699469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.699494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.699631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.699758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.699784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.699891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.700010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.700036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.700148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.700259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.700285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.700389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.700548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.700574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.700676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.700800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.700826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.700930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.701059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.701084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.701182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.701350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.701375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.701478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.701581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.701606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.701731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.701836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.701861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.701999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.702150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.702175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.702281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.702442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.702467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.702607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.702720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.702745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.702849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.702953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.702982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.703087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.703195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.703221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.703383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.703484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.703509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.703623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.703763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.703800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 15:51:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.453 [2024-11-26 15:51:15.703960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 15:51:15 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:24.453 [2024-11-26 15:51:15.704092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.704127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 15:51:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.453 [2024-11-26 15:51:15.704268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 15:51:15 -- common/autotest_common.sh@10 -- # set +x 00:27:24.453 [2024-11-26 15:51:15.704398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.704436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.704561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.704698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.704725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.704856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.704965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.704990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.705126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.705247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.705272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.705404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.705545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.705572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-26 15:51:15.705676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-26 15:51:15.705793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.705819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.705923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.706069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.706094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.706197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.706325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.706350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.706483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.706597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.706623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.706786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.706888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.706914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc188000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.707071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.707177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.707205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.707313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.707451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.707477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.707586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.707703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.707728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.707829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.707946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.707970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.708078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.708235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.708261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.708368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.708481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.708506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.708608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.708723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.708750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.708881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.708995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.709020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.709138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.709279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.709304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.709442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.709544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.709569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.709693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.709801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.709826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.709953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.710065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.710089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.710189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.710328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.710352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.710462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.710590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.710622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.710742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.710853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.710878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.711002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.711110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.711134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.711278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.711372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.711404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.711543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.711666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.711701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 15:51:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.454 [2024-11-26 15:51:15.711834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.711947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 15:51:15 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:24.454 [2024-11-26 15:51:15.711973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.712073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 15:51:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.454 [2024-11-26 15:51:15.712174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 15:51:15 -- common/autotest_common.sh@10 -- # set +x 00:27:24.454 [2024-11-26 15:51:15.712204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.712323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.712467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.712504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.712664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.712808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.712847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.712983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.713115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-26 15:51:15.713148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc190000b90 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-26 15:51:15.713317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.713552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.713581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.713703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.713840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.713867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.713981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.714095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.714122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.714233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.714333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.714359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.714490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.714607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.714632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.714771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.714878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.714903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.715009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.715107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.715138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.715264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.715373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.715398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.715509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.715653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.715694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.715799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.715900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.715924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.716027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.716135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.716159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.716321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.716422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.716448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.716550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.716714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.716740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.716847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.716957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.716982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.717113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.717339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.717364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.717515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.717624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.717654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.717799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.717899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.717924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.718048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.718190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.718214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.718347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.718457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.718481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.718640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.718753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.718779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.718880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.718981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.719006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.719116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.719273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.719305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.719417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.719560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.719586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.719713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.719823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 15:51:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.455 [2024-11-26 15:51:15.719849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.719961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 15:51:15 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:24.455 [2024-11-26 15:51:15.720082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 15:51:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.455 [2024-11-26 15:51:15.720107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 15:51:15 -- common/autotest_common.sh@10 -- # set +x 00:27:24.455 [2024-11-26 15:51:15.720269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.720373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.720397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.720512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.720631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.720656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.720783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.720882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.720907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-26 15:51:15.721016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-26 15:51:15.721115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.721140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.721254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.721425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.721450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.721559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.721694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.721719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.721820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.721917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.721942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.722049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.722149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.722174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.722277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.722410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.722435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.722602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.722704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.722729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.722828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.722930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.722955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.723059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.723166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.723196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.723327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.723422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.723447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.723556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.723664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-26 15:51:15.723705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x164dcb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.723821] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:24.456 [2024-11-26 15:51:15.726261] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.456 [2024-11-26 15:51:15.726404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.456 [2024-11-26 15:51:15.726432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.456 [2024-11-26 15:51:15.726447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.456 [2024-11-26 15:51:15.726460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.456 [2024-11-26 15:51:15.726494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 15:51:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.456 15:51:15 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:24.456 15:51:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.456 15:51:15 -- common/autotest_common.sh@10 -- # set +x 00:27:24.456 15:51:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.456 15:51:15 -- host/target_disconnect.sh@58 -- # wait 986168 00:27:24.456 [2024-11-26 15:51:15.736118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.456 [2024-11-26 15:51:15.736239] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.456 [2024-11-26 15:51:15.736265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.456 [2024-11-26 15:51:15.736280] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.456 [2024-11-26 15:51:15.736292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.456 [2024-11-26 15:51:15.736320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.746110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.456 [2024-11-26 15:51:15.746215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.456 [2024-11-26 15:51:15.746241] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.456 [2024-11-26 15:51:15.746255] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.456 [2024-11-26 15:51:15.746268] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.456 [2024-11-26 15:51:15.746302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.756204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.456 [2024-11-26 15:51:15.756327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.456 [2024-11-26 15:51:15.756363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.456 [2024-11-26 15:51:15.756377] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.456 [2024-11-26 15:51:15.756390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.456 [2024-11-26 15:51:15.756418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.766122] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.456 [2024-11-26 15:51:15.766230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.456 [2024-11-26 15:51:15.766256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.456 [2024-11-26 15:51:15.766270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.456 [2024-11-26 15:51:15.766283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.456 [2024-11-26 15:51:15.766310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.776146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.456 [2024-11-26 15:51:15.776250] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.456 [2024-11-26 15:51:15.776276] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.456 [2024-11-26 15:51:15.776290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.456 [2024-11-26 15:51:15.776302] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.456 [2024-11-26 15:51:15.776330] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.786211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.456 [2024-11-26 15:51:15.786319] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.456 [2024-11-26 15:51:15.786345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.456 [2024-11-26 15:51:15.786359] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.456 [2024-11-26 15:51:15.786371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.456 [2024-11-26 15:51:15.786400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-26 15:51:15.796176] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.456 [2024-11-26 15:51:15.796289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.456 [2024-11-26 15:51:15.796320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.456 [2024-11-26 15:51:15.796335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.456 [2024-11-26 15:51:15.796348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.456 [2024-11-26 15:51:15.796375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-26 15:51:15.806221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.457 [2024-11-26 15:51:15.806348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.457 [2024-11-26 15:51:15.806375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.457 [2024-11-26 15:51:15.806389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.457 [2024-11-26 15:51:15.806405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.457 [2024-11-26 15:51:15.806435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-26 15:51:15.816287] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.457 [2024-11-26 15:51:15.816395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.457 [2024-11-26 15:51:15.816421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.457 [2024-11-26 15:51:15.816435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.457 [2024-11-26 15:51:15.816447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.457 [2024-11-26 15:51:15.816475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-26 15:51:15.826254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.457 [2024-11-26 15:51:15.826358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.457 [2024-11-26 15:51:15.826384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.457 [2024-11-26 15:51:15.826398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.457 [2024-11-26 15:51:15.826411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.457 [2024-11-26 15:51:15.826439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-26 15:51:15.836347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.457 [2024-11-26 15:51:15.836502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.457 [2024-11-26 15:51:15.836527] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.457 [2024-11-26 15:51:15.836542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.457 [2024-11-26 15:51:15.836554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.457 [2024-11-26 15:51:15.836588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-26 15:51:15.846313] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.457 [2024-11-26 15:51:15.846425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.457 [2024-11-26 15:51:15.846451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.457 [2024-11-26 15:51:15.846464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.457 [2024-11-26 15:51:15.846477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.457 [2024-11-26 15:51:15.846505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-26 15:51:15.856345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.457 [2024-11-26 15:51:15.856457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.457 [2024-11-26 15:51:15.856482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.457 [2024-11-26 15:51:15.856495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.457 [2024-11-26 15:51:15.856508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.457 [2024-11-26 15:51:15.856536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.719 [2024-11-26 15:51:15.866361] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.719 [2024-11-26 15:51:15.866466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.719 [2024-11-26 15:51:15.866492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.719 [2024-11-26 15:51:15.866506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.719 [2024-11-26 15:51:15.866518] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.719 [2024-11-26 15:51:15.866547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.719 qpair failed and we were unable to recover it. 00:27:24.719 [2024-11-26 15:51:15.876546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.719 [2024-11-26 15:51:15.876668] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.719 [2024-11-26 15:51:15.876701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.719 [2024-11-26 15:51:15.876717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.719 [2024-11-26 15:51:15.876730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.719 [2024-11-26 15:51:15.876758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.719 qpair failed and we were unable to recover it. 00:27:24.719 [2024-11-26 15:51:15.886474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.719 [2024-11-26 15:51:15.886581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.719 [2024-11-26 15:51:15.886612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.719 [2024-11-26 15:51:15.886627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.719 [2024-11-26 15:51:15.886639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.719 [2024-11-26 15:51:15.886667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.719 qpair failed and we were unable to recover it. 00:27:24.719 [2024-11-26 15:51:15.896526] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.719 [2024-11-26 15:51:15.896636] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.719 [2024-11-26 15:51:15.896661] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.719 [2024-11-26 15:51:15.896674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.719 [2024-11-26 15:51:15.896695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.719 [2024-11-26 15:51:15.896725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.719 qpair failed and we were unable to recover it. 00:27:24.719 [2024-11-26 15:51:15.906535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.719 [2024-11-26 15:51:15.906639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.719 [2024-11-26 15:51:15.906665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.719 [2024-11-26 15:51:15.906679] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.719 [2024-11-26 15:51:15.906699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.719 [2024-11-26 15:51:15.906728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.719 qpair failed and we were unable to recover it. 00:27:24.719 [2024-11-26 15:51:15.916525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.719 [2024-11-26 15:51:15.916635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.719 [2024-11-26 15:51:15.916660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.719 [2024-11-26 15:51:15.916674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.719 [2024-11-26 15:51:15.916691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.719 [2024-11-26 15:51:15.916722] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.719 qpair failed and we were unable to recover it. 00:27:24.719 [2024-11-26 15:51:15.926539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.719 [2024-11-26 15:51:15.926671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.719 [2024-11-26 15:51:15.926706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.719 [2024-11-26 15:51:15.926721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.719 [2024-11-26 15:51:15.926749] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.719 [2024-11-26 15:51:15.926778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.719 qpair failed and we were unable to recover it. 00:27:24.719 [2024-11-26 15:51:15.936572] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.719 [2024-11-26 15:51:15.936679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.719 [2024-11-26 15:51:15.936712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.719 [2024-11-26 15:51:15.936726] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.719 [2024-11-26 15:51:15.936738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.719 [2024-11-26 15:51:15.936767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.719 qpair failed and we were unable to recover it. 00:27:24.719 [2024-11-26 15:51:15.946613] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.719 [2024-11-26 15:51:15.946742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.719 [2024-11-26 15:51:15.946768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.719 [2024-11-26 15:51:15.946782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.719 [2024-11-26 15:51:15.946795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.719 [2024-11-26 15:51:15.946823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.719 qpair failed and we were unable to recover it. 00:27:24.719 [2024-11-26 15:51:15.956647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.719 [2024-11-26 15:51:15.956765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.719 [2024-11-26 15:51:15.956790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.719 [2024-11-26 15:51:15.956804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.719 [2024-11-26 15:51:15.956816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.719 [2024-11-26 15:51:15.956845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.719 qpair failed and we were unable to recover it. 00:27:24.719 [2024-11-26 15:51:15.966662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.720 [2024-11-26 15:51:15.966771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.720 [2024-11-26 15:51:15.966796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.720 [2024-11-26 15:51:15.966810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.720 [2024-11-26 15:51:15.966823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.720 [2024-11-26 15:51:15.966851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.720 qpair failed and we were unable to recover it. 00:27:24.720 [2024-11-26 15:51:15.976696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.720 [2024-11-26 15:51:15.976807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.720 [2024-11-26 15:51:15.976833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.720 [2024-11-26 15:51:15.976846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.720 [2024-11-26 15:51:15.976859] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.720 [2024-11-26 15:51:15.976886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.720 qpair failed and we were unable to recover it. 00:27:24.720 [2024-11-26 15:51:15.986711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.720 [2024-11-26 15:51:15.986814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.720 [2024-11-26 15:51:15.986839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.720 [2024-11-26 15:51:15.986853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.720 [2024-11-26 15:51:15.986866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.720 [2024-11-26 15:51:15.986893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.720 qpair failed and we were unable to recover it. 00:27:24.720 [2024-11-26 15:51:15.996756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.720 [2024-11-26 15:51:15.996903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.720 [2024-11-26 15:51:15.996928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.720 [2024-11-26 15:51:15.996942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.720 [2024-11-26 15:51:15.996954] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.720 [2024-11-26 15:51:15.996982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.720 qpair failed and we were unable to recover it. 00:27:24.720 [2024-11-26 15:51:16.006808] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.720 [2024-11-26 15:51:16.006920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.720 [2024-11-26 15:51:16.006946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.720 [2024-11-26 15:51:16.006960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.720 [2024-11-26 15:51:16.006972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.720 [2024-11-26 15:51:16.007000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.720 qpair failed and we were unable to recover it. 00:27:24.720 [2024-11-26 15:51:16.016798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.720 [2024-11-26 15:51:16.016909] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.720 [2024-11-26 15:51:16.016934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.720 [2024-11-26 15:51:16.016948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.720 [2024-11-26 15:51:16.016966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.720 [2024-11-26 15:51:16.016995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.720 qpair failed and we were unable to recover it. 00:27:24.720 [2024-11-26 15:51:16.026853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.720 [2024-11-26 15:51:16.026956] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.720 [2024-11-26 15:51:16.026981] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.720 [2024-11-26 15:51:16.026994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.720 [2024-11-26 15:51:16.027007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.720 [2024-11-26 15:51:16.027035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.720 qpair failed and we were unable to recover it. 00:27:24.720 [2024-11-26 15:51:16.036911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.720 [2024-11-26 15:51:16.037036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.720 [2024-11-26 15:51:16.037063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.720 [2024-11-26 15:51:16.037077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.720 [2024-11-26 15:51:16.037093] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.720 [2024-11-26 15:51:16.037123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.720 qpair failed and we were unable to recover it. 00:27:24.720 [2024-11-26 15:51:16.046937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.720 [2024-11-26 15:51:16.047079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.720 [2024-11-26 15:51:16.047105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.720 [2024-11-26 15:51:16.047118] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.720 [2024-11-26 15:51:16.047130] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.720 [2024-11-26 15:51:16.047159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.720 qpair failed and we were unable to recover it. 00:27:24.720 [2024-11-26 15:51:16.056927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.720 [2024-11-26 15:51:16.057029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.720 [2024-11-26 15:51:16.057055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.720 [2024-11-26 15:51:16.057069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.720 [2024-11-26 15:51:16.057081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.720 [2024-11-26 15:51:16.057108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.720 qpair failed and we were unable to recover it. 00:27:24.720 [2024-11-26 15:51:16.066971] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.720 [2024-11-26 15:51:16.067082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.720 [2024-11-26 15:51:16.067107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.720 [2024-11-26 15:51:16.067121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.720 [2024-11-26 15:51:16.067133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.720 [2024-11-26 15:51:16.067161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.720 qpair failed and we were unable to recover it. 00:27:24.720 [2024-11-26 15:51:16.077027] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.720 [2024-11-26 15:51:16.077139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.720 [2024-11-26 15:51:16.077165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.720 [2024-11-26 15:51:16.077178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.720 [2024-11-26 15:51:16.077191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.720 [2024-11-26 15:51:16.077219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.720 qpair failed and we were unable to recover it. 00:27:24.720 [2024-11-26 15:51:16.087034] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.720 [2024-11-26 15:51:16.087141] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.720 [2024-11-26 15:51:16.087167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.720 [2024-11-26 15:51:16.087181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.720 [2024-11-26 15:51:16.087193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.720 [2024-11-26 15:51:16.087221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.720 qpair failed and we were unable to recover it. 00:27:24.720 [2024-11-26 15:51:16.097049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.720 [2024-11-26 15:51:16.097152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.720 [2024-11-26 15:51:16.097179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.720 [2024-11-26 15:51:16.097193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.721 [2024-11-26 15:51:16.097205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.721 [2024-11-26 15:51:16.097235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.721 qpair failed and we were unable to recover it. 00:27:24.721 [2024-11-26 15:51:16.107059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.721 [2024-11-26 15:51:16.107168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.721 [2024-11-26 15:51:16.107194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.721 [2024-11-26 15:51:16.107208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.721 [2024-11-26 15:51:16.107226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.721 [2024-11-26 15:51:16.107255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.721 qpair failed and we were unable to recover it. 00:27:24.721 [2024-11-26 15:51:16.117121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.721 [2024-11-26 15:51:16.117231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.721 [2024-11-26 15:51:16.117256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.721 [2024-11-26 15:51:16.117270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.721 [2024-11-26 15:51:16.117282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.721 [2024-11-26 15:51:16.117310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.721 qpair failed and we were unable to recover it. 00:27:24.721 [2024-11-26 15:51:16.127108] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.721 [2024-11-26 15:51:16.127216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.721 [2024-11-26 15:51:16.127242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.721 [2024-11-26 15:51:16.127256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.721 [2024-11-26 15:51:16.127269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.721 [2024-11-26 15:51:16.127296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.721 qpair failed and we were unable to recover it. 00:27:24.721 [2024-11-26 15:51:16.137176] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.721 [2024-11-26 15:51:16.137285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.721 [2024-11-26 15:51:16.137311] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.721 [2024-11-26 15:51:16.137324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.721 [2024-11-26 15:51:16.137336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.721 [2024-11-26 15:51:16.137364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.721 qpair failed and we were unable to recover it. 00:27:24.721 [2024-11-26 15:51:16.147168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.721 [2024-11-26 15:51:16.147274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.721 [2024-11-26 15:51:16.147299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.721 [2024-11-26 15:51:16.147313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.721 [2024-11-26 15:51:16.147325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.721 [2024-11-26 15:51:16.147353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.721 qpair failed and we were unable to recover it. 00:27:24.721 [2024-11-26 15:51:16.157266] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.721 [2024-11-26 15:51:16.157382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.721 [2024-11-26 15:51:16.157407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.721 [2024-11-26 15:51:16.157420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.721 [2024-11-26 15:51:16.157432] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.721 [2024-11-26 15:51:16.157460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.721 qpair failed and we were unable to recover it. 00:27:24.983 [2024-11-26 15:51:16.167263] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.983 [2024-11-26 15:51:16.167367] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.983 [2024-11-26 15:51:16.167393] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.983 [2024-11-26 15:51:16.167407] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.983 [2024-11-26 15:51:16.167419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.983 [2024-11-26 15:51:16.167447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.983 qpair failed and we were unable to recover it. 00:27:24.983 [2024-11-26 15:51:16.177302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.983 [2024-11-26 15:51:16.177417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.983 [2024-11-26 15:51:16.177444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.983 [2024-11-26 15:51:16.177459] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.983 [2024-11-26 15:51:16.177471] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.983 [2024-11-26 15:51:16.177500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.983 qpair failed and we were unable to recover it. 00:27:24.983 [2024-11-26 15:51:16.187309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.983 [2024-11-26 15:51:16.187417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.983 [2024-11-26 15:51:16.187443] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.983 [2024-11-26 15:51:16.187458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.983 [2024-11-26 15:51:16.187470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.983 [2024-11-26 15:51:16.187499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.983 qpair failed and we were unable to recover it. 00:27:24.983 [2024-11-26 15:51:16.197372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.983 [2024-11-26 15:51:16.197518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.983 [2024-11-26 15:51:16.197544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.983 [2024-11-26 15:51:16.197558] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.983 [2024-11-26 15:51:16.197580] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.983 [2024-11-26 15:51:16.197611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.983 qpair failed and we were unable to recover it. 00:27:24.983 [2024-11-26 15:51:16.207383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.983 [2024-11-26 15:51:16.207504] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.983 [2024-11-26 15:51:16.207529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.983 [2024-11-26 15:51:16.207543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.983 [2024-11-26 15:51:16.207555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.983 [2024-11-26 15:51:16.207583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.983 qpair failed and we were unable to recover it. 00:27:24.983 [2024-11-26 15:51:16.217415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.984 [2024-11-26 15:51:16.217541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.984 [2024-11-26 15:51:16.217566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.984 [2024-11-26 15:51:16.217580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.984 [2024-11-26 15:51:16.217592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.984 [2024-11-26 15:51:16.217620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.984 qpair failed and we were unable to recover it. 00:27:24.984 [2024-11-26 15:51:16.227433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.984 [2024-11-26 15:51:16.227558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.984 [2024-11-26 15:51:16.227584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.984 [2024-11-26 15:51:16.227598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.984 [2024-11-26 15:51:16.227610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.984 [2024-11-26 15:51:16.227639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.984 qpair failed and we were unable to recover it. 00:27:24.984 [2024-11-26 15:51:16.237495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.984 [2024-11-26 15:51:16.237604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.984 [2024-11-26 15:51:16.237629] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.984 [2024-11-26 15:51:16.237643] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.984 [2024-11-26 15:51:16.237655] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.984 [2024-11-26 15:51:16.237683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.984 qpair failed and we were unable to recover it. 00:27:24.984 [2024-11-26 15:51:16.247489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.984 [2024-11-26 15:51:16.247593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.984 [2024-11-26 15:51:16.247619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.984 [2024-11-26 15:51:16.247633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.984 [2024-11-26 15:51:16.247645] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.984 [2024-11-26 15:51:16.247675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.984 qpair failed and we were unable to recover it. 00:27:24.984 [2024-11-26 15:51:16.257542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.984 [2024-11-26 15:51:16.257653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.984 [2024-11-26 15:51:16.257678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.984 [2024-11-26 15:51:16.257699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.984 [2024-11-26 15:51:16.257712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.984 [2024-11-26 15:51:16.257741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.984 qpair failed and we were unable to recover it. 00:27:24.984 [2024-11-26 15:51:16.267545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.984 [2024-11-26 15:51:16.267648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.984 [2024-11-26 15:51:16.267673] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.984 [2024-11-26 15:51:16.267694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.984 [2024-11-26 15:51:16.267708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.984 [2024-11-26 15:51:16.267737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.984 qpair failed and we were unable to recover it. 00:27:24.984 [2024-11-26 15:51:16.277653] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.984 [2024-11-26 15:51:16.277775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.984 [2024-11-26 15:51:16.277801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.984 [2024-11-26 15:51:16.277816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.984 [2024-11-26 15:51:16.277828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.984 [2024-11-26 15:51:16.277856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.984 qpair failed and we were unable to recover it. 00:27:24.984 [2024-11-26 15:51:16.287613] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.984 [2024-11-26 15:51:16.287768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.984 [2024-11-26 15:51:16.287795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.984 [2024-11-26 15:51:16.287815] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.984 [2024-11-26 15:51:16.287828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.984 [2024-11-26 15:51:16.287857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.984 qpair failed and we were unable to recover it. 00:27:24.984 [2024-11-26 15:51:16.297622] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.984 [2024-11-26 15:51:16.297740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.984 [2024-11-26 15:51:16.297765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.984 [2024-11-26 15:51:16.297779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.984 [2024-11-26 15:51:16.297791] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.984 [2024-11-26 15:51:16.297819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.984 qpair failed and we were unable to recover it. 00:27:24.984 [2024-11-26 15:51:16.307649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.984 [2024-11-26 15:51:16.307755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.984 [2024-11-26 15:51:16.307780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.984 [2024-11-26 15:51:16.307794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.984 [2024-11-26 15:51:16.307806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.984 [2024-11-26 15:51:16.307834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.984 qpair failed and we were unable to recover it. 00:27:24.984 [2024-11-26 15:51:16.317720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.984 [2024-11-26 15:51:16.317831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.984 [2024-11-26 15:51:16.317856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.984 [2024-11-26 15:51:16.317869] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.984 [2024-11-26 15:51:16.317882] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.984 [2024-11-26 15:51:16.317909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.984 qpair failed and we were unable to recover it. 00:27:24.984 [2024-11-26 15:51:16.327745] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.984 [2024-11-26 15:51:16.327867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.984 [2024-11-26 15:51:16.327891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.984 [2024-11-26 15:51:16.327905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.984 [2024-11-26 15:51:16.327917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.984 [2024-11-26 15:51:16.327945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.984 qpair failed and we were unable to recover it. 00:27:24.984 [2024-11-26 15:51:16.337772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.984 [2024-11-26 15:51:16.337875] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.984 [2024-11-26 15:51:16.337900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.984 [2024-11-26 15:51:16.337914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.984 [2024-11-26 15:51:16.337927] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.984 [2024-11-26 15:51:16.337954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.984 qpair failed and we were unable to recover it. 00:27:24.984 [2024-11-26 15:51:16.347777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.984 [2024-11-26 15:51:16.347880] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.984 [2024-11-26 15:51:16.347905] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.985 [2024-11-26 15:51:16.347919] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.985 [2024-11-26 15:51:16.347930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.985 [2024-11-26 15:51:16.347959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.985 qpair failed and we were unable to recover it. 00:27:24.985 [2024-11-26 15:51:16.357853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.985 [2024-11-26 15:51:16.357993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.985 [2024-11-26 15:51:16.358018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.985 [2024-11-26 15:51:16.358032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.985 [2024-11-26 15:51:16.358045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.985 [2024-11-26 15:51:16.358072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.985 qpair failed and we were unable to recover it. 00:27:24.985 [2024-11-26 15:51:16.367859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.985 [2024-11-26 15:51:16.367974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.985 [2024-11-26 15:51:16.367999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.985 [2024-11-26 15:51:16.368014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.985 [2024-11-26 15:51:16.368026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.985 [2024-11-26 15:51:16.368054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.985 qpair failed and we were unable to recover it. 00:27:24.985 [2024-11-26 15:51:16.377888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.985 [2024-11-26 15:51:16.378001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.985 [2024-11-26 15:51:16.378027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.985 [2024-11-26 15:51:16.378047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.985 [2024-11-26 15:51:16.378061] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.985 [2024-11-26 15:51:16.378091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.985 qpair failed and we were unable to recover it. 00:27:24.985 [2024-11-26 15:51:16.387916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.985 [2024-11-26 15:51:16.388018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.985 [2024-11-26 15:51:16.388044] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.985 [2024-11-26 15:51:16.388058] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.985 [2024-11-26 15:51:16.388070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.985 [2024-11-26 15:51:16.388098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.985 qpair failed and we were unable to recover it. 00:27:24.985 [2024-11-26 15:51:16.397953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.985 [2024-11-26 15:51:16.398094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.985 [2024-11-26 15:51:16.398119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.985 [2024-11-26 15:51:16.398133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.985 [2024-11-26 15:51:16.398146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.985 [2024-11-26 15:51:16.398173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.985 qpair failed and we were unable to recover it. 00:27:24.985 [2024-11-26 15:51:16.407940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.985 [2024-11-26 15:51:16.408053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.985 [2024-11-26 15:51:16.408079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.985 [2024-11-26 15:51:16.408093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.985 [2024-11-26 15:51:16.408106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.985 [2024-11-26 15:51:16.408134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.985 qpair failed and we were unable to recover it. 00:27:24.985 [2024-11-26 15:51:16.417984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.985 [2024-11-26 15:51:16.418087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.985 [2024-11-26 15:51:16.418112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.985 [2024-11-26 15:51:16.418125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.985 [2024-11-26 15:51:16.418137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.985 [2024-11-26 15:51:16.418165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.985 qpair failed and we were unable to recover it. 00:27:24.985 [2024-11-26 15:51:16.428023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.985 [2024-11-26 15:51:16.428131] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.985 [2024-11-26 15:51:16.428157] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.985 [2024-11-26 15:51:16.428172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.985 [2024-11-26 15:51:16.428184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:24.985 [2024-11-26 15:51:16.428212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:24.985 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-26 15:51:16.438084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.248 [2024-11-26 15:51:16.438197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.248 [2024-11-26 15:51:16.438222] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.248 [2024-11-26 15:51:16.438237] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.248 [2024-11-26 15:51:16.438249] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.248 [2024-11-26 15:51:16.438277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-26 15:51:16.448101] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.248 [2024-11-26 15:51:16.448222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.248 [2024-11-26 15:51:16.448248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.248 [2024-11-26 15:51:16.448262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.248 [2024-11-26 15:51:16.448274] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.248 [2024-11-26 15:51:16.448301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-26 15:51:16.458114] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.248 [2024-11-26 15:51:16.458217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.248 [2024-11-26 15:51:16.458242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.248 [2024-11-26 15:51:16.458256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.248 [2024-11-26 15:51:16.458269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.248 [2024-11-26 15:51:16.458296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-26 15:51:16.468182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.248 [2024-11-26 15:51:16.468285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.248 [2024-11-26 15:51:16.468310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.248 [2024-11-26 15:51:16.468330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.248 [2024-11-26 15:51:16.468344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.248 [2024-11-26 15:51:16.468372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-26 15:51:16.478214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.248 [2024-11-26 15:51:16.478339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.248 [2024-11-26 15:51:16.478364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.248 [2024-11-26 15:51:16.478378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.248 [2024-11-26 15:51:16.478390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.248 [2024-11-26 15:51:16.478418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-26 15:51:16.488234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.248 [2024-11-26 15:51:16.488351] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.248 [2024-11-26 15:51:16.488377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.248 [2024-11-26 15:51:16.488391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.248 [2024-11-26 15:51:16.488403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.248 [2024-11-26 15:51:16.488431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-26 15:51:16.498255] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.248 [2024-11-26 15:51:16.498361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.248 [2024-11-26 15:51:16.498387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.248 [2024-11-26 15:51:16.498401] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.248 [2024-11-26 15:51:16.498414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.248 [2024-11-26 15:51:16.498444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-26 15:51:16.508267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.248 [2024-11-26 15:51:16.508372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.248 [2024-11-26 15:51:16.508398] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.248 [2024-11-26 15:51:16.508412] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.248 [2024-11-26 15:51:16.508425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.248 [2024-11-26 15:51:16.508455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-26 15:51:16.518282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.248 [2024-11-26 15:51:16.518390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.248 [2024-11-26 15:51:16.518416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.248 [2024-11-26 15:51:16.518430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.248 [2024-11-26 15:51:16.518443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.248 [2024-11-26 15:51:16.518471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-26 15:51:16.528334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.248 [2024-11-26 15:51:16.528489] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.248 [2024-11-26 15:51:16.528514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.248 [2024-11-26 15:51:16.528528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.248 [2024-11-26 15:51:16.528541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.248 [2024-11-26 15:51:16.528568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.248 qpair failed and we were unable to recover it. 00:27:25.248 [2024-11-26 15:51:16.538377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.248 [2024-11-26 15:51:16.538525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.249 [2024-11-26 15:51:16.538551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.249 [2024-11-26 15:51:16.538565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.249 [2024-11-26 15:51:16.538577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.249 [2024-11-26 15:51:16.538605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-26 15:51:16.548388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.249 [2024-11-26 15:51:16.548495] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.249 [2024-11-26 15:51:16.548526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.249 [2024-11-26 15:51:16.548542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.249 [2024-11-26 15:51:16.548555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.249 [2024-11-26 15:51:16.548584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-26 15:51:16.558432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.249 [2024-11-26 15:51:16.558547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.249 [2024-11-26 15:51:16.558574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.249 [2024-11-26 15:51:16.558594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.249 [2024-11-26 15:51:16.558608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.249 [2024-11-26 15:51:16.558637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-26 15:51:16.568439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.249 [2024-11-26 15:51:16.568550] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.249 [2024-11-26 15:51:16.568575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.249 [2024-11-26 15:51:16.568590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.249 [2024-11-26 15:51:16.568603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.249 [2024-11-26 15:51:16.568631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-26 15:51:16.578448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.249 [2024-11-26 15:51:16.578554] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.249 [2024-11-26 15:51:16.578579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.249 [2024-11-26 15:51:16.578593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.249 [2024-11-26 15:51:16.578606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.249 [2024-11-26 15:51:16.578634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-26 15:51:16.588461] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.249 [2024-11-26 15:51:16.588563] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.249 [2024-11-26 15:51:16.588588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.249 [2024-11-26 15:51:16.588603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.249 [2024-11-26 15:51:16.588616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.249 [2024-11-26 15:51:16.588644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-26 15:51:16.598524] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.249 [2024-11-26 15:51:16.598640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.249 [2024-11-26 15:51:16.598665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.249 [2024-11-26 15:51:16.598679] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.249 [2024-11-26 15:51:16.598698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.249 [2024-11-26 15:51:16.598728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-26 15:51:16.608583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.249 [2024-11-26 15:51:16.608694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.249 [2024-11-26 15:51:16.608720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.249 [2024-11-26 15:51:16.608734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.249 [2024-11-26 15:51:16.608747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.249 [2024-11-26 15:51:16.608775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-26 15:51:16.618580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.249 [2024-11-26 15:51:16.618703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.249 [2024-11-26 15:51:16.618729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.249 [2024-11-26 15:51:16.618742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.249 [2024-11-26 15:51:16.618754] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.249 [2024-11-26 15:51:16.618783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-26 15:51:16.628593] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.249 [2024-11-26 15:51:16.628705] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.249 [2024-11-26 15:51:16.628731] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.249 [2024-11-26 15:51:16.628744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.249 [2024-11-26 15:51:16.628758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.249 [2024-11-26 15:51:16.628786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-26 15:51:16.638620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.249 [2024-11-26 15:51:16.638734] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.249 [2024-11-26 15:51:16.638759] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.249 [2024-11-26 15:51:16.638773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.249 [2024-11-26 15:51:16.638786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.249 [2024-11-26 15:51:16.638814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-26 15:51:16.648659] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.249 [2024-11-26 15:51:16.648771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.249 [2024-11-26 15:51:16.648801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.249 [2024-11-26 15:51:16.648816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.249 [2024-11-26 15:51:16.648828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.249 [2024-11-26 15:51:16.648857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-26 15:51:16.658711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.249 [2024-11-26 15:51:16.658811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.249 [2024-11-26 15:51:16.658836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.249 [2024-11-26 15:51:16.658850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.249 [2024-11-26 15:51:16.658862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.249 [2024-11-26 15:51:16.658890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.249 qpair failed and we were unable to recover it. 00:27:25.249 [2024-11-26 15:51:16.668755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.249 [2024-11-26 15:51:16.668860] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.249 [2024-11-26 15:51:16.668889] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.250 [2024-11-26 15:51:16.668903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.250 [2024-11-26 15:51:16.668916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.250 [2024-11-26 15:51:16.668944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-26 15:51:16.678742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.250 [2024-11-26 15:51:16.678850] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.250 [2024-11-26 15:51:16.678876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.250 [2024-11-26 15:51:16.678890] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.250 [2024-11-26 15:51:16.678903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.250 [2024-11-26 15:51:16.678931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.250 [2024-11-26 15:51:16.688800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.250 [2024-11-26 15:51:16.688915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.250 [2024-11-26 15:51:16.688940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.250 [2024-11-26 15:51:16.688954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.250 [2024-11-26 15:51:16.688966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.250 [2024-11-26 15:51:16.688994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.250 qpair failed and we were unable to recover it. 00:27:25.510 [2024-11-26 15:51:16.698872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.510 [2024-11-26 15:51:16.698978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.510 [2024-11-26 15:51:16.699002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.510 [2024-11-26 15:51:16.699015] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.510 [2024-11-26 15:51:16.699026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.510 [2024-11-26 15:51:16.699053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.510 qpair failed and we were unable to recover it. 00:27:25.510 [2024-11-26 15:51:16.708831] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.510 [2024-11-26 15:51:16.708932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.510 [2024-11-26 15:51:16.708957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.510 [2024-11-26 15:51:16.708971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.510 [2024-11-26 15:51:16.708983] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.510 [2024-11-26 15:51:16.709011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.510 qpair failed and we were unable to recover it. 00:27:25.510 [2024-11-26 15:51:16.718900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.510 [2024-11-26 15:51:16.719011] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.510 [2024-11-26 15:51:16.719036] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.510 [2024-11-26 15:51:16.719049] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.510 [2024-11-26 15:51:16.719062] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.510 [2024-11-26 15:51:16.719090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.510 qpair failed and we were unable to recover it. 00:27:25.510 [2024-11-26 15:51:16.728895] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.729002] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.729026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.729040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.729052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.729080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.738952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.739079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.739110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.739126] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.739139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.739166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.748955] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.749065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.749090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.749104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.749117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.749146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.758982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.759089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.759114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.759128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.759141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.759168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.769006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.769106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.769131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.769145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.769157] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.769185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.779023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.779127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.779153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.779166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.779178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.779213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.789078] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.789227] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.789253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.789268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.789284] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.789312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.799164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.799289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.799317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.799332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.799348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.799378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.809158] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.809274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.809299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.809313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.809325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.809353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.819155] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.819260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.819286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.819300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.819312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.819340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.829208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.829356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.829386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.829401] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.829413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.829441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.839225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.839378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.839403] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.839416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.839428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.839456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.849301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.849417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.849442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.849456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.849469] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.849498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.859293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.859393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.859419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.859433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.859445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.859472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.869323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.869436] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.869462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.869476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.869489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.869527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.879373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.879515] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.879542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.879560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.879575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.879604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.889370] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.889518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.889543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.889557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.889568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.889597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.899439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.899564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.899590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.899604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.899616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.899644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.909437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.909541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.909567] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.909581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.909593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.909621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.919527] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.919645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.919675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.919697] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.919710] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.919741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.929493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.929598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.929623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.929637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.929649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.929678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.939512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.939611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.939637] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.939651] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.939663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.939700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.511 [2024-11-26 15:51:16.949543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.511 [2024-11-26 15:51:16.949649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.511 [2024-11-26 15:51:16.949675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.511 [2024-11-26 15:51:16.949699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.511 [2024-11-26 15:51:16.949715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.511 [2024-11-26 15:51:16.949743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.511 qpair failed and we were unable to recover it. 00:27:25.771 [2024-11-26 15:51:16.959577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.771 [2024-11-26 15:51:16.959692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.771 [2024-11-26 15:51:16.959725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.771 [2024-11-26 15:51:16.959741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.771 [2024-11-26 15:51:16.959754] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.771 [2024-11-26 15:51:16.959788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.771 qpair failed and we were unable to recover it. 00:27:25.771 [2024-11-26 15:51:16.969615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.771 [2024-11-26 15:51:16.969743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.771 [2024-11-26 15:51:16.969768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.771 [2024-11-26 15:51:16.969782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.771 [2024-11-26 15:51:16.969794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.771 [2024-11-26 15:51:16.969822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.771 qpair failed and we were unable to recover it. 00:27:25.771 [2024-11-26 15:51:16.979638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.771 [2024-11-26 15:51:16.979757] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.771 [2024-11-26 15:51:16.979782] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.771 [2024-11-26 15:51:16.979796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.771 [2024-11-26 15:51:16.979809] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.771 [2024-11-26 15:51:16.979837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.771 qpair failed and we were unable to recover it. 00:27:25.771 [2024-11-26 15:51:16.989675] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.771 [2024-11-26 15:51:16.989790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.771 [2024-11-26 15:51:16.989815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.771 [2024-11-26 15:51:16.989829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.771 [2024-11-26 15:51:16.989842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.771 [2024-11-26 15:51:16.989869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.771 qpair failed and we were unable to recover it. 00:27:25.771 [2024-11-26 15:51:16.999735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.771 [2024-11-26 15:51:16.999848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.771 [2024-11-26 15:51:16.999873] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.771 [2024-11-26 15:51:16.999886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.771 [2024-11-26 15:51:16.999899] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.771 [2024-11-26 15:51:16.999926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.771 qpair failed and we were unable to recover it. 00:27:25.771 [2024-11-26 15:51:17.009723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.771 [2024-11-26 15:51:17.009831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.771 [2024-11-26 15:51:17.009861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.771 [2024-11-26 15:51:17.009876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.771 [2024-11-26 15:51:17.009888] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.771 [2024-11-26 15:51:17.009916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.771 qpair failed and we were unable to recover it. 00:27:25.771 [2024-11-26 15:51:17.019750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.771 [2024-11-26 15:51:17.019876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.771 [2024-11-26 15:51:17.019901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.771 [2024-11-26 15:51:17.019914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.771 [2024-11-26 15:51:17.019927] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.771 [2024-11-26 15:51:17.019955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.771 qpair failed and we were unable to recover it. 00:27:25.771 [2024-11-26 15:51:17.029791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.771 [2024-11-26 15:51:17.029912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.771 [2024-11-26 15:51:17.029940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.771 [2024-11-26 15:51:17.029954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.771 [2024-11-26 15:51:17.029966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.771 [2024-11-26 15:51:17.029994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.771 qpair failed and we were unable to recover it. 00:27:25.771 [2024-11-26 15:51:17.039807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.771 [2024-11-26 15:51:17.039924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.771 [2024-11-26 15:51:17.039949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.771 [2024-11-26 15:51:17.039963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.771 [2024-11-26 15:51:17.039975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.771 [2024-11-26 15:51:17.040003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.771 qpair failed and we were unable to recover it. 00:27:25.772 [2024-11-26 15:51:17.049826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.772 [2024-11-26 15:51:17.049926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.772 [2024-11-26 15:51:17.049951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.772 [2024-11-26 15:51:17.049965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.772 [2024-11-26 15:51:17.049978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.772 [2024-11-26 15:51:17.050012] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.772 qpair failed and we were unable to recover it. 00:27:25.772 [2024-11-26 15:51:17.059864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.772 [2024-11-26 15:51:17.060012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.772 [2024-11-26 15:51:17.060036] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.772 [2024-11-26 15:51:17.060050] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.772 [2024-11-26 15:51:17.060063] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.772 [2024-11-26 15:51:17.060091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.772 qpair failed and we were unable to recover it. 00:27:25.772 [2024-11-26 15:51:17.069909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.772 [2024-11-26 15:51:17.070052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.772 [2024-11-26 15:51:17.070078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.772 [2024-11-26 15:51:17.070091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.772 [2024-11-26 15:51:17.070104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.772 [2024-11-26 15:51:17.070132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.772 qpair failed and we were unable to recover it. 00:27:25.772 [2024-11-26 15:51:17.079927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.772 [2024-11-26 15:51:17.080033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.772 [2024-11-26 15:51:17.080059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.772 [2024-11-26 15:51:17.080072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.772 [2024-11-26 15:51:17.080085] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.772 [2024-11-26 15:51:17.080112] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.772 qpair failed and we were unable to recover it. 00:27:25.772 [2024-11-26 15:51:17.089983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.772 [2024-11-26 15:51:17.090087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.772 [2024-11-26 15:51:17.090112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.772 [2024-11-26 15:51:17.090126] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.772 [2024-11-26 15:51:17.090139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.772 [2024-11-26 15:51:17.090167] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.772 qpair failed and we were unable to recover it. 00:27:25.772 [2024-11-26 15:51:17.099968] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.772 [2024-11-26 15:51:17.100075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.772 [2024-11-26 15:51:17.100104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.772 [2024-11-26 15:51:17.100120] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.772 [2024-11-26 15:51:17.100133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.772 [2024-11-26 15:51:17.100161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.772 qpair failed and we were unable to recover it. 00:27:25.772 [2024-11-26 15:51:17.109991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.772 [2024-11-26 15:51:17.110094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.772 [2024-11-26 15:51:17.110119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.772 [2024-11-26 15:51:17.110133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.772 [2024-11-26 15:51:17.110146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.772 [2024-11-26 15:51:17.110174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.772 qpair failed and we were unable to recover it. 00:27:25.772 [2024-11-26 15:51:17.120065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.772 [2024-11-26 15:51:17.120182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.772 [2024-11-26 15:51:17.120208] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.772 [2024-11-26 15:51:17.120222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.772 [2024-11-26 15:51:17.120235] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.772 [2024-11-26 15:51:17.120263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.772 qpair failed and we were unable to recover it. 00:27:25.772 [2024-11-26 15:51:17.130053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.772 [2024-11-26 15:51:17.130184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.772 [2024-11-26 15:51:17.130210] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.772 [2024-11-26 15:51:17.130224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.772 [2024-11-26 15:51:17.130236] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.772 [2024-11-26 15:51:17.130264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.772 qpair failed and we were unable to recover it. 00:27:25.772 [2024-11-26 15:51:17.140089] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.772 [2024-11-26 15:51:17.140194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.772 [2024-11-26 15:51:17.140219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.772 [2024-11-26 15:51:17.140233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.772 [2024-11-26 15:51:17.140251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.772 [2024-11-26 15:51:17.140280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.772 qpair failed and we were unable to recover it. 00:27:25.772 [2024-11-26 15:51:17.150162] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.772 [2024-11-26 15:51:17.150312] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.772 [2024-11-26 15:51:17.150337] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.772 [2024-11-26 15:51:17.150351] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.772 [2024-11-26 15:51:17.150364] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.772 [2024-11-26 15:51:17.150392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.772 qpair failed and we were unable to recover it. 00:27:25.772 [2024-11-26 15:51:17.160206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.772 [2024-11-26 15:51:17.160317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.772 [2024-11-26 15:51:17.160342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.772 [2024-11-26 15:51:17.160356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.772 [2024-11-26 15:51:17.160369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.772 [2024-11-26 15:51:17.160396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.772 qpair failed and we were unable to recover it. 00:27:25.772 [2024-11-26 15:51:17.170198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.772 [2024-11-26 15:51:17.170329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.772 [2024-11-26 15:51:17.170355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.772 [2024-11-26 15:51:17.170369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.772 [2024-11-26 15:51:17.170381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.772 [2024-11-26 15:51:17.170409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.772 qpair failed and we were unable to recover it. 00:27:25.772 [2024-11-26 15:51:17.180228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.773 [2024-11-26 15:51:17.180338] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.773 [2024-11-26 15:51:17.180363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.773 [2024-11-26 15:51:17.180376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.773 [2024-11-26 15:51:17.180389] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.773 [2024-11-26 15:51:17.180417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.773 qpair failed and we were unable to recover it. 00:27:25.773 [2024-11-26 15:51:17.190291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.773 [2024-11-26 15:51:17.190435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.773 [2024-11-26 15:51:17.190463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.773 [2024-11-26 15:51:17.190477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.773 [2024-11-26 15:51:17.190490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.773 [2024-11-26 15:51:17.190518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.773 qpair failed and we were unable to recover it. 00:27:25.773 [2024-11-26 15:51:17.200307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.773 [2024-11-26 15:51:17.200464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.773 [2024-11-26 15:51:17.200490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.773 [2024-11-26 15:51:17.200503] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.773 [2024-11-26 15:51:17.200516] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.773 [2024-11-26 15:51:17.200543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.773 qpair failed and we were unable to recover it. 00:27:25.773 [2024-11-26 15:51:17.210338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.773 [2024-11-26 15:51:17.210490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.773 [2024-11-26 15:51:17.210515] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.773 [2024-11-26 15:51:17.210529] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.773 [2024-11-26 15:51:17.210541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:25.773 [2024-11-26 15:51:17.210569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:25.773 qpair failed and we were unable to recover it. 00:27:26.032 [2024-11-26 15:51:17.220377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.032 [2024-11-26 15:51:17.220500] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.032 [2024-11-26 15:51:17.220526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.032 [2024-11-26 15:51:17.220540] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.032 [2024-11-26 15:51:17.220553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.032 [2024-11-26 15:51:17.220581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.032 qpair failed and we were unable to recover it. 00:27:26.032 [2024-11-26 15:51:17.230414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.032 [2024-11-26 15:51:17.230558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.032 [2024-11-26 15:51:17.230584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.032 [2024-11-26 15:51:17.230598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.032 [2024-11-26 15:51:17.230617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.032 [2024-11-26 15:51:17.230647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.032 qpair failed and we were unable to recover it. 00:27:26.032 [2024-11-26 15:51:17.240437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.032 [2024-11-26 15:51:17.240555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.032 [2024-11-26 15:51:17.240580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.032 [2024-11-26 15:51:17.240594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.032 [2024-11-26 15:51:17.240606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.032 [2024-11-26 15:51:17.240633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.032 qpair failed and we were unable to recover it. 00:27:26.032 [2024-11-26 15:51:17.250448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.032 [2024-11-26 15:51:17.250554] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.032 [2024-11-26 15:51:17.250580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.032 [2024-11-26 15:51:17.250594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.032 [2024-11-26 15:51:17.250607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.032 [2024-11-26 15:51:17.250634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.032 qpair failed and we were unable to recover it. 00:27:26.032 [2024-11-26 15:51:17.260464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.032 [2024-11-26 15:51:17.260568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.032 [2024-11-26 15:51:17.260593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.032 [2024-11-26 15:51:17.260606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.032 [2024-11-26 15:51:17.260619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.032 [2024-11-26 15:51:17.260647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.032 qpair failed and we were unable to recover it. 00:27:26.032 [2024-11-26 15:51:17.270517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.032 [2024-11-26 15:51:17.270626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.032 [2024-11-26 15:51:17.270652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.032 [2024-11-26 15:51:17.270666] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.032 [2024-11-26 15:51:17.270679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.032 [2024-11-26 15:51:17.270714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.032 qpair failed and we were unable to recover it. 00:27:26.032 [2024-11-26 15:51:17.280527] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.032 [2024-11-26 15:51:17.280638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.032 [2024-11-26 15:51:17.280663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.032 [2024-11-26 15:51:17.280677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.032 [2024-11-26 15:51:17.280701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.033 [2024-11-26 15:51:17.280730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.033 qpair failed and we were unable to recover it. 00:27:26.033 [2024-11-26 15:51:17.290593] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.033 [2024-11-26 15:51:17.290704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.033 [2024-11-26 15:51:17.290729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.033 [2024-11-26 15:51:17.290743] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.033 [2024-11-26 15:51:17.290755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.033 [2024-11-26 15:51:17.290784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.033 qpair failed and we were unable to recover it. 00:27:26.033 [2024-11-26 15:51:17.300573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.033 [2024-11-26 15:51:17.300679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.033 [2024-11-26 15:51:17.300711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.033 [2024-11-26 15:51:17.300726] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.033 [2024-11-26 15:51:17.300738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.033 [2024-11-26 15:51:17.300766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.033 qpair failed and we were unable to recover it. 00:27:26.033 [2024-11-26 15:51:17.310612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.033 [2024-11-26 15:51:17.310723] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.033 [2024-11-26 15:51:17.310750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.033 [2024-11-26 15:51:17.310764] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.033 [2024-11-26 15:51:17.310775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.033 [2024-11-26 15:51:17.310804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.033 qpair failed and we were unable to recover it. 00:27:26.033 [2024-11-26 15:51:17.320637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.033 [2024-11-26 15:51:17.320749] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.033 [2024-11-26 15:51:17.320774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.033 [2024-11-26 15:51:17.320788] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.033 [2024-11-26 15:51:17.320806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.033 [2024-11-26 15:51:17.320835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.033 qpair failed and we were unable to recover it. 00:27:26.033 [2024-11-26 15:51:17.330720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.033 [2024-11-26 15:51:17.330834] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.033 [2024-11-26 15:51:17.330859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.033 [2024-11-26 15:51:17.330872] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.033 [2024-11-26 15:51:17.330885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.033 [2024-11-26 15:51:17.330913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.033 qpair failed and we were unable to recover it. 00:27:26.033 [2024-11-26 15:51:17.340704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.033 [2024-11-26 15:51:17.340808] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.033 [2024-11-26 15:51:17.340833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.033 [2024-11-26 15:51:17.340847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.033 [2024-11-26 15:51:17.340860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.033 [2024-11-26 15:51:17.340887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.033 qpair failed and we were unable to recover it. 00:27:26.033 [2024-11-26 15:51:17.350741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.033 [2024-11-26 15:51:17.350842] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.033 [2024-11-26 15:51:17.350867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.033 [2024-11-26 15:51:17.350882] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.033 [2024-11-26 15:51:17.350894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.033 [2024-11-26 15:51:17.350923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.033 qpair failed and we were unable to recover it. 00:27:26.033 [2024-11-26 15:51:17.360775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.033 [2024-11-26 15:51:17.360931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.033 [2024-11-26 15:51:17.360956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.033 [2024-11-26 15:51:17.360970] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.033 [2024-11-26 15:51:17.360983] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.033 [2024-11-26 15:51:17.361010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.033 qpair failed and we were unable to recover it. 00:27:26.033 [2024-11-26 15:51:17.370793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.033 [2024-11-26 15:51:17.370903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.033 [2024-11-26 15:51:17.370929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.033 [2024-11-26 15:51:17.370942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.033 [2024-11-26 15:51:17.370956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.033 [2024-11-26 15:51:17.370984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.033 qpair failed and we were unable to recover it. 00:27:26.033 [2024-11-26 15:51:17.380825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.033 [2024-11-26 15:51:17.380974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.033 [2024-11-26 15:51:17.380999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.033 [2024-11-26 15:51:17.381013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.033 [2024-11-26 15:51:17.381026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.033 [2024-11-26 15:51:17.381053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.033 qpair failed and we were unable to recover it. 00:27:26.033 [2024-11-26 15:51:17.390892] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.033 [2024-11-26 15:51:17.390996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.033 [2024-11-26 15:51:17.391021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.033 [2024-11-26 15:51:17.391035] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.033 [2024-11-26 15:51:17.391047] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.033 [2024-11-26 15:51:17.391074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.033 qpair failed and we were unable to recover it. 00:27:26.033 [2024-11-26 15:51:17.400915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.033 [2024-11-26 15:51:17.401030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.033 [2024-11-26 15:51:17.401055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.033 [2024-11-26 15:51:17.401069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.033 [2024-11-26 15:51:17.401082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.033 [2024-11-26 15:51:17.401110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.033 qpair failed and we were unable to recover it. 00:27:26.033 [2024-11-26 15:51:17.410947] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.033 [2024-11-26 15:51:17.411052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.033 [2024-11-26 15:51:17.411081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.033 [2024-11-26 15:51:17.411095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.033 [2024-11-26 15:51:17.411112] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.033 [2024-11-26 15:51:17.411141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.033 qpair failed and we were unable to recover it. 00:27:26.033 [2024-11-26 15:51:17.420968] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.034 [2024-11-26 15:51:17.421090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.034 [2024-11-26 15:51:17.421117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.034 [2024-11-26 15:51:17.421131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.034 [2024-11-26 15:51:17.421144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.034 [2024-11-26 15:51:17.421172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.034 qpair failed and we were unable to recover it. 00:27:26.034 [2024-11-26 15:51:17.430975] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.034 [2024-11-26 15:51:17.431114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.034 [2024-11-26 15:51:17.431140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.034 [2024-11-26 15:51:17.431155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.034 [2024-11-26 15:51:17.431167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.034 [2024-11-26 15:51:17.431197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.034 qpair failed and we were unable to recover it. 00:27:26.034 [2024-11-26 15:51:17.441069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.034 [2024-11-26 15:51:17.441210] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.034 [2024-11-26 15:51:17.441235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.034 [2024-11-26 15:51:17.441249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.034 [2024-11-26 15:51:17.441261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.034 [2024-11-26 15:51:17.441289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.034 qpair failed and we were unable to recover it. 00:27:26.034 [2024-11-26 15:51:17.451042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.034 [2024-11-26 15:51:17.451152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.034 [2024-11-26 15:51:17.451177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.034 [2024-11-26 15:51:17.451191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.034 [2024-11-26 15:51:17.451203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.034 [2024-11-26 15:51:17.451231] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.034 qpair failed and we were unable to recover it. 00:27:26.034 [2024-11-26 15:51:17.461069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.034 [2024-11-26 15:51:17.461182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.034 [2024-11-26 15:51:17.461207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.034 [2024-11-26 15:51:17.461221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.034 [2024-11-26 15:51:17.461233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.034 [2024-11-26 15:51:17.461261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.034 qpair failed and we were unable to recover it. 00:27:26.034 [2024-11-26 15:51:17.471079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.034 [2024-11-26 15:51:17.471180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.034 [2024-11-26 15:51:17.471206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.034 [2024-11-26 15:51:17.471220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.034 [2024-11-26 15:51:17.471232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.034 [2024-11-26 15:51:17.471260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.034 qpair failed and we were unable to recover it. 00:27:26.293 [2024-11-26 15:51:17.481185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.293 [2024-11-26 15:51:17.481333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.293 [2024-11-26 15:51:17.481359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.293 [2024-11-26 15:51:17.481373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.293 [2024-11-26 15:51:17.481385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.293 [2024-11-26 15:51:17.481413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.293 qpair failed and we were unable to recover it. 00:27:26.293 [2024-11-26 15:51:17.491158] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.293 [2024-11-26 15:51:17.491291] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.293 [2024-11-26 15:51:17.491317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.293 [2024-11-26 15:51:17.491330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.293 [2024-11-26 15:51:17.491342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.293 [2024-11-26 15:51:17.491370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.293 qpair failed and we were unable to recover it. 00:27:26.293 [2024-11-26 15:51:17.501186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.293 [2024-11-26 15:51:17.501293] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.293 [2024-11-26 15:51:17.501318] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.293 [2024-11-26 15:51:17.501341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.293 [2024-11-26 15:51:17.501355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.293 [2024-11-26 15:51:17.501382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.293 qpair failed and we were unable to recover it. 00:27:26.293 [2024-11-26 15:51:17.511224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.293 [2024-11-26 15:51:17.511360] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.293 [2024-11-26 15:51:17.511385] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.293 [2024-11-26 15:51:17.511400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.293 [2024-11-26 15:51:17.511412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.293 [2024-11-26 15:51:17.511440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.293 qpair failed and we were unable to recover it. 00:27:26.293 [2024-11-26 15:51:17.521223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.293 [2024-11-26 15:51:17.521328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.293 [2024-11-26 15:51:17.521354] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.293 [2024-11-26 15:51:17.521368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.293 [2024-11-26 15:51:17.521380] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.293 [2024-11-26 15:51:17.521408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.293 qpair failed and we were unable to recover it. 00:27:26.293 [2024-11-26 15:51:17.531254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.293 [2024-11-26 15:51:17.531361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.293 [2024-11-26 15:51:17.531386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.293 [2024-11-26 15:51:17.531400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.293 [2024-11-26 15:51:17.531412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.293 [2024-11-26 15:51:17.531440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.293 qpair failed and we were unable to recover it. 00:27:26.293 [2024-11-26 15:51:17.541278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.293 [2024-11-26 15:51:17.541384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.293 [2024-11-26 15:51:17.541410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.293 [2024-11-26 15:51:17.541424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.293 [2024-11-26 15:51:17.541437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.293 [2024-11-26 15:51:17.541464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.293 qpair failed and we were unable to recover it. 00:27:26.293 [2024-11-26 15:51:17.551320] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.293 [2024-11-26 15:51:17.551424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.293 [2024-11-26 15:51:17.551449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.293 [2024-11-26 15:51:17.551463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.293 [2024-11-26 15:51:17.551476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.293 [2024-11-26 15:51:17.551504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.293 qpair failed and we were unable to recover it. 00:27:26.293 [2024-11-26 15:51:17.561395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.294 [2024-11-26 15:51:17.561511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.294 [2024-11-26 15:51:17.561537] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.294 [2024-11-26 15:51:17.561550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.294 [2024-11-26 15:51:17.561562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.294 [2024-11-26 15:51:17.561590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.294 qpair failed and we were unable to recover it. 00:27:26.294 [2024-11-26 15:51:17.571381] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.294 [2024-11-26 15:51:17.571497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.294 [2024-11-26 15:51:17.571522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.294 [2024-11-26 15:51:17.571536] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.294 [2024-11-26 15:51:17.571548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.294 [2024-11-26 15:51:17.571576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.294 qpair failed and we were unable to recover it. 00:27:26.294 [2024-11-26 15:51:17.581436] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.294 [2024-11-26 15:51:17.581541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.294 [2024-11-26 15:51:17.581566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.294 [2024-11-26 15:51:17.581580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.294 [2024-11-26 15:51:17.581592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.294 [2024-11-26 15:51:17.581620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.294 qpair failed and we were unable to recover it. 00:27:26.294 [2024-11-26 15:51:17.591425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.294 [2024-11-26 15:51:17.591541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.294 [2024-11-26 15:51:17.591567] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.294 [2024-11-26 15:51:17.591587] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.294 [2024-11-26 15:51:17.591601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.294 [2024-11-26 15:51:17.591629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.294 qpair failed and we were unable to recover it. 00:27:26.294 [2024-11-26 15:51:17.601451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.294 [2024-11-26 15:51:17.601559] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.294 [2024-11-26 15:51:17.601584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.294 [2024-11-26 15:51:17.601598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.294 [2024-11-26 15:51:17.601611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.294 [2024-11-26 15:51:17.601638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.294 qpair failed and we were unable to recover it. 00:27:26.294 [2024-11-26 15:51:17.611485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.294 [2024-11-26 15:51:17.611589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.294 [2024-11-26 15:51:17.611614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.294 [2024-11-26 15:51:17.611628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.294 [2024-11-26 15:51:17.611641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.294 [2024-11-26 15:51:17.611668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.294 qpair failed and we were unable to recover it. 00:27:26.294 [2024-11-26 15:51:17.621530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.294 [2024-11-26 15:51:17.621648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.294 [2024-11-26 15:51:17.621674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.294 [2024-11-26 15:51:17.621695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.294 [2024-11-26 15:51:17.621709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.294 [2024-11-26 15:51:17.621737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.294 qpair failed and we were unable to recover it. 00:27:26.294 [2024-11-26 15:51:17.631546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.294 [2024-11-26 15:51:17.631660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.294 [2024-11-26 15:51:17.631697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.294 [2024-11-26 15:51:17.631714] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.294 [2024-11-26 15:51:17.631728] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.294 [2024-11-26 15:51:17.631757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.294 qpair failed and we were unable to recover it. 00:27:26.294 [2024-11-26 15:51:17.641580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.294 [2024-11-26 15:51:17.641710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.294 [2024-11-26 15:51:17.641736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.294 [2024-11-26 15:51:17.641749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.294 [2024-11-26 15:51:17.641762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.294 [2024-11-26 15:51:17.641792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.294 qpair failed and we were unable to recover it. 00:27:26.294 [2024-11-26 15:51:17.651690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.294 [2024-11-26 15:51:17.651801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.294 [2024-11-26 15:51:17.651827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.294 [2024-11-26 15:51:17.651841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.294 [2024-11-26 15:51:17.651856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.294 [2024-11-26 15:51:17.651885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.294 qpair failed and we were unable to recover it. 00:27:26.294 [2024-11-26 15:51:17.661605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.294 [2024-11-26 15:51:17.661709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.294 [2024-11-26 15:51:17.661735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.294 [2024-11-26 15:51:17.661750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.294 [2024-11-26 15:51:17.661764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.294 [2024-11-26 15:51:17.661792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.294 qpair failed and we were unable to recover it. 00:27:26.294 [2024-11-26 15:51:17.671650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.294 [2024-11-26 15:51:17.671761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.294 [2024-11-26 15:51:17.671787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.294 [2024-11-26 15:51:17.671801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.294 [2024-11-26 15:51:17.671814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.294 [2024-11-26 15:51:17.671845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.294 qpair failed and we were unable to recover it. 00:27:26.294 [2024-11-26 15:51:17.681776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.294 [2024-11-26 15:51:17.681908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.294 [2024-11-26 15:51:17.681933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.294 [2024-11-26 15:51:17.681956] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.294 [2024-11-26 15:51:17.681970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.294 [2024-11-26 15:51:17.681998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.294 qpair failed and we were unable to recover it. 00:27:26.294 [2024-11-26 15:51:17.691728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.294 [2024-11-26 15:51:17.691840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.294 [2024-11-26 15:51:17.691865] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.294 [2024-11-26 15:51:17.691879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.295 [2024-11-26 15:51:17.691891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.295 [2024-11-26 15:51:17.691919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.295 qpair failed and we were unable to recover it. 00:27:26.295 [2024-11-26 15:51:17.701838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.295 [2024-11-26 15:51:17.701965] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.295 [2024-11-26 15:51:17.701989] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.295 [2024-11-26 15:51:17.702003] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.295 [2024-11-26 15:51:17.702015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.295 [2024-11-26 15:51:17.702043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.295 qpair failed and we were unable to recover it. 00:27:26.295 [2024-11-26 15:51:17.711815] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.295 [2024-11-26 15:51:17.711921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.295 [2024-11-26 15:51:17.711949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.295 [2024-11-26 15:51:17.711963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.295 [2024-11-26 15:51:17.711975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.295 [2024-11-26 15:51:17.712003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.295 qpair failed and we were unable to recover it. 00:27:26.295 [2024-11-26 15:51:17.721842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.295 [2024-11-26 15:51:17.721951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.295 [2024-11-26 15:51:17.721983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.295 [2024-11-26 15:51:17.721997] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.295 [2024-11-26 15:51:17.722009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.295 [2024-11-26 15:51:17.722037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.295 qpair failed and we were unable to recover it. 00:27:26.295 [2024-11-26 15:51:17.731830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.295 [2024-11-26 15:51:17.731937] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.295 [2024-11-26 15:51:17.731963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.295 [2024-11-26 15:51:17.731977] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.295 [2024-11-26 15:51:17.732001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.295 [2024-11-26 15:51:17.732028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.295 qpair failed and we were unable to recover it. 00:27:26.554 [2024-11-26 15:51:17.741890] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.554 [2024-11-26 15:51:17.741997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.554 [2024-11-26 15:51:17.742022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.554 [2024-11-26 15:51:17.742036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.554 [2024-11-26 15:51:17.742051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.554 [2024-11-26 15:51:17.742079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.554 qpair failed and we were unable to recover it. 00:27:26.554 [2024-11-26 15:51:17.751876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.554 [2024-11-26 15:51:17.751978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.554 [2024-11-26 15:51:17.752004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.555 [2024-11-26 15:51:17.752017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.555 [2024-11-26 15:51:17.752029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.555 [2024-11-26 15:51:17.752057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.555 qpair failed and we were unable to recover it. 00:27:26.555 [2024-11-26 15:51:17.761948] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.555 [2024-11-26 15:51:17.762108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.555 [2024-11-26 15:51:17.762133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.555 [2024-11-26 15:51:17.762147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.555 [2024-11-26 15:51:17.762160] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.555 [2024-11-26 15:51:17.762188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.555 qpair failed and we were unable to recover it. 00:27:26.555 [2024-11-26 15:51:17.771966] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.555 [2024-11-26 15:51:17.772096] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.555 [2024-11-26 15:51:17.772122] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.555 [2024-11-26 15:51:17.772146] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.555 [2024-11-26 15:51:17.772161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.555 [2024-11-26 15:51:17.772190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.555 qpair failed and we were unable to recover it. 00:27:26.555 [2024-11-26 15:51:17.781979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.555 [2024-11-26 15:51:17.782100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.555 [2024-11-26 15:51:17.782125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.555 [2024-11-26 15:51:17.782139] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.555 [2024-11-26 15:51:17.782152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.555 [2024-11-26 15:51:17.782181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.555 qpair failed and we were unable to recover it. 00:27:26.555 [2024-11-26 15:51:17.792045] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.555 [2024-11-26 15:51:17.792156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.555 [2024-11-26 15:51:17.792183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.555 [2024-11-26 15:51:17.792196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.555 [2024-11-26 15:51:17.792208] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.555 [2024-11-26 15:51:17.792236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.555 qpair failed and we were unable to recover it. 00:27:26.555 [2024-11-26 15:51:17.802053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.555 [2024-11-26 15:51:17.802162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.555 [2024-11-26 15:51:17.802187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.555 [2024-11-26 15:51:17.802201] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.555 [2024-11-26 15:51:17.802213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.555 [2024-11-26 15:51:17.802241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.555 qpair failed and we were unable to recover it. 00:27:26.555 [2024-11-26 15:51:17.812042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.555 [2024-11-26 15:51:17.812173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.555 [2024-11-26 15:51:17.812198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.555 [2024-11-26 15:51:17.812212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.555 [2024-11-26 15:51:17.812224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.555 [2024-11-26 15:51:17.812251] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.555 qpair failed and we were unable to recover it. 00:27:26.555 [2024-11-26 15:51:17.822094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.555 [2024-11-26 15:51:17.822200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.555 [2024-11-26 15:51:17.822225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.555 [2024-11-26 15:51:17.822239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.555 [2024-11-26 15:51:17.822251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.555 [2024-11-26 15:51:17.822279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.555 qpair failed and we were unable to recover it. 00:27:26.555 [2024-11-26 15:51:17.832196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.555 [2024-11-26 15:51:17.832301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.555 [2024-11-26 15:51:17.832328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.555 [2024-11-26 15:51:17.832342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.555 [2024-11-26 15:51:17.832354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.555 [2024-11-26 15:51:17.832382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.555 qpair failed and we were unable to recover it. 00:27:26.555 [2024-11-26 15:51:17.842151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.555 [2024-11-26 15:51:17.842255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.555 [2024-11-26 15:51:17.842280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.555 [2024-11-26 15:51:17.842295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.555 [2024-11-26 15:51:17.842307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.555 [2024-11-26 15:51:17.842335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.555 qpair failed and we were unable to recover it. 00:27:26.555 [2024-11-26 15:51:17.852195] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.555 [2024-11-26 15:51:17.852310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.555 [2024-11-26 15:51:17.852335] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.555 [2024-11-26 15:51:17.852349] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.555 [2024-11-26 15:51:17.852361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.555 [2024-11-26 15:51:17.852389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.555 qpair failed and we were unable to recover it. 00:27:26.555 [2024-11-26 15:51:17.862268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.555 [2024-11-26 15:51:17.862400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.555 [2024-11-26 15:51:17.862431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.555 [2024-11-26 15:51:17.862446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.555 [2024-11-26 15:51:17.862458] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.555 [2024-11-26 15:51:17.862486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.555 qpair failed and we were unable to recover it. 00:27:26.555 [2024-11-26 15:51:17.872262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.555 [2024-11-26 15:51:17.872373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.555 [2024-11-26 15:51:17.872398] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.555 [2024-11-26 15:51:17.872412] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.555 [2024-11-26 15:51:17.872424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.555 [2024-11-26 15:51:17.872452] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.555 qpair failed and we were unable to recover it. 00:27:26.555 [2024-11-26 15:51:17.882308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.555 [2024-11-26 15:51:17.882430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.555 [2024-11-26 15:51:17.882455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.556 [2024-11-26 15:51:17.882469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.556 [2024-11-26 15:51:17.882482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.556 [2024-11-26 15:51:17.882509] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.556 qpair failed and we were unable to recover it. 00:27:26.556 [2024-11-26 15:51:17.892306] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.556 [2024-11-26 15:51:17.892422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.556 [2024-11-26 15:51:17.892447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.556 [2024-11-26 15:51:17.892460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.556 [2024-11-26 15:51:17.892473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.556 [2024-11-26 15:51:17.892500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.556 qpair failed and we were unable to recover it. 00:27:26.556 [2024-11-26 15:51:17.902326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.556 [2024-11-26 15:51:17.902432] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.556 [2024-11-26 15:51:17.902458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.556 [2024-11-26 15:51:17.902472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.556 [2024-11-26 15:51:17.902484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.556 [2024-11-26 15:51:17.902512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.556 qpair failed and we were unable to recover it. 00:27:26.556 [2024-11-26 15:51:17.912346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.556 [2024-11-26 15:51:17.912448] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.556 [2024-11-26 15:51:17.912474] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.556 [2024-11-26 15:51:17.912488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.556 [2024-11-26 15:51:17.912500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.556 [2024-11-26 15:51:17.912528] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.556 qpair failed and we were unable to recover it. 00:27:26.556 [2024-11-26 15:51:17.922398] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.556 [2024-11-26 15:51:17.922506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.556 [2024-11-26 15:51:17.922531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.556 [2024-11-26 15:51:17.922545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.556 [2024-11-26 15:51:17.922558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.556 [2024-11-26 15:51:17.922586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.556 qpair failed and we were unable to recover it. 00:27:26.556 [2024-11-26 15:51:17.932423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.556 [2024-11-26 15:51:17.932528] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.556 [2024-11-26 15:51:17.932553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.556 [2024-11-26 15:51:17.932567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.556 [2024-11-26 15:51:17.932579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.556 [2024-11-26 15:51:17.932607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.556 qpair failed and we were unable to recover it. 00:27:26.556 [2024-11-26 15:51:17.942451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.556 [2024-11-26 15:51:17.942575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.556 [2024-11-26 15:51:17.942600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.556 [2024-11-26 15:51:17.942613] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.556 [2024-11-26 15:51:17.942626] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.556 [2024-11-26 15:51:17.942653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.556 qpair failed and we were unable to recover it. 00:27:26.556 [2024-11-26 15:51:17.952493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.556 [2024-11-26 15:51:17.952605] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.556 [2024-11-26 15:51:17.952635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.556 [2024-11-26 15:51:17.952650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.556 [2024-11-26 15:51:17.952663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.556 [2024-11-26 15:51:17.952698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.556 qpair failed and we were unable to recover it. 00:27:26.556 [2024-11-26 15:51:17.962549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.556 [2024-11-26 15:51:17.962711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.556 [2024-11-26 15:51:17.962736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.556 [2024-11-26 15:51:17.962750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.556 [2024-11-26 15:51:17.962763] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.556 [2024-11-26 15:51:17.962793] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.556 qpair failed and we were unable to recover it. 00:27:26.556 [2024-11-26 15:51:17.972538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.556 [2024-11-26 15:51:17.972642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.556 [2024-11-26 15:51:17.972666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.556 [2024-11-26 15:51:17.972681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.556 [2024-11-26 15:51:17.972704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.556 [2024-11-26 15:51:17.972733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.556 qpair failed and we were unable to recover it. 00:27:26.556 [2024-11-26 15:51:17.982565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.556 [2024-11-26 15:51:17.982676] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.556 [2024-11-26 15:51:17.982710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.556 [2024-11-26 15:51:17.982724] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.556 [2024-11-26 15:51:17.982737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.556 [2024-11-26 15:51:17.982764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.556 qpair failed and we were unable to recover it. 00:27:26.556 [2024-11-26 15:51:17.992604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.556 [2024-11-26 15:51:17.992716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.556 [2024-11-26 15:51:17.992742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.556 [2024-11-26 15:51:17.992756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.556 [2024-11-26 15:51:17.992770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.556 [2024-11-26 15:51:17.992805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.556 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.002738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.002853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.002878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.002892] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.002904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.817 [2024-11-26 15:51:18.002932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.012662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.012790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.012815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.012829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.012841] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.817 [2024-11-26 15:51:18.012869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.022738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.022848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.022876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.022890] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.022902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.817 [2024-11-26 15:51:18.022931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.032733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.032835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.032861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.032875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.032888] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.817 [2024-11-26 15:51:18.032916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.042747] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.042855] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.042886] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.042900] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.042913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.817 [2024-11-26 15:51:18.042941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.052806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.052918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.052944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.052957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.052970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.817 [2024-11-26 15:51:18.052997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.062817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.062922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.062947] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.062961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.062974] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.817 [2024-11-26 15:51:18.063001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.072887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.073014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.073039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.073053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.073066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.817 [2024-11-26 15:51:18.073094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.082884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.083006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.083031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.083045] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.083058] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.817 [2024-11-26 15:51:18.083091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.092908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.093038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.093063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.093077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.093090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.817 [2024-11-26 15:51:18.093118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.102937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.103042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.103067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.103081] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.103094] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.817 [2024-11-26 15:51:18.103121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.112997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.113117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.113143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.113157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.113169] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.817 [2024-11-26 15:51:18.113197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.123049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.123163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.123187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.123202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.123214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.817 [2024-11-26 15:51:18.123242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.133013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.133126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.133157] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.133172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.133184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.817 [2024-11-26 15:51:18.133212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-11-26 15:51:18.143094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.817 [2024-11-26 15:51:18.143203] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.817 [2024-11-26 15:51:18.143228] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.817 [2024-11-26 15:51:18.143242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.817 [2024-11-26 15:51:18.143255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.818 [2024-11-26 15:51:18.143284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-26 15:51:18.153065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.818 [2024-11-26 15:51:18.153177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.818 [2024-11-26 15:51:18.153202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.818 [2024-11-26 15:51:18.153216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.818 [2024-11-26 15:51:18.153230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.818 [2024-11-26 15:51:18.153258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-26 15:51:18.163125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.818 [2024-11-26 15:51:18.163231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.818 [2024-11-26 15:51:18.163257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.818 [2024-11-26 15:51:18.163270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.818 [2024-11-26 15:51:18.163283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.818 [2024-11-26 15:51:18.163310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-26 15:51:18.173126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.818 [2024-11-26 15:51:18.173229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.818 [2024-11-26 15:51:18.173254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.818 [2024-11-26 15:51:18.173268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.818 [2024-11-26 15:51:18.173281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.818 [2024-11-26 15:51:18.173314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-26 15:51:18.183183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.818 [2024-11-26 15:51:18.183296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.818 [2024-11-26 15:51:18.183321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.818 [2024-11-26 15:51:18.183335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.818 [2024-11-26 15:51:18.183347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.818 [2024-11-26 15:51:18.183375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-26 15:51:18.193175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.818 [2024-11-26 15:51:18.193276] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.818 [2024-11-26 15:51:18.193302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.818 [2024-11-26 15:51:18.193316] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.818 [2024-11-26 15:51:18.193327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.818 [2024-11-26 15:51:18.193355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-26 15:51:18.203227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.818 [2024-11-26 15:51:18.203336] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.818 [2024-11-26 15:51:18.203360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.818 [2024-11-26 15:51:18.203374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.818 [2024-11-26 15:51:18.203387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.818 [2024-11-26 15:51:18.203415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-26 15:51:18.213255] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.818 [2024-11-26 15:51:18.213359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.818 [2024-11-26 15:51:18.213384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.818 [2024-11-26 15:51:18.213399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.818 [2024-11-26 15:51:18.213411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.818 [2024-11-26 15:51:18.213438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-26 15:51:18.223275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.818 [2024-11-26 15:51:18.223377] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.818 [2024-11-26 15:51:18.223406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.818 [2024-11-26 15:51:18.223421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.818 [2024-11-26 15:51:18.223433] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.818 [2024-11-26 15:51:18.223463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-26 15:51:18.233307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.818 [2024-11-26 15:51:18.233444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.818 [2024-11-26 15:51:18.233470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.818 [2024-11-26 15:51:18.233483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.818 [2024-11-26 15:51:18.233504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.818 [2024-11-26 15:51:18.233531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-26 15:51:18.243326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.818 [2024-11-26 15:51:18.243433] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.818 [2024-11-26 15:51:18.243459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.818 [2024-11-26 15:51:18.243472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.818 [2024-11-26 15:51:18.243484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.818 [2024-11-26 15:51:18.243512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-26 15:51:18.253357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.818 [2024-11-26 15:51:18.253467] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.818 [2024-11-26 15:51:18.253492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.818 [2024-11-26 15:51:18.253506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.818 [2024-11-26 15:51:18.253519] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:26.818 [2024-11-26 15:51:18.253546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-11-26 15:51:18.263388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.079 [2024-11-26 15:51:18.263524] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.079 [2024-11-26 15:51:18.263551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.079 [2024-11-26 15:51:18.263565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.079 [2024-11-26 15:51:18.263583] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.079 [2024-11-26 15:51:18.263612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.079 qpair failed and we were unable to recover it. 00:27:27.079 [2024-11-26 15:51:18.273471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.079 [2024-11-26 15:51:18.273593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.079 [2024-11-26 15:51:18.273619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.079 [2024-11-26 15:51:18.273637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.079 [2024-11-26 15:51:18.273651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.079 [2024-11-26 15:51:18.273680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.079 qpair failed and we were unable to recover it. 00:27:27.079 [2024-11-26 15:51:18.283447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.079 [2024-11-26 15:51:18.283557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.079 [2024-11-26 15:51:18.283583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.079 [2024-11-26 15:51:18.283597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.079 [2024-11-26 15:51:18.283609] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.079 [2024-11-26 15:51:18.283637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.079 qpair failed and we were unable to recover it. 00:27:27.079 [2024-11-26 15:51:18.293478] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.079 [2024-11-26 15:51:18.293585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.079 [2024-11-26 15:51:18.293610] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.079 [2024-11-26 15:51:18.293624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.079 [2024-11-26 15:51:18.293636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.079 [2024-11-26 15:51:18.293664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.079 qpair failed and we were unable to recover it. 00:27:27.079 [2024-11-26 15:51:18.303525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.079 [2024-11-26 15:51:18.303642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.079 [2024-11-26 15:51:18.303667] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.079 [2024-11-26 15:51:18.303681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.079 [2024-11-26 15:51:18.303702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.079 [2024-11-26 15:51:18.303731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.079 qpair failed and we were unable to recover it. 00:27:27.079 [2024-11-26 15:51:18.313534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.079 [2024-11-26 15:51:18.313644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.079 [2024-11-26 15:51:18.313674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.079 [2024-11-26 15:51:18.313699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.079 [2024-11-26 15:51:18.313714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.079 [2024-11-26 15:51:18.313744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.079 qpair failed and we were unable to recover it. 00:27:27.079 [2024-11-26 15:51:18.323585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.079 [2024-11-26 15:51:18.323701] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.080 [2024-11-26 15:51:18.323726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.080 [2024-11-26 15:51:18.323741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.080 [2024-11-26 15:51:18.323752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.080 [2024-11-26 15:51:18.323780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.080 qpair failed and we were unable to recover it. 00:27:27.080 [2024-11-26 15:51:18.333600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.080 [2024-11-26 15:51:18.333723] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.080 [2024-11-26 15:51:18.333748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.080 [2024-11-26 15:51:18.333762] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.080 [2024-11-26 15:51:18.333775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.080 [2024-11-26 15:51:18.333804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.080 qpair failed and we were unable to recover it. 00:27:27.080 [2024-11-26 15:51:18.343631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.080 [2024-11-26 15:51:18.343747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.080 [2024-11-26 15:51:18.343773] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.080 [2024-11-26 15:51:18.343787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.080 [2024-11-26 15:51:18.343799] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.080 [2024-11-26 15:51:18.343827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.080 qpair failed and we were unable to recover it. 00:27:27.080 [2024-11-26 15:51:18.353655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.080 [2024-11-26 15:51:18.353769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.080 [2024-11-26 15:51:18.353795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.080 [2024-11-26 15:51:18.353810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.080 [2024-11-26 15:51:18.353831] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.080 [2024-11-26 15:51:18.353860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.080 qpair failed and we were unable to recover it. 00:27:27.080 [2024-11-26 15:51:18.363694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.080 [2024-11-26 15:51:18.363805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.080 [2024-11-26 15:51:18.363830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.080 [2024-11-26 15:51:18.363844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.080 [2024-11-26 15:51:18.363857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.080 [2024-11-26 15:51:18.363885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.080 qpair failed and we were unable to recover it. 00:27:27.080 [2024-11-26 15:51:18.373738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.080 [2024-11-26 15:51:18.373843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.080 [2024-11-26 15:51:18.373868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.080 [2024-11-26 15:51:18.373881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.080 [2024-11-26 15:51:18.373894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.080 [2024-11-26 15:51:18.373922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.080 qpair failed and we were unable to recover it. 00:27:27.080 [2024-11-26 15:51:18.383743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.080 [2024-11-26 15:51:18.383845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.080 [2024-11-26 15:51:18.383870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.080 [2024-11-26 15:51:18.383884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.080 [2024-11-26 15:51:18.383896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.080 [2024-11-26 15:51:18.383925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.080 qpair failed and we were unable to recover it. 00:27:27.080 [2024-11-26 15:51:18.393759] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.080 [2024-11-26 15:51:18.393865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.080 [2024-11-26 15:51:18.393891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.080 [2024-11-26 15:51:18.393905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.080 [2024-11-26 15:51:18.393917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.080 [2024-11-26 15:51:18.393945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.080 qpair failed and we were unable to recover it. 00:27:27.080 [2024-11-26 15:51:18.403817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.080 [2024-11-26 15:51:18.403928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.080 [2024-11-26 15:51:18.403953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.080 [2024-11-26 15:51:18.403967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.080 [2024-11-26 15:51:18.403980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.080 [2024-11-26 15:51:18.404008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.080 qpair failed and we were unable to recover it. 00:27:27.080 [2024-11-26 15:51:18.413831] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.080 [2024-11-26 15:51:18.413940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.080 [2024-11-26 15:51:18.413965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.080 [2024-11-26 15:51:18.413979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.080 [2024-11-26 15:51:18.413991] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.080 [2024-11-26 15:51:18.414019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.080 qpair failed and we were unable to recover it. 00:27:27.080 [2024-11-26 15:51:18.423872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.080 [2024-11-26 15:51:18.424004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.080 [2024-11-26 15:51:18.424030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.080 [2024-11-26 15:51:18.424043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.080 [2024-11-26 15:51:18.424056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.080 [2024-11-26 15:51:18.424083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.080 qpair failed and we were unable to recover it. 00:27:27.080 [2024-11-26 15:51:18.433924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.080 [2024-11-26 15:51:18.434057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.080 [2024-11-26 15:51:18.434084] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.080 [2024-11-26 15:51:18.434099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.080 [2024-11-26 15:51:18.434111] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.080 [2024-11-26 15:51:18.434140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.080 qpair failed and we were unable to recover it. 00:27:27.080 [2024-11-26 15:51:18.443932] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.080 [2024-11-26 15:51:18.444041] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.080 [2024-11-26 15:51:18.444067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.080 [2024-11-26 15:51:18.444080] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.080 [2024-11-26 15:51:18.444098] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.080 [2024-11-26 15:51:18.444126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.080 qpair failed and we were unable to recover it. 00:27:27.080 [2024-11-26 15:51:18.453992] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.080 [2024-11-26 15:51:18.454099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.080 [2024-11-26 15:51:18.454124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.080 [2024-11-26 15:51:18.454138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.080 [2024-11-26 15:51:18.454150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.081 [2024-11-26 15:51:18.454177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.081 qpair failed and we were unable to recover it. 00:27:27.081 [2024-11-26 15:51:18.463980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.081 [2024-11-26 15:51:18.464103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.081 [2024-11-26 15:51:18.464128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.081 [2024-11-26 15:51:18.464142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.081 [2024-11-26 15:51:18.464154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.081 [2024-11-26 15:51:18.464183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.081 qpair failed and we were unable to recover it. 00:27:27.081 [2024-11-26 15:51:18.474019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.081 [2024-11-26 15:51:18.474133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.081 [2024-11-26 15:51:18.474159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.081 [2024-11-26 15:51:18.474172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.081 [2024-11-26 15:51:18.474184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.081 [2024-11-26 15:51:18.474212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.081 qpair failed and we were unable to recover it. 00:27:27.081 [2024-11-26 15:51:18.484061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.081 [2024-11-26 15:51:18.484169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.081 [2024-11-26 15:51:18.484194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.081 [2024-11-26 15:51:18.484208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.081 [2024-11-26 15:51:18.484220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.081 [2024-11-26 15:51:18.484247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.081 qpair failed and we were unable to recover it. 00:27:27.081 [2024-11-26 15:51:18.494069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.081 [2024-11-26 15:51:18.494181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.081 [2024-11-26 15:51:18.494206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.081 [2024-11-26 15:51:18.494219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.081 [2024-11-26 15:51:18.494231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.081 [2024-11-26 15:51:18.494260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.081 qpair failed and we were unable to recover it. 00:27:27.081 [2024-11-26 15:51:18.504128] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.081 [2024-11-26 15:51:18.504237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.081 [2024-11-26 15:51:18.504262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.081 [2024-11-26 15:51:18.504276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.081 [2024-11-26 15:51:18.504288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.081 [2024-11-26 15:51:18.504317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.081 qpair failed and we were unable to recover it. 00:27:27.081 [2024-11-26 15:51:18.514123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.081 [2024-11-26 15:51:18.514229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.081 [2024-11-26 15:51:18.514255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.081 [2024-11-26 15:51:18.514269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.081 [2024-11-26 15:51:18.514281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.081 [2024-11-26 15:51:18.514309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.081 qpair failed and we were unable to recover it. 00:27:27.081 [2024-11-26 15:51:18.524157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.081 [2024-11-26 15:51:18.524266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.081 [2024-11-26 15:51:18.524291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.081 [2024-11-26 15:51:18.524305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.081 [2024-11-26 15:51:18.524318] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.081 [2024-11-26 15:51:18.524345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.081 qpair failed and we were unable to recover it. 00:27:27.342 [2024-11-26 15:51:18.534184] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.342 [2024-11-26 15:51:18.534296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.342 [2024-11-26 15:51:18.534321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.342 [2024-11-26 15:51:18.534335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.342 [2024-11-26 15:51:18.534354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.342 [2024-11-26 15:51:18.534383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.342 qpair failed and we were unable to recover it. 00:27:27.342 [2024-11-26 15:51:18.544243] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.342 [2024-11-26 15:51:18.544352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.342 [2024-11-26 15:51:18.544377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.342 [2024-11-26 15:51:18.544391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.342 [2024-11-26 15:51:18.544406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.343 [2024-11-26 15:51:18.544435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.343 qpair failed and we were unable to recover it. 00:27:27.343 [2024-11-26 15:51:18.554262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.343 [2024-11-26 15:51:18.554378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.343 [2024-11-26 15:51:18.554404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.343 [2024-11-26 15:51:18.554417] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.343 [2024-11-26 15:51:18.554430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.343 [2024-11-26 15:51:18.554457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.343 qpair failed and we were unable to recover it. 00:27:27.343 [2024-11-26 15:51:18.564339] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.343 [2024-11-26 15:51:18.564483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.343 [2024-11-26 15:51:18.564508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.343 [2024-11-26 15:51:18.564523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.343 [2024-11-26 15:51:18.564535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.343 [2024-11-26 15:51:18.564563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.343 qpair failed and we were unable to recover it. 00:27:27.343 [2024-11-26 15:51:18.574302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.343 [2024-11-26 15:51:18.574412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.343 [2024-11-26 15:51:18.574437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.343 [2024-11-26 15:51:18.574451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.343 [2024-11-26 15:51:18.574463] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.343 [2024-11-26 15:51:18.574492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.343 qpair failed and we were unable to recover it. 00:27:27.343 [2024-11-26 15:51:18.584332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.343 [2024-11-26 15:51:18.584440] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.343 [2024-11-26 15:51:18.584466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.343 [2024-11-26 15:51:18.584480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.343 [2024-11-26 15:51:18.584492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.343 [2024-11-26 15:51:18.584520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.343 qpair failed and we were unable to recover it. 00:27:27.343 [2024-11-26 15:51:18.594378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.343 [2024-11-26 15:51:18.594509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.343 [2024-11-26 15:51:18.594534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.343 [2024-11-26 15:51:18.594549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.343 [2024-11-26 15:51:18.594561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.343 [2024-11-26 15:51:18.594589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.343 qpair failed and we were unable to recover it. 00:27:27.343 [2024-11-26 15:51:18.604395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.343 [2024-11-26 15:51:18.604514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.343 [2024-11-26 15:51:18.604539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.343 [2024-11-26 15:51:18.604553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.343 [2024-11-26 15:51:18.604565] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.343 [2024-11-26 15:51:18.604593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.343 qpair failed and we were unable to recover it. 00:27:27.343 [2024-11-26 15:51:18.614416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.343 [2024-11-26 15:51:18.614527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.343 [2024-11-26 15:51:18.614553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.343 [2024-11-26 15:51:18.614567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.343 [2024-11-26 15:51:18.614580] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.343 [2024-11-26 15:51:18.614608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.343 qpair failed and we were unable to recover it. 00:27:27.343 [2024-11-26 15:51:18.624456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.343 [2024-11-26 15:51:18.624582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.343 [2024-11-26 15:51:18.624611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.343 [2024-11-26 15:51:18.624630] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.343 [2024-11-26 15:51:18.624643] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.343 [2024-11-26 15:51:18.624671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.343 qpair failed and we were unable to recover it. 00:27:27.343 [2024-11-26 15:51:18.634475] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.343 [2024-11-26 15:51:18.634581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.343 [2024-11-26 15:51:18.634606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.343 [2024-11-26 15:51:18.634621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.343 [2024-11-26 15:51:18.634632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.343 [2024-11-26 15:51:18.634660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.343 qpair failed and we were unable to recover it. 00:27:27.343 [2024-11-26 15:51:18.644554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.343 [2024-11-26 15:51:18.644665] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.343 [2024-11-26 15:51:18.644696] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.343 [2024-11-26 15:51:18.644712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.343 [2024-11-26 15:51:18.644725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.343 [2024-11-26 15:51:18.644753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.343 qpair failed and we were unable to recover it. 00:27:27.343 [2024-11-26 15:51:18.654526] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.343 [2024-11-26 15:51:18.654635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.343 [2024-11-26 15:51:18.654661] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.343 [2024-11-26 15:51:18.654675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.343 [2024-11-26 15:51:18.654697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.343 [2024-11-26 15:51:18.654737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.343 qpair failed and we were unable to recover it. 00:27:27.343 [2024-11-26 15:51:18.664587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.343 [2024-11-26 15:51:18.664714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.343 [2024-11-26 15:51:18.664741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.343 [2024-11-26 15:51:18.664755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.343 [2024-11-26 15:51:18.664767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.343 [2024-11-26 15:51:18.664795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.343 qpair failed and we were unable to recover it. 00:27:27.343 [2024-11-26 15:51:18.674585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.343 [2024-11-26 15:51:18.674697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.343 [2024-11-26 15:51:18.674723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.343 [2024-11-26 15:51:18.674737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.343 [2024-11-26 15:51:18.674751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.344 [2024-11-26 15:51:18.674780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.344 qpair failed and we were unable to recover it. 00:27:27.344 [2024-11-26 15:51:18.684626] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.344 [2024-11-26 15:51:18.684735] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.344 [2024-11-26 15:51:18.684761] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.344 [2024-11-26 15:51:18.684775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.344 [2024-11-26 15:51:18.684787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.344 [2024-11-26 15:51:18.684816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.344 qpair failed and we were unable to recover it. 00:27:27.344 [2024-11-26 15:51:18.694648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.344 [2024-11-26 15:51:18.694759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.344 [2024-11-26 15:51:18.694785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.344 [2024-11-26 15:51:18.694799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.344 [2024-11-26 15:51:18.694811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.344 [2024-11-26 15:51:18.694839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.344 qpair failed and we were unable to recover it. 00:27:27.344 [2024-11-26 15:51:18.704733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.344 [2024-11-26 15:51:18.704849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.344 [2024-11-26 15:51:18.704875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.344 [2024-11-26 15:51:18.704888] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.344 [2024-11-26 15:51:18.704900] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.344 [2024-11-26 15:51:18.704928] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.344 qpair failed and we were unable to recover it. 00:27:27.344 [2024-11-26 15:51:18.714737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.344 [2024-11-26 15:51:18.714884] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.344 [2024-11-26 15:51:18.714910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.344 [2024-11-26 15:51:18.714931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.344 [2024-11-26 15:51:18.714944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.344 [2024-11-26 15:51:18.714973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.344 qpair failed and we were unable to recover it. 00:27:27.344 [2024-11-26 15:51:18.724780] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.344 [2024-11-26 15:51:18.724938] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.344 [2024-11-26 15:51:18.724963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.344 [2024-11-26 15:51:18.724977] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.344 [2024-11-26 15:51:18.724989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.344 [2024-11-26 15:51:18.725017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.344 qpair failed and we were unable to recover it. 00:27:27.344 [2024-11-26 15:51:18.734759] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.344 [2024-11-26 15:51:18.734864] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.344 [2024-11-26 15:51:18.734890] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.344 [2024-11-26 15:51:18.734904] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.344 [2024-11-26 15:51:18.734917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.344 [2024-11-26 15:51:18.734946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.344 qpair failed and we were unable to recover it. 00:27:27.344 [2024-11-26 15:51:18.744795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.344 [2024-11-26 15:51:18.744909] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.344 [2024-11-26 15:51:18.744935] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.344 [2024-11-26 15:51:18.744949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.344 [2024-11-26 15:51:18.744961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.344 [2024-11-26 15:51:18.744989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.344 qpair failed and we were unable to recover it. 00:27:27.344 [2024-11-26 15:51:18.754818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.344 [2024-11-26 15:51:18.754918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.344 [2024-11-26 15:51:18.754944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.344 [2024-11-26 15:51:18.754958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.344 [2024-11-26 15:51:18.754969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.344 [2024-11-26 15:51:18.754997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.344 qpair failed and we were unable to recover it. 00:27:27.344 [2024-11-26 15:51:18.764879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.344 [2024-11-26 15:51:18.764990] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.344 [2024-11-26 15:51:18.765016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.344 [2024-11-26 15:51:18.765030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.344 [2024-11-26 15:51:18.765042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.344 [2024-11-26 15:51:18.765070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.344 qpair failed and we were unable to recover it. 00:27:27.344 [2024-11-26 15:51:18.774926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.344 [2024-11-26 15:51:18.775027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.344 [2024-11-26 15:51:18.775053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.344 [2024-11-26 15:51:18.775067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.344 [2024-11-26 15:51:18.775080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.344 [2024-11-26 15:51:18.775108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.344 qpair failed and we were unable to recover it. 00:27:27.344 [2024-11-26 15:51:18.784967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.344 [2024-11-26 15:51:18.785068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.344 [2024-11-26 15:51:18.785094] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.344 [2024-11-26 15:51:18.785108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.344 [2024-11-26 15:51:18.785122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.344 [2024-11-26 15:51:18.785151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.344 qpair failed and we were unable to recover it. 00:27:27.603 [2024-11-26 15:51:18.794944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.603 [2024-11-26 15:51:18.795050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.603 [2024-11-26 15:51:18.795076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.603 [2024-11-26 15:51:18.795090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.603 [2024-11-26 15:51:18.795104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.603 [2024-11-26 15:51:18.795134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.603 qpair failed and we were unable to recover it. 00:27:27.603 [2024-11-26 15:51:18.804987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.603 [2024-11-26 15:51:18.805096] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.603 [2024-11-26 15:51:18.805122] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.603 [2024-11-26 15:51:18.805142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.603 [2024-11-26 15:51:18.805155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.603 [2024-11-26 15:51:18.805184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.603 qpair failed and we were unable to recover it. 00:27:27.604 [2024-11-26 15:51:18.815042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.604 [2024-11-26 15:51:18.815149] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.604 [2024-11-26 15:51:18.815175] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.604 [2024-11-26 15:51:18.815189] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.604 [2024-11-26 15:51:18.815202] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.604 [2024-11-26 15:51:18.815230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.604 qpair failed and we were unable to recover it. 00:27:27.604 [2024-11-26 15:51:18.825037] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.604 [2024-11-26 15:51:18.825139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.604 [2024-11-26 15:51:18.825165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.604 [2024-11-26 15:51:18.825180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.604 [2024-11-26 15:51:18.825193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.604 [2024-11-26 15:51:18.825220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.604 qpair failed and we were unable to recover it. 00:27:27.604 [2024-11-26 15:51:18.835072] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.604 [2024-11-26 15:51:18.835199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.604 [2024-11-26 15:51:18.835224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.604 [2024-11-26 15:51:18.835238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.604 [2024-11-26 15:51:18.835251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.604 [2024-11-26 15:51:18.835278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.604 qpair failed and we were unable to recover it. 00:27:27.604 [2024-11-26 15:51:18.845117] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.604 [2024-11-26 15:51:18.845251] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.604 [2024-11-26 15:51:18.845277] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.604 [2024-11-26 15:51:18.845291] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.604 [2024-11-26 15:51:18.845303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.604 [2024-11-26 15:51:18.845331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.604 qpair failed and we were unable to recover it. 00:27:27.604 [2024-11-26 15:51:18.855205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.604 [2024-11-26 15:51:18.855316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.604 [2024-11-26 15:51:18.855343] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.604 [2024-11-26 15:51:18.855358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.604 [2024-11-26 15:51:18.855371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.604 [2024-11-26 15:51:18.855399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.604 qpair failed and we were unable to recover it. 00:27:27.604 [2024-11-26 15:51:18.865181] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.604 [2024-11-26 15:51:18.865281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.604 [2024-11-26 15:51:18.865308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.604 [2024-11-26 15:51:18.865322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.604 [2024-11-26 15:51:18.865335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.604 [2024-11-26 15:51:18.865363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.604 qpair failed and we were unable to recover it. 00:27:27.604 [2024-11-26 15:51:18.875182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.604 [2024-11-26 15:51:18.875294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.604 [2024-11-26 15:51:18.875320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.604 [2024-11-26 15:51:18.875334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.604 [2024-11-26 15:51:18.875347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.604 [2024-11-26 15:51:18.875375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.604 qpair failed and we were unable to recover it. 00:27:27.604 [2024-11-26 15:51:18.885219] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.604 [2024-11-26 15:51:18.885330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.604 [2024-11-26 15:51:18.885357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.604 [2024-11-26 15:51:18.885372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.604 [2024-11-26 15:51:18.885385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.604 [2024-11-26 15:51:18.885413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.604 qpair failed and we were unable to recover it. 00:27:27.604 [2024-11-26 15:51:18.895279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.604 [2024-11-26 15:51:18.895388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.604 [2024-11-26 15:51:18.895414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.604 [2024-11-26 15:51:18.895435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.604 [2024-11-26 15:51:18.895449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.604 [2024-11-26 15:51:18.895477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.604 qpair failed and we were unable to recover it. 00:27:27.604 [2024-11-26 15:51:18.905282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.604 [2024-11-26 15:51:18.905396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.604 [2024-11-26 15:51:18.905422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.604 [2024-11-26 15:51:18.905436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.604 [2024-11-26 15:51:18.905449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.604 [2024-11-26 15:51:18.905478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.604 qpair failed and we were unable to recover it. 00:27:27.604 [2024-11-26 15:51:18.915300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.604 [2024-11-26 15:51:18.915418] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.604 [2024-11-26 15:51:18.915445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.604 [2024-11-26 15:51:18.915459] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.604 [2024-11-26 15:51:18.915471] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.604 [2024-11-26 15:51:18.915499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.604 qpair failed and we were unable to recover it. 00:27:27.604 [2024-11-26 15:51:18.925367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.604 [2024-11-26 15:51:18.925482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.604 [2024-11-26 15:51:18.925508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.604 [2024-11-26 15:51:18.925521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.604 [2024-11-26 15:51:18.925534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.604 [2024-11-26 15:51:18.925562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.604 qpair failed and we were unable to recover it. 00:27:27.604 [2024-11-26 15:51:18.935375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.604 [2024-11-26 15:51:18.935484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.604 [2024-11-26 15:51:18.935510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.604 [2024-11-26 15:51:18.935523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.604 [2024-11-26 15:51:18.935535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.604 [2024-11-26 15:51:18.935563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.604 qpair failed and we were unable to recover it. 00:27:27.604 [2024-11-26 15:51:18.945428] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.604 [2024-11-26 15:51:18.945537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.604 [2024-11-26 15:51:18.945563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.605 [2024-11-26 15:51:18.945577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.605 [2024-11-26 15:51:18.945589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.605 [2024-11-26 15:51:18.945617] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.605 qpair failed and we were unable to recover it. 00:27:27.605 [2024-11-26 15:51:18.955412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.605 [2024-11-26 15:51:18.955511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.605 [2024-11-26 15:51:18.955538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.605 [2024-11-26 15:51:18.955552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.605 [2024-11-26 15:51:18.955564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.605 [2024-11-26 15:51:18.955592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.605 qpair failed and we were unable to recover it. 00:27:27.605 [2024-11-26 15:51:18.965474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.605 [2024-11-26 15:51:18.965631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.605 [2024-11-26 15:51:18.965657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.605 [2024-11-26 15:51:18.965672] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.605 [2024-11-26 15:51:18.965691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.605 [2024-11-26 15:51:18.965725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.605 qpair failed and we were unable to recover it. 00:27:27.605 [2024-11-26 15:51:18.975505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.605 [2024-11-26 15:51:18.975623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.605 [2024-11-26 15:51:18.975649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.605 [2024-11-26 15:51:18.975663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.605 [2024-11-26 15:51:18.975675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.605 [2024-11-26 15:51:18.975710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.605 qpair failed and we were unable to recover it. 00:27:27.605 [2024-11-26 15:51:18.985550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.605 [2024-11-26 15:51:18.985657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.605 [2024-11-26 15:51:18.985683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.605 [2024-11-26 15:51:18.985715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.605 [2024-11-26 15:51:18.985730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.605 [2024-11-26 15:51:18.985758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.605 qpair failed and we were unable to recover it. 00:27:27.605 [2024-11-26 15:51:18.995595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.605 [2024-11-26 15:51:18.995736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.605 [2024-11-26 15:51:18.995763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.605 [2024-11-26 15:51:18.995776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.605 [2024-11-26 15:51:18.995789] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.605 [2024-11-26 15:51:18.995817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.605 qpair failed and we were unable to recover it. 00:27:27.605 [2024-11-26 15:51:19.005682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.605 [2024-11-26 15:51:19.005830] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.605 [2024-11-26 15:51:19.005857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.605 [2024-11-26 15:51:19.005871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.605 [2024-11-26 15:51:19.005884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.605 [2024-11-26 15:51:19.005912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.605 qpair failed and we were unable to recover it. 00:27:27.605 [2024-11-26 15:51:19.015614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.605 [2024-11-26 15:51:19.015731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.605 [2024-11-26 15:51:19.015757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.605 [2024-11-26 15:51:19.015771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.605 [2024-11-26 15:51:19.015783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.605 [2024-11-26 15:51:19.015810] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.605 qpair failed and we were unable to recover it. 00:27:27.605 [2024-11-26 15:51:19.025668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.605 [2024-11-26 15:51:19.025782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.605 [2024-11-26 15:51:19.025808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.605 [2024-11-26 15:51:19.025823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.605 [2024-11-26 15:51:19.025836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.605 [2024-11-26 15:51:19.025864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.605 qpair failed and we were unable to recover it. 00:27:27.605 [2024-11-26 15:51:19.035653] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.605 [2024-11-26 15:51:19.035762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.605 [2024-11-26 15:51:19.035788] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.605 [2024-11-26 15:51:19.035802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.605 [2024-11-26 15:51:19.035816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.605 [2024-11-26 15:51:19.035843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.605 qpair failed and we were unable to recover it. 00:27:27.605 [2024-11-26 15:51:19.045733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.605 [2024-11-26 15:51:19.045853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.605 [2024-11-26 15:51:19.045879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.605 [2024-11-26 15:51:19.045893] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.605 [2024-11-26 15:51:19.045906] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.605 [2024-11-26 15:51:19.045935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.605 qpair failed and we were unable to recover it. 00:27:27.966 [2024-11-26 15:51:19.055737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.966 [2024-11-26 15:51:19.055858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.966 [2024-11-26 15:51:19.055884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.966 [2024-11-26 15:51:19.055899] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.966 [2024-11-26 15:51:19.055912] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.966 [2024-11-26 15:51:19.055940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.966 qpair failed and we were unable to recover it. 00:27:27.966 [2024-11-26 15:51:19.065775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.966 [2024-11-26 15:51:19.065911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.966 [2024-11-26 15:51:19.065938] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.966 [2024-11-26 15:51:19.065957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.966 [2024-11-26 15:51:19.065971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.966 [2024-11-26 15:51:19.066001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.966 qpair failed and we were unable to recover it. 00:27:27.966 [2024-11-26 15:51:19.075794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.966 [2024-11-26 15:51:19.075908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.966 [2024-11-26 15:51:19.075942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.966 [2024-11-26 15:51:19.075957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.966 [2024-11-26 15:51:19.075970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.966 [2024-11-26 15:51:19.075999] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.966 qpair failed and we were unable to recover it. 00:27:27.966 [2024-11-26 15:51:19.085824] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.966 [2024-11-26 15:51:19.085941] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.966 [2024-11-26 15:51:19.085968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.966 [2024-11-26 15:51:19.085982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.966 [2024-11-26 15:51:19.085994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.966 [2024-11-26 15:51:19.086022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.966 qpair failed and we were unable to recover it. 00:27:27.966 [2024-11-26 15:51:19.095858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.967 [2024-11-26 15:51:19.095969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.967 [2024-11-26 15:51:19.095996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.967 [2024-11-26 15:51:19.096010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.967 [2024-11-26 15:51:19.096022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.967 [2024-11-26 15:51:19.096050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.967 qpair failed and we were unable to recover it. 00:27:27.967 [2024-11-26 15:51:19.105876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.967 [2024-11-26 15:51:19.105978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.967 [2024-11-26 15:51:19.106005] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.967 [2024-11-26 15:51:19.106019] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.967 [2024-11-26 15:51:19.106031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.967 [2024-11-26 15:51:19.106059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.967 qpair failed and we were unable to recover it. 00:27:27.967 [2024-11-26 15:51:19.115884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.967 [2024-11-26 15:51:19.115987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.967 [2024-11-26 15:51:19.116014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.967 [2024-11-26 15:51:19.116028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.967 [2024-11-26 15:51:19.116040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.967 [2024-11-26 15:51:19.116069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.967 qpair failed and we were unable to recover it. 00:27:27.967 [2024-11-26 15:51:19.126010] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.967 [2024-11-26 15:51:19.126163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.967 [2024-11-26 15:51:19.126191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.967 [2024-11-26 15:51:19.126206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.967 [2024-11-26 15:51:19.126219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.967 [2024-11-26 15:51:19.126247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.967 qpair failed and we were unable to recover it. 00:27:27.967 [2024-11-26 15:51:19.136006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.967 [2024-11-26 15:51:19.136114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.967 [2024-11-26 15:51:19.136143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.967 [2024-11-26 15:51:19.136158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.968 [2024-11-26 15:51:19.136171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.968 [2024-11-26 15:51:19.136200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.968 qpair failed and we were unable to recover it. 00:27:27.968 [2024-11-26 15:51:19.145983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.968 [2024-11-26 15:51:19.146092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.968 [2024-11-26 15:51:19.146119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.968 [2024-11-26 15:51:19.146133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.968 [2024-11-26 15:51:19.146145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.968 [2024-11-26 15:51:19.146173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.968 qpair failed and we were unable to recover it. 00:27:27.968 [2024-11-26 15:51:19.156055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.968 [2024-11-26 15:51:19.156162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.968 [2024-11-26 15:51:19.156189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.968 [2024-11-26 15:51:19.156203] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.968 [2024-11-26 15:51:19.156216] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.968 [2024-11-26 15:51:19.156244] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.968 qpair failed and we were unable to recover it. 00:27:27.968 [2024-11-26 15:51:19.166042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.968 [2024-11-26 15:51:19.166170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.968 [2024-11-26 15:51:19.166205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.968 [2024-11-26 15:51:19.166220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.968 [2024-11-26 15:51:19.166232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.968 [2024-11-26 15:51:19.166260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.968 qpair failed and we were unable to recover it. 00:27:27.968 [2024-11-26 15:51:19.176156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.968 [2024-11-26 15:51:19.176261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.969 [2024-11-26 15:51:19.176287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.969 [2024-11-26 15:51:19.176301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.969 [2024-11-26 15:51:19.176313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.969 [2024-11-26 15:51:19.176342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.969 qpair failed and we were unable to recover it. 00:27:27.969 [2024-11-26 15:51:19.186154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.969 [2024-11-26 15:51:19.186257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.969 [2024-11-26 15:51:19.186283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.969 [2024-11-26 15:51:19.186297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.969 [2024-11-26 15:51:19.186310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.969 [2024-11-26 15:51:19.186338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.969 qpair failed and we were unable to recover it. 00:27:27.969 [2024-11-26 15:51:19.196151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.969 [2024-11-26 15:51:19.196309] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.969 [2024-11-26 15:51:19.196336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.969 [2024-11-26 15:51:19.196351] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.969 [2024-11-26 15:51:19.196364] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.969 [2024-11-26 15:51:19.196393] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.969 qpair failed and we were unable to recover it. 00:27:27.969 [2024-11-26 15:51:19.206156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.969 [2024-11-26 15:51:19.206270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.969 [2024-11-26 15:51:19.206296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.970 [2024-11-26 15:51:19.206310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.970 [2024-11-26 15:51:19.206322] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.970 [2024-11-26 15:51:19.206356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.970 qpair failed and we were unable to recover it. 00:27:27.970 [2024-11-26 15:51:19.216226] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.970 [2024-11-26 15:51:19.216349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.970 [2024-11-26 15:51:19.216375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.970 [2024-11-26 15:51:19.216389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.970 [2024-11-26 15:51:19.216401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.970 [2024-11-26 15:51:19.216438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.970 qpair failed and we were unable to recover it. 00:27:27.970 [2024-11-26 15:51:19.226207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.970 [2024-11-26 15:51:19.226315] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.970 [2024-11-26 15:51:19.226341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.970 [2024-11-26 15:51:19.226355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.970 [2024-11-26 15:51:19.226368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.970 [2024-11-26 15:51:19.226396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.970 qpair failed and we were unable to recover it. 00:27:27.970 [2024-11-26 15:51:19.236248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.970 [2024-11-26 15:51:19.236349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.970 [2024-11-26 15:51:19.236375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.970 [2024-11-26 15:51:19.236390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.970 [2024-11-26 15:51:19.236401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.970 [2024-11-26 15:51:19.236430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.970 qpair failed and we were unable to recover it. 00:27:27.970 [2024-11-26 15:51:19.246445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.970 [2024-11-26 15:51:19.246554] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.971 [2024-11-26 15:51:19.246580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.971 [2024-11-26 15:51:19.246594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.971 [2024-11-26 15:51:19.246606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.971 [2024-11-26 15:51:19.246635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.971 qpair failed and we were unable to recover it. 00:27:27.971 [2024-11-26 15:51:19.256344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.971 [2024-11-26 15:51:19.256507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.971 [2024-11-26 15:51:19.256540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.971 [2024-11-26 15:51:19.256559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.971 [2024-11-26 15:51:19.256573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.971 [2024-11-26 15:51:19.256602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.971 qpair failed and we were unable to recover it. 00:27:27.971 [2024-11-26 15:51:19.266330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.971 [2024-11-26 15:51:19.266459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.971 [2024-11-26 15:51:19.266485] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.971 [2024-11-26 15:51:19.266499] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.971 [2024-11-26 15:51:19.266511] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.971 [2024-11-26 15:51:19.266539] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.971 qpair failed and we were unable to recover it. 00:27:27.971 [2024-11-26 15:51:19.276362] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.971 [2024-11-26 15:51:19.276487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.971 [2024-11-26 15:51:19.276513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.971 [2024-11-26 15:51:19.276527] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.971 [2024-11-26 15:51:19.276539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.971 [2024-11-26 15:51:19.276568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.971 qpair failed and we were unable to recover it. 00:27:27.971 [2024-11-26 15:51:19.286401] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.971 [2024-11-26 15:51:19.286512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.971 [2024-11-26 15:51:19.286538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.971 [2024-11-26 15:51:19.286552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.971 [2024-11-26 15:51:19.286564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.971 [2024-11-26 15:51:19.286592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.971 qpair failed and we were unable to recover it. 00:27:27.972 [2024-11-26 15:51:19.296434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.972 [2024-11-26 15:51:19.296544] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.972 [2024-11-26 15:51:19.296570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.972 [2024-11-26 15:51:19.296584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.972 [2024-11-26 15:51:19.296597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.972 [2024-11-26 15:51:19.296631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.972 qpair failed and we were unable to recover it. 00:27:27.972 [2024-11-26 15:51:19.306458] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.972 [2024-11-26 15:51:19.306565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.972 [2024-11-26 15:51:19.306591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.972 [2024-11-26 15:51:19.306605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.972 [2024-11-26 15:51:19.306618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.972 [2024-11-26 15:51:19.306646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.972 qpair failed and we were unable to recover it. 00:27:27.972 [2024-11-26 15:51:19.316582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.972 [2024-11-26 15:51:19.316694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.972 [2024-11-26 15:51:19.316720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.972 [2024-11-26 15:51:19.316734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.972 [2024-11-26 15:51:19.316747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.972 [2024-11-26 15:51:19.316775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.972 qpair failed and we were unable to recover it. 00:27:27.972 [2024-11-26 15:51:19.326575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.972 [2024-11-26 15:51:19.326700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.972 [2024-11-26 15:51:19.326732] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.972 [2024-11-26 15:51:19.326747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.972 [2024-11-26 15:51:19.326760] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.972 [2024-11-26 15:51:19.326789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.972 qpair failed and we were unable to recover it. 00:27:27.972 [2024-11-26 15:51:19.336520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.972 [2024-11-26 15:51:19.336630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.972 [2024-11-26 15:51:19.336656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.972 [2024-11-26 15:51:19.336670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.972 [2024-11-26 15:51:19.336683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.973 [2024-11-26 15:51:19.336723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.973 qpair failed and we were unable to recover it. 00:27:27.973 [2024-11-26 15:51:19.346575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.973 [2024-11-26 15:51:19.346678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.973 [2024-11-26 15:51:19.346722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.973 [2024-11-26 15:51:19.346738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.973 [2024-11-26 15:51:19.346751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.973 [2024-11-26 15:51:19.346780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.973 qpair failed and we were unable to recover it. 00:27:27.973 [2024-11-26 15:51:19.356598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.973 [2024-11-26 15:51:19.356712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.973 [2024-11-26 15:51:19.356738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.973 [2024-11-26 15:51:19.356752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.973 [2024-11-26 15:51:19.356764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.973 [2024-11-26 15:51:19.356794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.973 qpair failed and we were unable to recover it. 00:27:27.973 [2024-11-26 15:51:19.366648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.973 [2024-11-26 15:51:19.366778] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.973 [2024-11-26 15:51:19.366804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.973 [2024-11-26 15:51:19.366818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.973 [2024-11-26 15:51:19.366830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.973 [2024-11-26 15:51:19.366859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.973 qpair failed and we were unable to recover it. 00:27:27.973 [2024-11-26 15:51:19.376659] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.973 [2024-11-26 15:51:19.376777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.973 [2024-11-26 15:51:19.376804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.973 [2024-11-26 15:51:19.376818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.973 [2024-11-26 15:51:19.376830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.973 [2024-11-26 15:51:19.376858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.973 qpair failed and we were unable to recover it. 00:27:27.973 [2024-11-26 15:51:19.386721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.974 [2024-11-26 15:51:19.386844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.974 [2024-11-26 15:51:19.386870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.974 [2024-11-26 15:51:19.386884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.974 [2024-11-26 15:51:19.386897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.974 [2024-11-26 15:51:19.386932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.974 qpair failed and we were unable to recover it. 00:27:27.974 [2024-11-26 15:51:19.396738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.974 [2024-11-26 15:51:19.396854] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.974 [2024-11-26 15:51:19.396879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.974 [2024-11-26 15:51:19.396893] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.974 [2024-11-26 15:51:19.396906] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.974 [2024-11-26 15:51:19.396936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.974 qpair failed and we were unable to recover it. 00:27:27.974 [2024-11-26 15:51:19.406781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.974 [2024-11-26 15:51:19.406902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.974 [2024-11-26 15:51:19.406928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.974 [2024-11-26 15:51:19.406942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.974 [2024-11-26 15:51:19.406954] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:27.974 [2024-11-26 15:51:19.406983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:27.974 qpair failed and we were unable to recover it. 00:27:28.238 [2024-11-26 15:51:19.416796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.238 [2024-11-26 15:51:19.416900] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.238 [2024-11-26 15:51:19.416925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.238 [2024-11-26 15:51:19.416940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.238 [2024-11-26 15:51:19.416952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.238 [2024-11-26 15:51:19.416980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.238 qpair failed and we were unable to recover it. 00:27:28.238 [2024-11-26 15:51:19.426813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.238 [2024-11-26 15:51:19.426927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.238 [2024-11-26 15:51:19.426953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.238 [2024-11-26 15:51:19.426967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.238 [2024-11-26 15:51:19.426980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.238 [2024-11-26 15:51:19.427008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.238 qpair failed and we were unable to recover it. 00:27:28.238 [2024-11-26 15:51:19.436823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.238 [2024-11-26 15:51:19.436929] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.238 [2024-11-26 15:51:19.436961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.238 [2024-11-26 15:51:19.436976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.238 [2024-11-26 15:51:19.436989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.238 [2024-11-26 15:51:19.437017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.238 qpair failed and we were unable to recover it. 00:27:28.238 [2024-11-26 15:51:19.446883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.446989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.447014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.447028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.447041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.447069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.456893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.456993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.457019] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.457033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.457046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.457074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.466979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.467093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.467119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.467134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.467146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.467174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.476966] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.477074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.477100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.477115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.477132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.477161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.487038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.487192] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.487218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.487232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.487244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.487271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.496993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.497105] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.497131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.497145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.497157] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.497185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.507025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.507137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.507164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.507177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.507189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.507218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.517058] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.517158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.517185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.517199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.517211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.517239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.527095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.527197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.527228] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.527243] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.527255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.527284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.537147] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.537256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.537282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.537296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.537309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.537337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.547154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.547255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.547281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.547295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.547307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.547335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.557183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.557282] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.557308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.557323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.557335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.557363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.567247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.567405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.567432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.567446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.567464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.567493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.577241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.577341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.577367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.577381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.577393] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.577422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.587259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.587361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.587387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.587401] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.587414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.587442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.597324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.597472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.597498] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.597511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.597525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.597553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.607388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.607497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.607524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.239 [2024-11-26 15:51:19.607538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.239 [2024-11-26 15:51:19.607551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.239 [2024-11-26 15:51:19.607579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.239 qpair failed and we were unable to recover it. 00:27:28.239 [2024-11-26 15:51:19.617449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.239 [2024-11-26 15:51:19.617568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.239 [2024-11-26 15:51:19.617595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.240 [2024-11-26 15:51:19.617609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.240 [2024-11-26 15:51:19.617625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.240 [2024-11-26 15:51:19.617654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.240 qpair failed and we were unable to recover it. 00:27:28.240 [2024-11-26 15:51:19.627403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.240 [2024-11-26 15:51:19.627547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.240 [2024-11-26 15:51:19.627573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.240 [2024-11-26 15:51:19.627588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.240 [2024-11-26 15:51:19.627599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.240 [2024-11-26 15:51:19.627627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.240 qpair failed and we were unable to recover it. 00:27:28.240 [2024-11-26 15:51:19.637439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.240 [2024-11-26 15:51:19.637544] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.240 [2024-11-26 15:51:19.637570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.240 [2024-11-26 15:51:19.637584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.240 [2024-11-26 15:51:19.637597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.240 [2024-11-26 15:51:19.637624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.240 qpair failed and we were unable to recover it. 00:27:28.240 [2024-11-26 15:51:19.647466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.240 [2024-11-26 15:51:19.647575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.240 [2024-11-26 15:51:19.647601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.240 [2024-11-26 15:51:19.647615] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.240 [2024-11-26 15:51:19.647627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.240 [2024-11-26 15:51:19.647655] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.240 qpair failed and we were unable to recover it. 00:27:28.240 [2024-11-26 15:51:19.657497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.240 [2024-11-26 15:51:19.657610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.240 [2024-11-26 15:51:19.657636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.240 [2024-11-26 15:51:19.657650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.240 [2024-11-26 15:51:19.657667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.240 [2024-11-26 15:51:19.657702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.240 qpair failed and we were unable to recover it. 00:27:28.240 [2024-11-26 15:51:19.667519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.240 [2024-11-26 15:51:19.667625] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.240 [2024-11-26 15:51:19.667652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.240 [2024-11-26 15:51:19.667666] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.240 [2024-11-26 15:51:19.667679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.240 [2024-11-26 15:51:19.667723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.240 qpair failed and we were unable to recover it. 00:27:28.240 [2024-11-26 15:51:19.677523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.240 [2024-11-26 15:51:19.677629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.240 [2024-11-26 15:51:19.677655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.240 [2024-11-26 15:51:19.677669] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.240 [2024-11-26 15:51:19.677681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.240 [2024-11-26 15:51:19.677718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.240 qpair failed and we were unable to recover it. 00:27:28.500 [2024-11-26 15:51:19.687584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.500 [2024-11-26 15:51:19.687708] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.500 [2024-11-26 15:51:19.687735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.500 [2024-11-26 15:51:19.687750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.500 [2024-11-26 15:51:19.687762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.500 [2024-11-26 15:51:19.687791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-11-26 15:51:19.697648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.500 [2024-11-26 15:51:19.697813] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.500 [2024-11-26 15:51:19.697839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.500 [2024-11-26 15:51:19.697853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.500 [2024-11-26 15:51:19.697866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.500 [2024-11-26 15:51:19.697895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-11-26 15:51:19.707634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.500 [2024-11-26 15:51:19.707760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.500 [2024-11-26 15:51:19.707786] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.500 [2024-11-26 15:51:19.707799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.500 [2024-11-26 15:51:19.707814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.500 [2024-11-26 15:51:19.707842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-11-26 15:51:19.717646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.500 [2024-11-26 15:51:19.717754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.500 [2024-11-26 15:51:19.717781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.500 [2024-11-26 15:51:19.717795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.500 [2024-11-26 15:51:19.717806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.500 [2024-11-26 15:51:19.717836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-11-26 15:51:19.727702] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.500 [2024-11-26 15:51:19.727809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.500 [2024-11-26 15:51:19.727835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.500 [2024-11-26 15:51:19.727848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.500 [2024-11-26 15:51:19.727861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.500 [2024-11-26 15:51:19.727889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-11-26 15:51:19.737708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.500 [2024-11-26 15:51:19.737818] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.500 [2024-11-26 15:51:19.737844] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.500 [2024-11-26 15:51:19.737858] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.500 [2024-11-26 15:51:19.737871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.500 [2024-11-26 15:51:19.737899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-11-26 15:51:19.747748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.500 [2024-11-26 15:51:19.747851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.501 [2024-11-26 15:51:19.747877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.501 [2024-11-26 15:51:19.747891] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.501 [2024-11-26 15:51:19.747909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.501 [2024-11-26 15:51:19.747938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-11-26 15:51:19.757772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.501 [2024-11-26 15:51:19.757880] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.501 [2024-11-26 15:51:19.757906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.501 [2024-11-26 15:51:19.757921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.501 [2024-11-26 15:51:19.757934] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.501 [2024-11-26 15:51:19.757962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-11-26 15:51:19.767859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.501 [2024-11-26 15:51:19.767982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.501 [2024-11-26 15:51:19.768012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.501 [2024-11-26 15:51:19.768026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.501 [2024-11-26 15:51:19.768042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.501 [2024-11-26 15:51:19.768072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-11-26 15:51:19.777839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.501 [2024-11-26 15:51:19.777963] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.501 [2024-11-26 15:51:19.777989] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.501 [2024-11-26 15:51:19.778003] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.501 [2024-11-26 15:51:19.778016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.501 [2024-11-26 15:51:19.778044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-11-26 15:51:19.787883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.501 [2024-11-26 15:51:19.787989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.501 [2024-11-26 15:51:19.788015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.501 [2024-11-26 15:51:19.788029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.501 [2024-11-26 15:51:19.788042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.501 [2024-11-26 15:51:19.788070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-11-26 15:51:19.797885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.501 [2024-11-26 15:51:19.797999] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.501 [2024-11-26 15:51:19.798026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.501 [2024-11-26 15:51:19.798041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.501 [2024-11-26 15:51:19.798053] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.501 [2024-11-26 15:51:19.798081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-11-26 15:51:19.807933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.501 [2024-11-26 15:51:19.808046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.501 [2024-11-26 15:51:19.808073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.501 [2024-11-26 15:51:19.808087] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.501 [2024-11-26 15:51:19.808099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.501 [2024-11-26 15:51:19.808127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-11-26 15:51:19.817998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.501 [2024-11-26 15:51:19.818106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.501 [2024-11-26 15:51:19.818132] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.501 [2024-11-26 15:51:19.818145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.501 [2024-11-26 15:51:19.818158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.501 [2024-11-26 15:51:19.818188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-11-26 15:51:19.827969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.501 [2024-11-26 15:51:19.828070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.501 [2024-11-26 15:51:19.828096] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.501 [2024-11-26 15:51:19.828110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.501 [2024-11-26 15:51:19.828123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.501 [2024-11-26 15:51:19.828151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-11-26 15:51:19.838039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.501 [2024-11-26 15:51:19.838155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.501 [2024-11-26 15:51:19.838181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.501 [2024-11-26 15:51:19.838201] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.501 [2024-11-26 15:51:19.838215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.501 [2024-11-26 15:51:19.838243] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-11-26 15:51:19.848059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.501 [2024-11-26 15:51:19.848169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.501 [2024-11-26 15:51:19.848195] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.501 [2024-11-26 15:51:19.848209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.501 [2024-11-26 15:51:19.848221] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.501 [2024-11-26 15:51:19.848251] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-11-26 15:51:19.858126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.501 [2024-11-26 15:51:19.858272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.501 [2024-11-26 15:51:19.858298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.501 [2024-11-26 15:51:19.858312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.501 [2024-11-26 15:51:19.858324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.501 [2024-11-26 15:51:19.858352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-11-26 15:51:19.868106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.501 [2024-11-26 15:51:19.868212] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.501 [2024-11-26 15:51:19.868238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.501 [2024-11-26 15:51:19.868251] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.501 [2024-11-26 15:51:19.868264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.501 [2024-11-26 15:51:19.868292] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-11-26 15:51:19.878162] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.501 [2024-11-26 15:51:19.878268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.501 [2024-11-26 15:51:19.878294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.501 [2024-11-26 15:51:19.878308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.501 [2024-11-26 15:51:19.878320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.502 [2024-11-26 15:51:19.878349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-11-26 15:51:19.888183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.502 [2024-11-26 15:51:19.888292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.502 [2024-11-26 15:51:19.888318] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.502 [2024-11-26 15:51:19.888332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.502 [2024-11-26 15:51:19.888345] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.502 [2024-11-26 15:51:19.888373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-11-26 15:51:19.898187] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.502 [2024-11-26 15:51:19.898314] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.502 [2024-11-26 15:51:19.898340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.502 [2024-11-26 15:51:19.898354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.502 [2024-11-26 15:51:19.898367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.502 [2024-11-26 15:51:19.898395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-11-26 15:51:19.908224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.502 [2024-11-26 15:51:19.908337] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.502 [2024-11-26 15:51:19.908363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.502 [2024-11-26 15:51:19.908377] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.502 [2024-11-26 15:51:19.908388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.502 [2024-11-26 15:51:19.908416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-11-26 15:51:19.918241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.502 [2024-11-26 15:51:19.918350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.502 [2024-11-26 15:51:19.918376] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.502 [2024-11-26 15:51:19.918390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.502 [2024-11-26 15:51:19.918403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.502 [2024-11-26 15:51:19.918431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-11-26 15:51:19.928285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.502 [2024-11-26 15:51:19.928394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.502 [2024-11-26 15:51:19.928420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.502 [2024-11-26 15:51:19.928440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.502 [2024-11-26 15:51:19.928453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.502 [2024-11-26 15:51:19.928482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-11-26 15:51:19.938325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.502 [2024-11-26 15:51:19.938475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.502 [2024-11-26 15:51:19.938501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.502 [2024-11-26 15:51:19.938515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.502 [2024-11-26 15:51:19.938528] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.502 [2024-11-26 15:51:19.938556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.761 [2024-11-26 15:51:19.948399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.761 [2024-11-26 15:51:19.948529] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.761 [2024-11-26 15:51:19.948554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.761 [2024-11-26 15:51:19.948569] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.761 [2024-11-26 15:51:19.948581] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.761 [2024-11-26 15:51:19.948610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.762 qpair failed and we were unable to recover it. 00:27:28.762 [2024-11-26 15:51:19.958394] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.762 [2024-11-26 15:51:19.958514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.762 [2024-11-26 15:51:19.958540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.762 [2024-11-26 15:51:19.958554] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.762 [2024-11-26 15:51:19.958566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.762 [2024-11-26 15:51:19.958594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.762 qpair failed and we were unable to recover it. 00:27:28.762 [2024-11-26 15:51:19.968404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.762 [2024-11-26 15:51:19.968512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.762 [2024-11-26 15:51:19.968538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.762 [2024-11-26 15:51:19.968553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.762 [2024-11-26 15:51:19.968565] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.762 [2024-11-26 15:51:19.968593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.762 qpair failed and we were unable to recover it. 00:27:28.762 [2024-11-26 15:51:19.978451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.762 [2024-11-26 15:51:19.978560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.762 [2024-11-26 15:51:19.978585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.762 [2024-11-26 15:51:19.978598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.762 [2024-11-26 15:51:19.978611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.762 [2024-11-26 15:51:19.978638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.762 qpair failed and we were unable to recover it. 00:27:28.762 [2024-11-26 15:51:19.988536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.762 [2024-11-26 15:51:19.988650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.762 [2024-11-26 15:51:19.988676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.762 [2024-11-26 15:51:19.988700] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.762 [2024-11-26 15:51:19.988714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.762 [2024-11-26 15:51:19.988743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.762 qpair failed and we were unable to recover it. 00:27:28.762 [2024-11-26 15:51:19.998482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.762 [2024-11-26 15:51:19.998588] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.762 [2024-11-26 15:51:19.998615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.762 [2024-11-26 15:51:19.998629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.762 [2024-11-26 15:51:19.998641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.762 [2024-11-26 15:51:19.998670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.762 qpair failed and we were unable to recover it. 00:27:28.762 [2024-11-26 15:51:20.008532] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.762 [2024-11-26 15:51:20.008646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.762 [2024-11-26 15:51:20.008674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.762 [2024-11-26 15:51:20.008701] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.762 [2024-11-26 15:51:20.008718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.762 [2024-11-26 15:51:20.008749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.762 qpair failed and we were unable to recover it. 00:27:28.762 [2024-11-26 15:51:20.018545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.762 [2024-11-26 15:51:20.018658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.762 [2024-11-26 15:51:20.018694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.762 [2024-11-26 15:51:20.018720] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.762 [2024-11-26 15:51:20.018735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.762 [2024-11-26 15:51:20.018766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.762 qpair failed and we were unable to recover it. 00:27:28.762 [2024-11-26 15:51:20.028600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.762 [2024-11-26 15:51:20.028722] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.762 [2024-11-26 15:51:20.028760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.762 [2024-11-26 15:51:20.028777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.762 [2024-11-26 15:51:20.028789] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.762 [2024-11-26 15:51:20.028819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.762 qpair failed and we were unable to recover it. 00:27:28.762 [2024-11-26 15:51:20.038620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.762 [2024-11-26 15:51:20.038727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.762 [2024-11-26 15:51:20.038756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.762 [2024-11-26 15:51:20.038770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.762 [2024-11-26 15:51:20.038782] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.762 [2024-11-26 15:51:20.038812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.762 qpair failed and we were unable to recover it. 00:27:28.762 [2024-11-26 15:51:20.048662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.762 [2024-11-26 15:51:20.048802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.762 [2024-11-26 15:51:20.048829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.762 [2024-11-26 15:51:20.048843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.762 [2024-11-26 15:51:20.048856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.763 [2024-11-26 15:51:20.048884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.763 qpair failed and we were unable to recover it. 00:27:28.763 [2024-11-26 15:51:20.058675] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.763 [2024-11-26 15:51:20.058791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.763 [2024-11-26 15:51:20.058817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.763 [2024-11-26 15:51:20.058832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.763 [2024-11-26 15:51:20.058844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.763 [2024-11-26 15:51:20.058873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.763 qpair failed and we were unable to recover it. 00:27:28.763 [2024-11-26 15:51:20.068746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.763 [2024-11-26 15:51:20.068857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.763 [2024-11-26 15:51:20.068882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.763 [2024-11-26 15:51:20.068896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.763 [2024-11-26 15:51:20.068909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.763 [2024-11-26 15:51:20.068937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.763 qpair failed and we were unable to recover it. 00:27:28.763 [2024-11-26 15:51:20.078779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.763 [2024-11-26 15:51:20.078888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.763 [2024-11-26 15:51:20.078918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.763 [2024-11-26 15:51:20.078932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.763 [2024-11-26 15:51:20.078945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.763 [2024-11-26 15:51:20.078974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.763 qpair failed and we were unable to recover it. 00:27:28.763 [2024-11-26 15:51:20.088787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.763 [2024-11-26 15:51:20.088895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.763 [2024-11-26 15:51:20.088921] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.763 [2024-11-26 15:51:20.088935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.763 [2024-11-26 15:51:20.088948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.763 [2024-11-26 15:51:20.088976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.763 qpair failed and we were unable to recover it. 00:27:28.763 [2024-11-26 15:51:20.098816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.763 [2024-11-26 15:51:20.098925] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.763 [2024-11-26 15:51:20.098950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.763 [2024-11-26 15:51:20.098966] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.763 [2024-11-26 15:51:20.098979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.763 [2024-11-26 15:51:20.099007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.763 qpair failed and we were unable to recover it. 00:27:28.763 [2024-11-26 15:51:20.108828] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.763 [2024-11-26 15:51:20.108933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.763 [2024-11-26 15:51:20.108959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.763 [2024-11-26 15:51:20.108979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.763 [2024-11-26 15:51:20.108992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.763 [2024-11-26 15:51:20.109020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.763 qpair failed and we were unable to recover it. 00:27:28.763 [2024-11-26 15:51:20.118855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.763 [2024-11-26 15:51:20.118957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.763 [2024-11-26 15:51:20.118983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.763 [2024-11-26 15:51:20.118996] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.763 [2024-11-26 15:51:20.119008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.763 [2024-11-26 15:51:20.119037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.763 qpair failed and we were unable to recover it. 00:27:28.763 [2024-11-26 15:51:20.128887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.763 [2024-11-26 15:51:20.128992] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.763 [2024-11-26 15:51:20.129019] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.763 [2024-11-26 15:51:20.129033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.763 [2024-11-26 15:51:20.129045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.763 [2024-11-26 15:51:20.129073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.763 qpair failed and we were unable to recover it. 00:27:28.763 [2024-11-26 15:51:20.138900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.763 [2024-11-26 15:51:20.139000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.763 [2024-11-26 15:51:20.139025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.763 [2024-11-26 15:51:20.139039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.763 [2024-11-26 15:51:20.139052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.763 [2024-11-26 15:51:20.139081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.763 qpair failed and we were unable to recover it. 00:27:28.763 [2024-11-26 15:51:20.148926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.763 [2024-11-26 15:51:20.149024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.763 [2024-11-26 15:51:20.149049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.763 [2024-11-26 15:51:20.149063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.763 [2024-11-26 15:51:20.149075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.763 [2024-11-26 15:51:20.149104] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.763 qpair failed and we were unable to recover it. 00:27:28.763 [2024-11-26 15:51:20.158974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.763 [2024-11-26 15:51:20.159101] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.763 [2024-11-26 15:51:20.159128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.763 [2024-11-26 15:51:20.159142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.763 [2024-11-26 15:51:20.159154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.763 [2024-11-26 15:51:20.159182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.763 qpair failed and we were unable to recover it. 00:27:28.763 [2024-11-26 15:51:20.169004] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.763 [2024-11-26 15:51:20.169121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.763 [2024-11-26 15:51:20.169149] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.763 [2024-11-26 15:51:20.169165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.763 [2024-11-26 15:51:20.169177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.763 [2024-11-26 15:51:20.169206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.763 qpair failed and we were unable to recover it. 00:27:28.764 [2024-11-26 15:51:20.179022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.764 [2024-11-26 15:51:20.179128] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.764 [2024-11-26 15:51:20.179154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.764 [2024-11-26 15:51:20.179168] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.764 [2024-11-26 15:51:20.179180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.764 [2024-11-26 15:51:20.179210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.764 qpair failed and we were unable to recover it. 00:27:28.764 [2024-11-26 15:51:20.189070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.764 [2024-11-26 15:51:20.189222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.764 [2024-11-26 15:51:20.189248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.764 [2024-11-26 15:51:20.189262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.764 [2024-11-26 15:51:20.189275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.764 [2024-11-26 15:51:20.189305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.764 qpair failed and we were unable to recover it. 00:27:28.764 [2024-11-26 15:51:20.199064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.764 [2024-11-26 15:51:20.199166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.764 [2024-11-26 15:51:20.199192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.764 [2024-11-26 15:51:20.199212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.764 [2024-11-26 15:51:20.199225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:28.764 [2024-11-26 15:51:20.199253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:28.764 qpair failed and we were unable to recover it. 00:27:29.024 [2024-11-26 15:51:20.209109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.024 [2024-11-26 15:51:20.209248] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.024 [2024-11-26 15:51:20.209273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.024 [2024-11-26 15:51:20.209288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.024 [2024-11-26 15:51:20.209300] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.024 [2024-11-26 15:51:20.209327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.024 qpair failed and we were unable to recover it. 00:27:29.024 [2024-11-26 15:51:20.219122] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.024 [2024-11-26 15:51:20.219231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.025 [2024-11-26 15:51:20.219256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.025 [2024-11-26 15:51:20.219270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.025 [2024-11-26 15:51:20.219283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.025 [2024-11-26 15:51:20.219310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.025 qpair failed and we were unable to recover it. 00:27:29.025 [2024-11-26 15:51:20.229174] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.025 [2024-11-26 15:51:20.229282] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.025 [2024-11-26 15:51:20.229307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.025 [2024-11-26 15:51:20.229321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.025 [2024-11-26 15:51:20.229333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.025 [2024-11-26 15:51:20.229361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.025 qpair failed and we were unable to recover it. 00:27:29.025 [2024-11-26 15:51:20.239196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.025 [2024-11-26 15:51:20.239298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.025 [2024-11-26 15:51:20.239324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.025 [2024-11-26 15:51:20.239337] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.025 [2024-11-26 15:51:20.239349] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.025 [2024-11-26 15:51:20.239379] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.025 qpair failed and we were unable to recover it. 00:27:29.025 [2024-11-26 15:51:20.249301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.025 [2024-11-26 15:51:20.249456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.025 [2024-11-26 15:51:20.249481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.025 [2024-11-26 15:51:20.249496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.025 [2024-11-26 15:51:20.249508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.025 [2024-11-26 15:51:20.249536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.025 qpair failed and we were unable to recover it. 00:27:29.025 [2024-11-26 15:51:20.259321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.025 [2024-11-26 15:51:20.259478] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.025 [2024-11-26 15:51:20.259503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.025 [2024-11-26 15:51:20.259517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.025 [2024-11-26 15:51:20.259529] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.025 [2024-11-26 15:51:20.259557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.025 qpair failed and we were unable to recover it. 00:27:29.025 [2024-11-26 15:51:20.269329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.025 [2024-11-26 15:51:20.269450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.025 [2024-11-26 15:51:20.269475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.025 [2024-11-26 15:51:20.269489] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.025 [2024-11-26 15:51:20.269501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.025 [2024-11-26 15:51:20.269529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.025 qpair failed and we were unable to recover it. 00:27:29.025 [2024-11-26 15:51:20.279341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.025 [2024-11-26 15:51:20.279462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.025 [2024-11-26 15:51:20.279487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.025 [2024-11-26 15:51:20.279501] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.025 [2024-11-26 15:51:20.279513] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.025 [2024-11-26 15:51:20.279541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.025 qpair failed and we were unable to recover it. 00:27:29.025 [2024-11-26 15:51:20.289385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.025 [2024-11-26 15:51:20.289500] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.025 [2024-11-26 15:51:20.289530] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.025 [2024-11-26 15:51:20.289545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.025 [2024-11-26 15:51:20.289558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.025 [2024-11-26 15:51:20.289585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.025 qpair failed and we were unable to recover it. 00:27:29.025 [2024-11-26 15:51:20.299365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.025 [2024-11-26 15:51:20.299473] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.025 [2024-11-26 15:51:20.299499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.025 [2024-11-26 15:51:20.299513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.025 [2024-11-26 15:51:20.299525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.025 [2024-11-26 15:51:20.299554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.025 qpair failed and we were unable to recover it. 00:27:29.025 [2024-11-26 15:51:20.309398] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.025 [2024-11-26 15:51:20.309499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.025 [2024-11-26 15:51:20.309524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.025 [2024-11-26 15:51:20.309538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.025 [2024-11-26 15:51:20.309550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.025 [2024-11-26 15:51:20.309578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.025 qpair failed and we were unable to recover it. 00:27:29.025 [2024-11-26 15:51:20.319427] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.025 [2024-11-26 15:51:20.319537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.025 [2024-11-26 15:51:20.319563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.025 [2024-11-26 15:51:20.319577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.025 [2024-11-26 15:51:20.319589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.025 [2024-11-26 15:51:20.319617] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.025 qpair failed and we were unable to recover it. 00:27:29.025 [2024-11-26 15:51:20.329500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.025 [2024-11-26 15:51:20.329614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.025 [2024-11-26 15:51:20.329639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.025 [2024-11-26 15:51:20.329653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.025 [2024-11-26 15:51:20.329665] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.025 [2024-11-26 15:51:20.329700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.025 qpair failed and we were unable to recover it. 00:27:29.025 [2024-11-26 15:51:20.339512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.025 [2024-11-26 15:51:20.339617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.025 [2024-11-26 15:51:20.339643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.025 [2024-11-26 15:51:20.339656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.025 [2024-11-26 15:51:20.339669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.025 [2024-11-26 15:51:20.339703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.025 qpair failed and we were unable to recover it. 00:27:29.025 [2024-11-26 15:51:20.349510] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.025 [2024-11-26 15:51:20.349643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.025 [2024-11-26 15:51:20.349670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.026 [2024-11-26 15:51:20.349683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.026 [2024-11-26 15:51:20.349706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.026 [2024-11-26 15:51:20.349734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.026 qpair failed and we were unable to recover it. 00:27:29.026 [2024-11-26 15:51:20.359539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.026 [2024-11-26 15:51:20.359641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.026 [2024-11-26 15:51:20.359666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.026 [2024-11-26 15:51:20.359681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.026 [2024-11-26 15:51:20.359700] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.026 [2024-11-26 15:51:20.359731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.026 qpair failed and we were unable to recover it. 00:27:29.026 [2024-11-26 15:51:20.369558] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.026 [2024-11-26 15:51:20.369666] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.026 [2024-11-26 15:51:20.369700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.026 [2024-11-26 15:51:20.369716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.026 [2024-11-26 15:51:20.369729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.026 [2024-11-26 15:51:20.369757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.026 qpair failed and we were unable to recover it. 00:27:29.026 [2024-11-26 15:51:20.379605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.026 [2024-11-26 15:51:20.379712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.026 [2024-11-26 15:51:20.379744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.026 [2024-11-26 15:51:20.379759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.026 [2024-11-26 15:51:20.379771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.026 [2024-11-26 15:51:20.379799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.026 qpair failed and we were unable to recover it. 00:27:29.026 [2024-11-26 15:51:20.389614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.026 [2024-11-26 15:51:20.389742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.026 [2024-11-26 15:51:20.389768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.026 [2024-11-26 15:51:20.389782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.026 [2024-11-26 15:51:20.389794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.026 [2024-11-26 15:51:20.389822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.026 qpair failed and we were unable to recover it. 00:27:29.026 [2024-11-26 15:51:20.399648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.026 [2024-11-26 15:51:20.399762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.026 [2024-11-26 15:51:20.399787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.026 [2024-11-26 15:51:20.399801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.026 [2024-11-26 15:51:20.399813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.026 [2024-11-26 15:51:20.399842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.026 qpair failed and we were unable to recover it. 00:27:29.026 [2024-11-26 15:51:20.409697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.026 [2024-11-26 15:51:20.409821] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.026 [2024-11-26 15:51:20.409846] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.026 [2024-11-26 15:51:20.409860] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.026 [2024-11-26 15:51:20.409872] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.026 [2024-11-26 15:51:20.409900] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.026 qpair failed and we were unable to recover it. 00:27:29.026 [2024-11-26 15:51:20.419705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.026 [2024-11-26 15:51:20.419811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.026 [2024-11-26 15:51:20.419835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.026 [2024-11-26 15:51:20.419850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.026 [2024-11-26 15:51:20.419863] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.026 [2024-11-26 15:51:20.419896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.026 qpair failed and we were unable to recover it. 00:27:29.026 [2024-11-26 15:51:20.429787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.026 [2024-11-26 15:51:20.429897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.026 [2024-11-26 15:51:20.429923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.026 [2024-11-26 15:51:20.429937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.026 [2024-11-26 15:51:20.429948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.026 [2024-11-26 15:51:20.429976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.026 qpair failed and we were unable to recover it. 00:27:29.026 [2024-11-26 15:51:20.439799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.026 [2024-11-26 15:51:20.439925] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.026 [2024-11-26 15:51:20.439950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.026 [2024-11-26 15:51:20.439964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.026 [2024-11-26 15:51:20.439977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.026 [2024-11-26 15:51:20.440004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.026 qpair failed and we were unable to recover it. 00:27:29.026 [2024-11-26 15:51:20.449852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.026 [2024-11-26 15:51:20.449968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.026 [2024-11-26 15:51:20.449993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.026 [2024-11-26 15:51:20.450006] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.026 [2024-11-26 15:51:20.450018] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.026 [2024-11-26 15:51:20.450047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.026 qpair failed and we were unable to recover it. 00:27:29.026 [2024-11-26 15:51:20.459861] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.026 [2024-11-26 15:51:20.459985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.026 [2024-11-26 15:51:20.460010] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.026 [2024-11-26 15:51:20.460024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.026 [2024-11-26 15:51:20.460036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.026 [2024-11-26 15:51:20.460063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.026 qpair failed and we were unable to recover it. 00:27:29.026 [2024-11-26 15:51:20.469926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.026 [2024-11-26 15:51:20.470038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.026 [2024-11-26 15:51:20.470068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.026 [2024-11-26 15:51:20.470083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.026 [2024-11-26 15:51:20.470095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.026 [2024-11-26 15:51:20.470122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.026 qpair failed and we were unable to recover it. 00:27:29.286 [2024-11-26 15:51:20.479874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.286 [2024-11-26 15:51:20.479980] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.286 [2024-11-26 15:51:20.480005] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.286 [2024-11-26 15:51:20.480019] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.286 [2024-11-26 15:51:20.480031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.286 [2024-11-26 15:51:20.480060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.286 qpair failed and we were unable to recover it. 00:27:29.286 [2024-11-26 15:51:20.489926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.286 [2024-11-26 15:51:20.490054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.286 [2024-11-26 15:51:20.490079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.286 [2024-11-26 15:51:20.490093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.286 [2024-11-26 15:51:20.490105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.286 [2024-11-26 15:51:20.490132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.286 qpair failed and we were unable to recover it. 00:27:29.286 [2024-11-26 15:51:20.499946] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.286 [2024-11-26 15:51:20.500050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.286 [2024-11-26 15:51:20.500074] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.286 [2024-11-26 15:51:20.500088] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.286 [2024-11-26 15:51:20.500101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.286 [2024-11-26 15:51:20.500129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.286 qpair failed and we were unable to recover it. 00:27:29.286 [2024-11-26 15:51:20.510023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.286 [2024-11-26 15:51:20.510128] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.286 [2024-11-26 15:51:20.510153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.286 [2024-11-26 15:51:20.510166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.286 [2024-11-26 15:51:20.510178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.286 [2024-11-26 15:51:20.510213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.286 qpair failed and we were unable to recover it. 00:27:29.286 [2024-11-26 15:51:20.519996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.286 [2024-11-26 15:51:20.520099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.286 [2024-11-26 15:51:20.520124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.286 [2024-11-26 15:51:20.520138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.286 [2024-11-26 15:51:20.520150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.286 [2024-11-26 15:51:20.520179] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.286 qpair failed and we were unable to recover it. 00:27:29.286 [2024-11-26 15:51:20.530044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.286 [2024-11-26 15:51:20.530158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.286 [2024-11-26 15:51:20.530183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.286 [2024-11-26 15:51:20.530197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.286 [2024-11-26 15:51:20.530209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.286 [2024-11-26 15:51:20.530237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.286 qpair failed and we were unable to recover it. 00:27:29.286 [2024-11-26 15:51:20.540104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.286 [2024-11-26 15:51:20.540204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.286 [2024-11-26 15:51:20.540230] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.286 [2024-11-26 15:51:20.540243] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.286 [2024-11-26 15:51:20.540256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.286 [2024-11-26 15:51:20.540283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.286 qpair failed and we were unable to recover it. 00:27:29.286 [2024-11-26 15:51:20.550125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.286 [2024-11-26 15:51:20.550230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.286 [2024-11-26 15:51:20.550255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.286 [2024-11-26 15:51:20.550269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.287 [2024-11-26 15:51:20.550281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.287 [2024-11-26 15:51:20.550309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.287 qpair failed and we were unable to recover it. 00:27:29.287 [2024-11-26 15:51:20.560148] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.287 [2024-11-26 15:51:20.560250] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.287 [2024-11-26 15:51:20.560281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.287 [2024-11-26 15:51:20.560295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.287 [2024-11-26 15:51:20.560308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.287 [2024-11-26 15:51:20.560336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.287 qpair failed and we were unable to recover it. 00:27:29.287 [2024-11-26 15:51:20.570141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.287 [2024-11-26 15:51:20.570247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.287 [2024-11-26 15:51:20.570273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.287 [2024-11-26 15:51:20.570287] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.287 [2024-11-26 15:51:20.570299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.287 [2024-11-26 15:51:20.570327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.287 qpair failed and we were unable to recover it. 00:27:29.287 [2024-11-26 15:51:20.580228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.287 [2024-11-26 15:51:20.580388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.287 [2024-11-26 15:51:20.580413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.287 [2024-11-26 15:51:20.580427] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.287 [2024-11-26 15:51:20.580439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.287 [2024-11-26 15:51:20.580467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.287 qpair failed and we were unable to recover it. 00:27:29.287 [2024-11-26 15:51:20.590224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.287 [2024-11-26 15:51:20.590334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.287 [2024-11-26 15:51:20.590359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.287 [2024-11-26 15:51:20.590373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.287 [2024-11-26 15:51:20.590386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.287 [2024-11-26 15:51:20.590413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.287 qpair failed and we were unable to recover it. 00:27:29.287 [2024-11-26 15:51:20.600220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.287 [2024-11-26 15:51:20.600346] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.287 [2024-11-26 15:51:20.600370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.287 [2024-11-26 15:51:20.600384] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.287 [2024-11-26 15:51:20.600395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.287 [2024-11-26 15:51:20.600430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.287 qpair failed and we were unable to recover it. 00:27:29.287 [2024-11-26 15:51:20.610293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.287 [2024-11-26 15:51:20.610417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.287 [2024-11-26 15:51:20.610442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.287 [2024-11-26 15:51:20.610456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.287 [2024-11-26 15:51:20.610470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.287 [2024-11-26 15:51:20.610497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.287 qpair failed and we were unable to recover it. 00:27:29.287 [2024-11-26 15:51:20.620310] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.287 [2024-11-26 15:51:20.620416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.287 [2024-11-26 15:51:20.620441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.287 [2024-11-26 15:51:20.620454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.287 [2024-11-26 15:51:20.620467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.287 [2024-11-26 15:51:20.620495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.287 qpair failed and we were unable to recover it. 00:27:29.287 [2024-11-26 15:51:20.630318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.287 [2024-11-26 15:51:20.630435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.287 [2024-11-26 15:51:20.630460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.287 [2024-11-26 15:51:20.630474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.287 [2024-11-26 15:51:20.630485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.287 [2024-11-26 15:51:20.630512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.287 qpair failed and we were unable to recover it. 00:27:29.287 [2024-11-26 15:51:20.640380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.287 [2024-11-26 15:51:20.640507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.287 [2024-11-26 15:51:20.640532] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.287 [2024-11-26 15:51:20.640546] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.287 [2024-11-26 15:51:20.640559] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.287 [2024-11-26 15:51:20.640586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.287 qpair failed and we were unable to recover it. 00:27:29.287 [2024-11-26 15:51:20.650404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.287 [2024-11-26 15:51:20.650527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.287 [2024-11-26 15:51:20.650564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.287 [2024-11-26 15:51:20.650579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.287 [2024-11-26 15:51:20.650592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.287 [2024-11-26 15:51:20.650621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.287 qpair failed and we were unable to recover it. 00:27:29.287 [2024-11-26 15:51:20.660424] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.287 [2024-11-26 15:51:20.660533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.287 [2024-11-26 15:51:20.660558] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.287 [2024-11-26 15:51:20.660572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.288 [2024-11-26 15:51:20.660584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.288 [2024-11-26 15:51:20.660613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.288 qpair failed and we were unable to recover it. 00:27:29.288 [2024-11-26 15:51:20.670459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.288 [2024-11-26 15:51:20.670563] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.288 [2024-11-26 15:51:20.670589] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.288 [2024-11-26 15:51:20.670602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.288 [2024-11-26 15:51:20.670615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.288 [2024-11-26 15:51:20.670643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.288 qpair failed and we were unable to recover it. 00:27:29.288 [2024-11-26 15:51:20.680489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.288 [2024-11-26 15:51:20.680614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.288 [2024-11-26 15:51:20.680639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.288 [2024-11-26 15:51:20.680653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.288 [2024-11-26 15:51:20.680666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.288 [2024-11-26 15:51:20.680701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.288 qpair failed and we were unable to recover it. 00:27:29.288 [2024-11-26 15:51:20.690593] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.288 [2024-11-26 15:51:20.690713] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.288 [2024-11-26 15:51:20.690739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.288 [2024-11-26 15:51:20.690753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.288 [2024-11-26 15:51:20.690771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.288 [2024-11-26 15:51:20.690799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.288 qpair failed and we were unable to recover it. 00:27:29.288 [2024-11-26 15:51:20.700535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.288 [2024-11-26 15:51:20.700636] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.288 [2024-11-26 15:51:20.700661] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.288 [2024-11-26 15:51:20.700675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.288 [2024-11-26 15:51:20.700695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.288 [2024-11-26 15:51:20.700725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.288 qpair failed and we were unable to recover it. 00:27:29.288 [2024-11-26 15:51:20.710592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.288 [2024-11-26 15:51:20.710706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.288 [2024-11-26 15:51:20.710731] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.288 [2024-11-26 15:51:20.710744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.288 [2024-11-26 15:51:20.710756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.288 [2024-11-26 15:51:20.710784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.288 qpair failed and we were unable to recover it. 00:27:29.288 [2024-11-26 15:51:20.720657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.288 [2024-11-26 15:51:20.720796] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.288 [2024-11-26 15:51:20.720822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.288 [2024-11-26 15:51:20.720836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.288 [2024-11-26 15:51:20.720848] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.288 [2024-11-26 15:51:20.720876] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.288 qpair failed and we were unable to recover it. 00:27:29.288 [2024-11-26 15:51:20.730670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.288 [2024-11-26 15:51:20.730819] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.288 [2024-11-26 15:51:20.730843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.288 [2024-11-26 15:51:20.730857] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.288 [2024-11-26 15:51:20.730869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.288 [2024-11-26 15:51:20.730898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.288 qpair failed and we were unable to recover it. 00:27:29.546 [2024-11-26 15:51:20.740647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.546 [2024-11-26 15:51:20.740771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.546 [2024-11-26 15:51:20.740802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.546 [2024-11-26 15:51:20.740816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.546 [2024-11-26 15:51:20.740829] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.546 [2024-11-26 15:51:20.740857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.546 qpair failed and we were unable to recover it. 00:27:29.546 [2024-11-26 15:51:20.750697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.546 [2024-11-26 15:51:20.750804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.546 [2024-11-26 15:51:20.750829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.546 [2024-11-26 15:51:20.750843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.546 [2024-11-26 15:51:20.750855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.546 [2024-11-26 15:51:20.750883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.546 qpair failed and we were unable to recover it. 00:27:29.546 [2024-11-26 15:51:20.760800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.547 [2024-11-26 15:51:20.760900] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.547 [2024-11-26 15:51:20.760925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.547 [2024-11-26 15:51:20.760939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.547 [2024-11-26 15:51:20.760952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.547 [2024-11-26 15:51:20.760980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.547 qpair failed and we were unable to recover it. 00:27:29.547 [2024-11-26 15:51:20.770754] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.547 [2024-11-26 15:51:20.770904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.547 [2024-11-26 15:51:20.770928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.547 [2024-11-26 15:51:20.770943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.547 [2024-11-26 15:51:20.770955] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.547 [2024-11-26 15:51:20.770983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.547 qpair failed and we were unable to recover it. 00:27:29.547 [2024-11-26 15:51:20.780820] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.547 [2024-11-26 15:51:20.780926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.547 [2024-11-26 15:51:20.780951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.547 [2024-11-26 15:51:20.780964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.547 [2024-11-26 15:51:20.780982] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.547 [2024-11-26 15:51:20.781012] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.547 qpair failed and we were unable to recover it. 00:27:29.547 [2024-11-26 15:51:20.790794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.547 [2024-11-26 15:51:20.790942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.547 [2024-11-26 15:51:20.790967] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.547 [2024-11-26 15:51:20.790981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.547 [2024-11-26 15:51:20.790994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.547 [2024-11-26 15:51:20.791021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.547 qpair failed and we were unable to recover it. 00:27:29.547 [2024-11-26 15:51:20.800883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.547 [2024-11-26 15:51:20.800985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.547 [2024-11-26 15:51:20.801010] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.547 [2024-11-26 15:51:20.801024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.547 [2024-11-26 15:51:20.801036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x164dcb0 00:27:29.547 [2024-11-26 15:51:20.801064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.547 qpair failed and we were unable to recover it. 00:27:29.547 [2024-11-26 15:51:20.810871] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.547 [2024-11-26 15:51:20.810980] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.547 [2024-11-26 15:51:20.811013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.547 [2024-11-26 15:51:20.811028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.547 [2024-11-26 15:51:20.811041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc190000b90 00:27:29.547 [2024-11-26 15:51:20.811073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:29.547 qpair failed and we were unable to recover it. 00:27:29.547 [2024-11-26 15:51:20.820890] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.547 [2024-11-26 15:51:20.821001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.547 [2024-11-26 15:51:20.821027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.547 [2024-11-26 15:51:20.821043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.547 [2024-11-26 15:51:20.821056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc190000b90 00:27:29.547 [2024-11-26 15:51:20.821086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:29.547 qpair failed and we were unable to recover it. 00:27:29.547 [2024-11-26 15:51:20.830943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.547 [2024-11-26 15:51:20.831058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.547 [2024-11-26 15:51:20.831092] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.547 [2024-11-26 15:51:20.831109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.547 [2024-11-26 15:51:20.831122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc184000b90 00:27:29.547 [2024-11-26 15:51:20.831153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:29.547 qpair failed and we were unable to recover it. 00:27:29.547 [2024-11-26 15:51:20.840982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.547 [2024-11-26 15:51:20.841107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.547 [2024-11-26 15:51:20.841135] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.547 [2024-11-26 15:51:20.841150] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.547 [2024-11-26 15:51:20.841163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc184000b90 00:27:29.547 [2024-11-26 15:51:20.841195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:29.547 qpair failed and we were unable to recover it. 00:27:29.547 [2024-11-26 15:51:20.850994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.547 [2024-11-26 15:51:20.851108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.547 [2024-11-26 15:51:20.851140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.547 [2024-11-26 15:51:20.851156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.547 [2024-11-26 15:51:20.851169] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc188000b90 00:27:29.547 [2024-11-26 15:51:20.851199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.547 qpair failed and we were unable to recover it. 00:27:29.547 [2024-11-26 15:51:20.860994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.547 [2024-11-26 15:51:20.861095] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.547 [2024-11-26 15:51:20.861122] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.547 [2024-11-26 15:51:20.861138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.547 [2024-11-26 15:51:20.861150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc188000b90 00:27:29.547 [2024-11-26 15:51:20.861182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:29.547 qpair failed and we were unable to recover it. 00:27:29.547 [2024-11-26 15:51:20.861276] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:27:29.547 A controller has encountered a failure and is being reset. 00:27:29.547 Controller properly reset. 00:27:29.547 Initializing NVMe Controllers 00:27:29.547 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:29.547 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:29.547 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:27:29.547 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:27:29.547 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:27:29.547 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:27:29.547 Initialization complete. Launching workers. 00:27:29.547 Starting thread on core 1 00:27:29.547 Starting thread on core 2 00:27:29.547 Starting thread on core 3 00:27:29.547 Starting thread on core 0 00:27:29.547 15:51:20 -- host/target_disconnect.sh@59 -- # sync 00:27:29.547 00:27:29.547 real 0m11.530s 00:27:29.547 user 0m21.667s 00:27:29.547 sys 0m5.350s 00:27:29.547 15:51:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:29.547 15:51:20 -- common/autotest_common.sh@10 -- # set +x 00:27:29.547 ************************************ 00:27:29.547 END TEST nvmf_target_disconnect_tc2 00:27:29.547 ************************************ 00:27:29.547 15:51:20 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:27:29.547 15:51:20 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:27:29.547 15:51:20 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:27:29.547 15:51:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:29.547 15:51:20 -- nvmf/common.sh@116 -- # sync 00:27:29.547 15:51:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:29.547 15:51:20 -- nvmf/common.sh@119 -- # set +e 00:27:29.548 15:51:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:29.548 15:51:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:29.548 rmmod nvme_tcp 00:27:29.806 rmmod nvme_fabrics 00:27:29.806 rmmod nvme_keyring 00:27:29.806 15:51:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:29.806 15:51:21 -- nvmf/common.sh@123 -- # set -e 00:27:29.806 15:51:21 -- nvmf/common.sh@124 -- # return 0 00:27:29.806 15:51:21 -- nvmf/common.sh@477 -- # '[' -n 986767 ']' 00:27:29.806 15:51:21 -- nvmf/common.sh@478 -- # killprocess 986767 00:27:29.806 15:51:21 -- common/autotest_common.sh@936 -- # '[' -z 986767 ']' 00:27:29.806 15:51:21 -- common/autotest_common.sh@940 -- # kill -0 986767 00:27:29.806 15:51:21 -- common/autotest_common.sh@941 -- # uname 00:27:29.806 15:51:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:29.806 15:51:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 986767 00:27:29.806 15:51:21 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:27:29.806 15:51:21 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:27:29.806 15:51:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 986767' 00:27:29.806 killing process with pid 986767 00:27:29.806 15:51:21 -- common/autotest_common.sh@955 -- # kill 986767 00:27:29.806 15:51:21 -- common/autotest_common.sh@960 -- # wait 986767 00:27:30.065 15:51:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:30.065 15:51:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:30.065 15:51:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:30.065 15:51:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:30.065 15:51:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:30.065 15:51:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:30.065 15:51:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:30.065 15:51:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:31.973 15:51:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:31.973 00:27:31.973 real 0m16.468s 00:27:31.973 user 0m47.864s 00:27:31.973 sys 0m7.379s 00:27:31.973 15:51:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:31.973 15:51:23 -- common/autotest_common.sh@10 -- # set +x 00:27:31.973 ************************************ 00:27:31.973 END TEST nvmf_target_disconnect 00:27:31.973 ************************************ 00:27:31.973 15:51:23 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:27:31.973 15:51:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:31.973 15:51:23 -- common/autotest_common.sh@10 -- # set +x 00:27:32.232 15:51:23 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:27:32.232 00:27:32.232 real 21m30.729s 00:27:32.232 user 62m24.731s 00:27:32.232 sys 5m0.462s 00:27:32.232 15:51:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:32.232 15:51:23 -- common/autotest_common.sh@10 -- # set +x 00:27:32.232 ************************************ 00:27:32.232 END TEST nvmf_tcp 00:27:32.232 ************************************ 00:27:32.232 15:51:23 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:27:32.232 15:51:23 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:32.232 15:51:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:32.232 15:51:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:32.232 15:51:23 -- common/autotest_common.sh@10 -- # set +x 00:27:32.232 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:27:32.232 ************************************ 00:27:32.232 START TEST spdkcli_nvmf_tcp 00:27:32.232 ************************************ 00:27:32.232 15:51:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:32.232 * Looking for test storage... 00:27:32.232 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:27:32.232 15:51:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:32.232 15:51:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:32.232 15:51:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:32.232 15:51:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:32.232 15:51:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:32.232 15:51:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:32.232 15:51:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:32.232 15:51:23 -- scripts/common.sh@335 -- # IFS=.-: 00:27:32.232 15:51:23 -- scripts/common.sh@335 -- # read -ra ver1 00:27:32.232 15:51:23 -- scripts/common.sh@336 -- # IFS=.-: 00:27:32.232 15:51:23 -- scripts/common.sh@336 -- # read -ra ver2 00:27:32.232 15:51:23 -- scripts/common.sh@337 -- # local 'op=<' 00:27:32.232 15:51:23 -- scripts/common.sh@339 -- # ver1_l=2 00:27:32.232 15:51:23 -- scripts/common.sh@340 -- # ver2_l=1 00:27:32.232 15:51:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:32.232 15:51:23 -- scripts/common.sh@343 -- # case "$op" in 00:27:32.232 15:51:23 -- scripts/common.sh@344 -- # : 1 00:27:32.232 15:51:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:32.232 15:51:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:32.232 15:51:23 -- scripts/common.sh@364 -- # decimal 1 00:27:32.232 15:51:23 -- scripts/common.sh@352 -- # local d=1 00:27:32.232 15:51:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:32.232 15:51:23 -- scripts/common.sh@354 -- # echo 1 00:27:32.232 15:51:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:32.232 15:51:23 -- scripts/common.sh@365 -- # decimal 2 00:27:32.232 15:51:23 -- scripts/common.sh@352 -- # local d=2 00:27:32.232 15:51:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:32.232 15:51:23 -- scripts/common.sh@354 -- # echo 2 00:27:32.232 15:51:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:32.232 15:51:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:32.232 15:51:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:32.232 15:51:23 -- scripts/common.sh@367 -- # return 0 00:27:32.232 15:51:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:32.232 15:51:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:32.232 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:32.232 --rc genhtml_branch_coverage=1 00:27:32.232 --rc genhtml_function_coverage=1 00:27:32.232 --rc genhtml_legend=1 00:27:32.232 --rc geninfo_all_blocks=1 00:27:32.232 --rc geninfo_unexecuted_blocks=1 00:27:32.232 00:27:32.232 ' 00:27:32.232 15:51:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:32.232 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:32.232 --rc genhtml_branch_coverage=1 00:27:32.232 --rc genhtml_function_coverage=1 00:27:32.232 --rc genhtml_legend=1 00:27:32.232 --rc geninfo_all_blocks=1 00:27:32.232 --rc geninfo_unexecuted_blocks=1 00:27:32.232 00:27:32.232 ' 00:27:32.232 15:51:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:32.232 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:32.232 --rc genhtml_branch_coverage=1 00:27:32.232 --rc genhtml_function_coverage=1 00:27:32.232 --rc genhtml_legend=1 00:27:32.232 --rc geninfo_all_blocks=1 00:27:32.232 --rc geninfo_unexecuted_blocks=1 00:27:32.232 00:27:32.232 ' 00:27:32.232 15:51:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:32.232 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:32.232 --rc genhtml_branch_coverage=1 00:27:32.232 --rc genhtml_function_coverage=1 00:27:32.232 --rc genhtml_legend=1 00:27:32.232 --rc geninfo_all_blocks=1 00:27:32.232 --rc geninfo_unexecuted_blocks=1 00:27:32.232 00:27:32.232 ' 00:27:32.232 15:51:23 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:27:32.232 15:51:23 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:27:32.232 15:51:23 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:27:32.232 15:51:23 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:32.232 15:51:23 -- nvmf/common.sh@7 -- # uname -s 00:27:32.232 15:51:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:32.232 15:51:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:32.232 15:51:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:32.232 15:51:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:32.232 15:51:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:32.232 15:51:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:32.232 15:51:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:32.232 15:51:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:32.232 15:51:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:32.232 15:51:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:32.232 15:51:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:32.232 15:51:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:32.232 15:51:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:32.232 15:51:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:32.232 15:51:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:32.232 15:51:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:32.232 15:51:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:32.232 15:51:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:32.232 15:51:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:32.232 15:51:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.232 15:51:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.232 15:51:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.232 15:51:23 -- paths/export.sh@5 -- # export PATH 00:27:32.232 15:51:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.232 15:51:23 -- nvmf/common.sh@46 -- # : 0 00:27:32.232 15:51:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:32.232 15:51:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:32.232 15:51:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:32.232 15:51:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:32.232 15:51:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:32.232 15:51:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:32.232 15:51:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:32.232 15:51:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:32.232 15:51:23 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:27:32.232 15:51:23 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:27:32.232 15:51:23 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:27:32.232 15:51:23 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:27:32.232 15:51:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:32.232 15:51:23 -- common/autotest_common.sh@10 -- # set +x 00:27:32.232 15:51:23 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:27:32.232 15:51:23 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=987861 00:27:32.232 15:51:23 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:27:32.232 15:51:23 -- spdkcli/common.sh@34 -- # waitforlisten 987861 00:27:32.232 15:51:23 -- common/autotest_common.sh@829 -- # '[' -z 987861 ']' 00:27:32.233 15:51:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:32.233 15:51:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:32.233 15:51:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:32.233 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:32.233 15:51:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:32.233 15:51:23 -- common/autotest_common.sh@10 -- # set +x 00:27:32.233 [2024-11-26 15:51:23.650271] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:32.233 [2024-11-26 15:51:23.650349] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid987861 ] 00:27:32.492 EAL: No free 2048 kB hugepages reported on node 1 00:27:32.492 [2024-11-26 15:51:23.715115] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:32.492 [2024-11-26 15:51:23.823081] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:32.492 [2024-11-26 15:51:23.823333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:32.492 [2024-11-26 15:51:23.823338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:33.430 15:51:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:33.430 15:51:24 -- common/autotest_common.sh@862 -- # return 0 00:27:33.430 15:51:24 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:27:33.430 15:51:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:33.430 15:51:24 -- common/autotest_common.sh@10 -- # set +x 00:27:33.430 15:51:24 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:27:33.430 15:51:24 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:27:33.430 15:51:24 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:27:33.430 15:51:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:33.430 15:51:24 -- common/autotest_common.sh@10 -- # set +x 00:27:33.430 15:51:24 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:27:33.430 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:27:33.430 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:27:33.430 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:27:33.430 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:27:33.430 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:27:33.430 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:27:33.430 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:33.430 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:33.430 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:27:33.430 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:27:33.430 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:27:33.430 ' 00:27:33.690 [2024-11-26 15:51:25.075832] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:36.229 [2024-11-26 15:51:27.270449] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:37.167 [2024-11-26 15:51:28.543137] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:27:39.708 [2024-11-26 15:51:30.834526] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:27:41.617 [2024-11-26 15:51:32.808851] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:27:43.001 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:27:43.001 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:27:43.001 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:27:43.001 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:27:43.001 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:27:43.001 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:27:43.001 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:27:43.001 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:43.001 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:43.001 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:27:43.001 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:27:43.001 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:27:43.001 15:51:34 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:27:43.001 15:51:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:43.001 15:51:34 -- common/autotest_common.sh@10 -- # set +x 00:27:43.258 15:51:34 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:27:43.258 15:51:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:43.258 15:51:34 -- common/autotest_common.sh@10 -- # set +x 00:27:43.258 15:51:34 -- spdkcli/nvmf.sh@69 -- # check_match 00:27:43.258 15:51:34 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:27:43.515 15:51:34 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:27:43.515 15:51:34 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:27:43.515 15:51:34 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:27:43.515 15:51:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:43.515 15:51:34 -- common/autotest_common.sh@10 -- # set +x 00:27:43.515 15:51:34 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:27:43.515 15:51:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:43.515 15:51:34 -- common/autotest_common.sh@10 -- # set +x 00:27:43.515 15:51:34 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:27:43.515 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:27:43.515 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:27:43.515 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:27:43.515 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:27:43.515 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:27:43.515 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:27:43.515 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:27:43.516 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:27:43.516 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:27:43.516 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:27:43.516 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:27:43.516 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:27:43.516 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:27:43.516 ' 00:27:48.788 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:27:48.788 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:27:48.788 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:27:48.788 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:27:48.788 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:27:48.788 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:27:48.788 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:27:48.788 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:27:48.788 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:27:48.788 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:27:48.788 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:27:48.788 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:27:48.788 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:27:48.788 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:27:48.788 15:51:40 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:27:48.788 15:51:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:48.788 15:51:40 -- common/autotest_common.sh@10 -- # set +x 00:27:49.046 15:51:40 -- spdkcli/nvmf.sh@90 -- # killprocess 987861 00:27:49.046 15:51:40 -- common/autotest_common.sh@936 -- # '[' -z 987861 ']' 00:27:49.046 15:51:40 -- common/autotest_common.sh@940 -- # kill -0 987861 00:27:49.046 15:51:40 -- common/autotest_common.sh@941 -- # uname 00:27:49.046 15:51:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:49.046 15:51:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 987861 00:27:49.046 15:51:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:49.046 15:51:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:49.046 15:51:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 987861' 00:27:49.046 killing process with pid 987861 00:27:49.046 15:51:40 -- common/autotest_common.sh@955 -- # kill 987861 00:27:49.046 [2024-11-26 15:51:40.281343] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:49.046 15:51:40 -- common/autotest_common.sh@960 -- # wait 987861 00:27:49.305 15:51:40 -- spdkcli/nvmf.sh@1 -- # cleanup 00:27:49.305 15:51:40 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:27:49.305 15:51:40 -- spdkcli/common.sh@13 -- # '[' -n 987861 ']' 00:27:49.305 15:51:40 -- spdkcli/common.sh@14 -- # killprocess 987861 00:27:49.305 15:51:40 -- common/autotest_common.sh@936 -- # '[' -z 987861 ']' 00:27:49.305 15:51:40 -- common/autotest_common.sh@940 -- # kill -0 987861 00:27:49.305 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (987861) - No such process 00:27:49.305 15:51:40 -- common/autotest_common.sh@963 -- # echo 'Process with pid 987861 is not found' 00:27:49.305 Process with pid 987861 is not found 00:27:49.305 15:51:40 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:27:49.305 15:51:40 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:27:49.305 15:51:40 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:27:49.305 00:27:49.305 real 0m17.093s 00:27:49.305 user 0m36.404s 00:27:49.305 sys 0m0.835s 00:27:49.305 15:51:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:49.305 15:51:40 -- common/autotest_common.sh@10 -- # set +x 00:27:49.305 ************************************ 00:27:49.305 END TEST spdkcli_nvmf_tcp 00:27:49.305 ************************************ 00:27:49.305 15:51:40 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:27:49.305 15:51:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:49.305 15:51:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:49.305 15:51:40 -- common/autotest_common.sh@10 -- # set +x 00:27:49.305 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:27:49.305 ************************************ 00:27:49.305 START TEST nvmf_identify_passthru 00:27:49.305 ************************************ 00:27:49.305 15:51:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:27:49.305 * Looking for test storage... 00:27:49.305 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:27:49.305 15:51:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:49.305 15:51:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:49.305 15:51:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:49.305 15:51:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:49.305 15:51:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:49.305 15:51:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:49.305 15:51:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:49.305 15:51:40 -- scripts/common.sh@335 -- # IFS=.-: 00:27:49.305 15:51:40 -- scripts/common.sh@335 -- # read -ra ver1 00:27:49.305 15:51:40 -- scripts/common.sh@336 -- # IFS=.-: 00:27:49.305 15:51:40 -- scripts/common.sh@336 -- # read -ra ver2 00:27:49.305 15:51:40 -- scripts/common.sh@337 -- # local 'op=<' 00:27:49.305 15:51:40 -- scripts/common.sh@339 -- # ver1_l=2 00:27:49.305 15:51:40 -- scripts/common.sh@340 -- # ver2_l=1 00:27:49.305 15:51:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:49.305 15:51:40 -- scripts/common.sh@343 -- # case "$op" in 00:27:49.305 15:51:40 -- scripts/common.sh@344 -- # : 1 00:27:49.305 15:51:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:49.305 15:51:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:49.305 15:51:40 -- scripts/common.sh@364 -- # decimal 1 00:27:49.305 15:51:40 -- scripts/common.sh@352 -- # local d=1 00:27:49.305 15:51:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:49.305 15:51:40 -- scripts/common.sh@354 -- # echo 1 00:27:49.305 15:51:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:49.305 15:51:40 -- scripts/common.sh@365 -- # decimal 2 00:27:49.305 15:51:40 -- scripts/common.sh@352 -- # local d=2 00:27:49.305 15:51:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:49.305 15:51:40 -- scripts/common.sh@354 -- # echo 2 00:27:49.305 15:51:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:49.305 15:51:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:49.305 15:51:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:49.305 15:51:40 -- scripts/common.sh@367 -- # return 0 00:27:49.305 15:51:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:49.305 15:51:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:49.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:49.305 --rc genhtml_branch_coverage=1 00:27:49.305 --rc genhtml_function_coverage=1 00:27:49.305 --rc genhtml_legend=1 00:27:49.305 --rc geninfo_all_blocks=1 00:27:49.305 --rc geninfo_unexecuted_blocks=1 00:27:49.305 00:27:49.305 ' 00:27:49.305 15:51:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:49.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:49.305 --rc genhtml_branch_coverage=1 00:27:49.305 --rc genhtml_function_coverage=1 00:27:49.305 --rc genhtml_legend=1 00:27:49.305 --rc geninfo_all_blocks=1 00:27:49.305 --rc geninfo_unexecuted_blocks=1 00:27:49.305 00:27:49.305 ' 00:27:49.305 15:51:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:49.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:49.305 --rc genhtml_branch_coverage=1 00:27:49.305 --rc genhtml_function_coverage=1 00:27:49.305 --rc genhtml_legend=1 00:27:49.305 --rc geninfo_all_blocks=1 00:27:49.305 --rc geninfo_unexecuted_blocks=1 00:27:49.305 00:27:49.305 ' 00:27:49.305 15:51:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:49.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:49.305 --rc genhtml_branch_coverage=1 00:27:49.305 --rc genhtml_function_coverage=1 00:27:49.305 --rc genhtml_legend=1 00:27:49.305 --rc geninfo_all_blocks=1 00:27:49.305 --rc geninfo_unexecuted_blocks=1 00:27:49.305 00:27:49.305 ' 00:27:49.305 15:51:40 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:49.305 15:51:40 -- nvmf/common.sh@7 -- # uname -s 00:27:49.305 15:51:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:49.305 15:51:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:49.305 15:51:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:49.305 15:51:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:49.305 15:51:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:49.305 15:51:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:49.305 15:51:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:49.305 15:51:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:49.305 15:51:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:49.305 15:51:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:49.305 15:51:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:49.305 15:51:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:49.305 15:51:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:49.305 15:51:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:49.305 15:51:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:49.305 15:51:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:49.305 15:51:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:49.305 15:51:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:49.305 15:51:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:49.305 15:51:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.305 15:51:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.305 15:51:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.305 15:51:40 -- paths/export.sh@5 -- # export PATH 00:27:49.305 15:51:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.306 15:51:40 -- nvmf/common.sh@46 -- # : 0 00:27:49.306 15:51:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:49.306 15:51:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:49.306 15:51:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:49.306 15:51:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:49.306 15:51:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:49.306 15:51:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:49.306 15:51:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:49.306 15:51:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:49.306 15:51:40 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:49.306 15:51:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:49.306 15:51:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:49.306 15:51:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:49.306 15:51:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.306 15:51:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.306 15:51:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.306 15:51:40 -- paths/export.sh@5 -- # export PATH 00:27:49.306 15:51:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.306 15:51:40 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:27:49.306 15:51:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:49.306 15:51:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:49.306 15:51:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:49.306 15:51:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:49.306 15:51:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:49.306 15:51:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:49.306 15:51:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:27:49.306 15:51:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:49.306 15:51:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:49.306 15:51:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:49.306 15:51:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:49.306 15:51:40 -- common/autotest_common.sh@10 -- # set +x 00:27:51.211 15:51:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:51.211 15:51:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:51.211 15:51:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:51.211 15:51:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:51.211 15:51:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:51.211 15:51:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:51.211 15:51:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:51.211 15:51:42 -- nvmf/common.sh@294 -- # net_devs=() 00:27:51.211 15:51:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:51.211 15:51:42 -- nvmf/common.sh@295 -- # e810=() 00:27:51.211 15:51:42 -- nvmf/common.sh@295 -- # local -ga e810 00:27:51.211 15:51:42 -- nvmf/common.sh@296 -- # x722=() 00:27:51.211 15:51:42 -- nvmf/common.sh@296 -- # local -ga x722 00:27:51.211 15:51:42 -- nvmf/common.sh@297 -- # mlx=() 00:27:51.211 15:51:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:51.211 15:51:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:51.211 15:51:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:51.211 15:51:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:51.211 15:51:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:51.211 15:51:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:51.211 15:51:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:51.211 15:51:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:51.211 15:51:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:51.211 15:51:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:51.211 15:51:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:51.211 15:51:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:51.211 15:51:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:51.211 15:51:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:51.211 15:51:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:51.211 15:51:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:51.211 15:51:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:51.211 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:51.211 15:51:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:51.211 15:51:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:51.211 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:51.211 15:51:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:51.211 15:51:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:51.211 15:51:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:51.211 15:51:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:51.211 15:51:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:51.211 15:51:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:51.211 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:51.211 15:51:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:51.211 15:51:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:51.211 15:51:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:51.211 15:51:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:51.211 15:51:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:51.211 15:51:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:51.211 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:51.211 15:51:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:51.211 15:51:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:51.211 15:51:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:51.211 15:51:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:51.211 15:51:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:51.211 15:51:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:51.211 15:51:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:51.211 15:51:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:51.211 15:51:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:51.211 15:51:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:51.211 15:51:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:51.211 15:51:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:51.211 15:51:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:51.211 15:51:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:51.211 15:51:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:51.211 15:51:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:51.470 15:51:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:51.470 15:51:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:51.471 15:51:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:51.471 15:51:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:51.471 15:51:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:51.471 15:51:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:51.471 15:51:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:51.471 15:51:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:51.471 15:51:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:51.471 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:51.471 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:27:51.471 00:27:51.471 --- 10.0.0.2 ping statistics --- 00:27:51.471 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:51.471 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:27:51.471 15:51:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:51.471 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:51.471 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:27:51.471 00:27:51.471 --- 10.0.0.1 ping statistics --- 00:27:51.471 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:51.471 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:27:51.471 15:51:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:51.471 15:51:42 -- nvmf/common.sh@410 -- # return 0 00:27:51.471 15:51:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:51.471 15:51:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:51.471 15:51:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:51.471 15:51:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:51.471 15:51:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:51.471 15:51:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:51.471 15:51:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:51.471 15:51:42 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:27:51.471 15:51:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:51.471 15:51:42 -- common/autotest_common.sh@10 -- # set +x 00:27:51.471 15:51:42 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:27:51.471 15:51:42 -- common/autotest_common.sh@1519 -- # bdfs=() 00:27:51.471 15:51:42 -- common/autotest_common.sh@1519 -- # local bdfs 00:27:51.471 15:51:42 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:27:51.471 15:51:42 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:27:51.471 15:51:42 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:51.471 15:51:42 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:51.471 15:51:42 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:51.471 15:51:42 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:51.471 15:51:42 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:51.471 15:51:42 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:51.471 15:51:42 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:51.471 15:51:42 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:27:51.471 15:51:42 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:27:51.471 15:51:42 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:27:51.471 15:51:42 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:27:51.471 15:51:42 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:27:51.471 15:51:42 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:27:51.471 EAL: No free 2048 kB hugepages reported on node 1 00:27:55.678 15:51:47 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:27:55.678 15:51:47 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:27:55.678 15:51:47 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:27:55.678 15:51:47 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:27:55.938 EAL: No free 2048 kB hugepages reported on node 1 00:28:00.160 15:51:51 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:00.160 15:51:51 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:00.160 15:51:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:00.160 15:51:51 -- common/autotest_common.sh@10 -- # set +x 00:28:00.160 15:51:51 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:00.160 15:51:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:00.160 15:51:51 -- common/autotest_common.sh@10 -- # set +x 00:28:00.160 15:51:51 -- target/identify_passthru.sh@31 -- # nvmfpid=992528 00:28:00.160 15:51:51 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:00.160 15:51:51 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:00.160 15:51:51 -- target/identify_passthru.sh@35 -- # waitforlisten 992528 00:28:00.160 15:51:51 -- common/autotest_common.sh@829 -- # '[' -z 992528 ']' 00:28:00.160 15:51:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:00.160 15:51:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:00.160 15:51:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:00.160 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:00.160 15:51:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:00.160 15:51:51 -- common/autotest_common.sh@10 -- # set +x 00:28:00.160 [2024-11-26 15:51:51.406298] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:00.160 [2024-11-26 15:51:51.406368] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:00.160 EAL: No free 2048 kB hugepages reported on node 1 00:28:00.160 [2024-11-26 15:51:51.468025] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:00.160 [2024-11-26 15:51:51.572849] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:00.160 [2024-11-26 15:51:51.573004] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:00.160 [2024-11-26 15:51:51.573021] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:00.160 [2024-11-26 15:51:51.573033] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:00.160 [2024-11-26 15:51:51.573092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:00.160 [2024-11-26 15:51:51.573153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:00.160 [2024-11-26 15:51:51.573219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:00.160 [2024-11-26 15:51:51.573222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:00.421 15:51:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:00.421 15:51:51 -- common/autotest_common.sh@862 -- # return 0 00:28:00.421 15:51:51 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:00.421 15:51:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:00.421 15:51:51 -- common/autotest_common.sh@10 -- # set +x 00:28:00.421 INFO: Log level set to 20 00:28:00.421 INFO: Requests: 00:28:00.421 { 00:28:00.421 "jsonrpc": "2.0", 00:28:00.421 "method": "nvmf_set_config", 00:28:00.421 "id": 1, 00:28:00.421 "params": { 00:28:00.421 "admin_cmd_passthru": { 00:28:00.421 "identify_ctrlr": true 00:28:00.421 } 00:28:00.421 } 00:28:00.421 } 00:28:00.421 00:28:00.421 INFO: response: 00:28:00.421 { 00:28:00.421 "jsonrpc": "2.0", 00:28:00.421 "id": 1, 00:28:00.421 "result": true 00:28:00.421 } 00:28:00.421 00:28:00.421 15:51:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:00.421 15:51:51 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:00.421 15:51:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:00.421 15:51:51 -- common/autotest_common.sh@10 -- # set +x 00:28:00.421 INFO: Setting log level to 20 00:28:00.421 INFO: Setting log level to 20 00:28:00.421 INFO: Log level set to 20 00:28:00.421 INFO: Log level set to 20 00:28:00.421 INFO: Requests: 00:28:00.421 { 00:28:00.421 "jsonrpc": "2.0", 00:28:00.421 "method": "framework_start_init", 00:28:00.421 "id": 1 00:28:00.421 } 00:28:00.421 00:28:00.421 INFO: Requests: 00:28:00.421 { 00:28:00.421 "jsonrpc": "2.0", 00:28:00.421 "method": "framework_start_init", 00:28:00.421 "id": 1 00:28:00.421 } 00:28:00.421 00:28:00.421 [2024-11-26 15:51:51.736064] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:00.421 INFO: response: 00:28:00.421 { 00:28:00.421 "jsonrpc": "2.0", 00:28:00.421 "id": 1, 00:28:00.421 "result": true 00:28:00.421 } 00:28:00.421 00:28:00.421 INFO: response: 00:28:00.421 { 00:28:00.421 "jsonrpc": "2.0", 00:28:00.421 "id": 1, 00:28:00.421 "result": true 00:28:00.421 } 00:28:00.421 00:28:00.421 15:51:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:00.421 15:51:51 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:00.421 15:51:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:00.421 15:51:51 -- common/autotest_common.sh@10 -- # set +x 00:28:00.421 INFO: Setting log level to 40 00:28:00.421 INFO: Setting log level to 40 00:28:00.421 INFO: Setting log level to 40 00:28:00.421 [2024-11-26 15:51:51.746151] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:00.421 15:51:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:00.421 15:51:51 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:00.421 15:51:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:00.421 15:51:51 -- common/autotest_common.sh@10 -- # set +x 00:28:00.421 15:51:51 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:00.421 15:51:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:00.421 15:51:51 -- common/autotest_common.sh@10 -- # set +x 00:28:03.709 Nvme0n1 00:28:03.709 15:51:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:03.710 15:51:54 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:03.710 15:51:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:03.710 15:51:54 -- common/autotest_common.sh@10 -- # set +x 00:28:03.710 15:51:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:03.710 15:51:54 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:03.710 15:51:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:03.710 15:51:54 -- common/autotest_common.sh@10 -- # set +x 00:28:03.710 15:51:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:03.710 15:51:54 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:03.710 15:51:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:03.710 15:51:54 -- common/autotest_common.sh@10 -- # set +x 00:28:03.710 [2024-11-26 15:51:54.644129] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:03.710 15:51:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:03.710 15:51:54 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:03.710 15:51:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:03.710 15:51:54 -- common/autotest_common.sh@10 -- # set +x 00:28:03.710 [2024-11-26 15:51:54.651774] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:03.710 [ 00:28:03.710 { 00:28:03.710 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:03.710 "subtype": "Discovery", 00:28:03.710 "listen_addresses": [], 00:28:03.710 "allow_any_host": true, 00:28:03.710 "hosts": [] 00:28:03.710 }, 00:28:03.710 { 00:28:03.710 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:03.710 "subtype": "NVMe", 00:28:03.710 "listen_addresses": [ 00:28:03.710 { 00:28:03.710 "transport": "TCP", 00:28:03.710 "trtype": "TCP", 00:28:03.710 "adrfam": "IPv4", 00:28:03.710 "traddr": "10.0.0.2", 00:28:03.710 "trsvcid": "4420" 00:28:03.710 } 00:28:03.710 ], 00:28:03.710 "allow_any_host": true, 00:28:03.710 "hosts": [], 00:28:03.710 "serial_number": "SPDK00000000000001", 00:28:03.710 "model_number": "SPDK bdev Controller", 00:28:03.710 "max_namespaces": 1, 00:28:03.710 "min_cntlid": 1, 00:28:03.710 "max_cntlid": 65519, 00:28:03.710 "namespaces": [ 00:28:03.710 { 00:28:03.710 "nsid": 1, 00:28:03.710 "bdev_name": "Nvme0n1", 00:28:03.710 "name": "Nvme0n1", 00:28:03.710 "nguid": "D97AC51AC0A04466B088C941862D0EE4", 00:28:03.710 "uuid": "d97ac51a-c0a0-4466-b088-c941862d0ee4" 00:28:03.710 } 00:28:03.710 ] 00:28:03.710 } 00:28:03.710 ] 00:28:03.710 15:51:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:03.710 15:51:54 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:03.710 15:51:54 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:03.710 15:51:54 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:03.710 EAL: No free 2048 kB hugepages reported on node 1 00:28:03.710 15:51:54 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:03.710 15:51:54 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:03.710 15:51:54 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:03.710 15:51:54 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:03.710 EAL: No free 2048 kB hugepages reported on node 1 00:28:03.710 15:51:54 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:03.710 15:51:54 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:03.710 15:51:54 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:03.710 15:51:54 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:03.710 15:51:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:03.710 15:51:54 -- common/autotest_common.sh@10 -- # set +x 00:28:03.710 15:51:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:03.710 15:51:54 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:03.710 15:51:54 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:03.710 15:51:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:03.710 15:51:54 -- nvmf/common.sh@116 -- # sync 00:28:03.710 15:51:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:03.710 15:51:54 -- nvmf/common.sh@119 -- # set +e 00:28:03.710 15:51:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:03.710 15:51:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:03.710 rmmod nvme_tcp 00:28:03.710 rmmod nvme_fabrics 00:28:03.710 rmmod nvme_keyring 00:28:03.710 15:51:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:03.710 15:51:54 -- nvmf/common.sh@123 -- # set -e 00:28:03.710 15:51:54 -- nvmf/common.sh@124 -- # return 0 00:28:03.710 15:51:54 -- nvmf/common.sh@477 -- # '[' -n 992528 ']' 00:28:03.710 15:51:54 -- nvmf/common.sh@478 -- # killprocess 992528 00:28:03.710 15:51:54 -- common/autotest_common.sh@936 -- # '[' -z 992528 ']' 00:28:03.710 15:51:54 -- common/autotest_common.sh@940 -- # kill -0 992528 00:28:03.710 15:51:54 -- common/autotest_common.sh@941 -- # uname 00:28:03.710 15:51:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:03.710 15:51:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 992528 00:28:03.710 15:51:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:03.710 15:51:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:03.710 15:51:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 992528' 00:28:03.710 killing process with pid 992528 00:28:03.710 15:51:55 -- common/autotest_common.sh@955 -- # kill 992528 00:28:03.710 [2024-11-26 15:51:55.006118] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:03.710 15:51:55 -- common/autotest_common.sh@960 -- # wait 992528 00:28:05.616 15:51:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:05.616 15:51:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:05.616 15:51:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:05.616 15:51:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:05.616 15:51:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:05.616 15:51:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:05.616 15:51:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:05.616 15:51:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:07.526 15:51:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:07.526 00:28:07.526 real 0m18.092s 00:28:07.526 user 0m26.637s 00:28:07.526 sys 0m2.294s 00:28:07.526 15:51:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:07.526 15:51:58 -- common/autotest_common.sh@10 -- # set +x 00:28:07.526 ************************************ 00:28:07.526 END TEST nvmf_identify_passthru 00:28:07.526 ************************************ 00:28:07.526 15:51:58 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:07.526 15:51:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:07.526 15:51:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:07.526 15:51:58 -- common/autotest_common.sh@10 -- # set +x 00:28:07.526 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:28:07.526 ************************************ 00:28:07.526 START TEST nvmf_dif 00:28:07.526 ************************************ 00:28:07.526 15:51:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:07.526 * Looking for test storage... 00:28:07.526 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:07.527 15:51:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:07.527 15:51:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:07.527 15:51:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:07.527 15:51:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:07.527 15:51:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:07.527 15:51:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:07.527 15:51:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:07.527 15:51:58 -- scripts/common.sh@335 -- # IFS=.-: 00:28:07.527 15:51:58 -- scripts/common.sh@335 -- # read -ra ver1 00:28:07.527 15:51:58 -- scripts/common.sh@336 -- # IFS=.-: 00:28:07.527 15:51:58 -- scripts/common.sh@336 -- # read -ra ver2 00:28:07.527 15:51:58 -- scripts/common.sh@337 -- # local 'op=<' 00:28:07.527 15:51:58 -- scripts/common.sh@339 -- # ver1_l=2 00:28:07.527 15:51:58 -- scripts/common.sh@340 -- # ver2_l=1 00:28:07.527 15:51:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:07.527 15:51:58 -- scripts/common.sh@343 -- # case "$op" in 00:28:07.527 15:51:58 -- scripts/common.sh@344 -- # : 1 00:28:07.527 15:51:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:07.527 15:51:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:07.527 15:51:58 -- scripts/common.sh@364 -- # decimal 1 00:28:07.527 15:51:58 -- scripts/common.sh@352 -- # local d=1 00:28:07.527 15:51:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:07.527 15:51:58 -- scripts/common.sh@354 -- # echo 1 00:28:07.527 15:51:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:07.527 15:51:58 -- scripts/common.sh@365 -- # decimal 2 00:28:07.527 15:51:58 -- scripts/common.sh@352 -- # local d=2 00:28:07.527 15:51:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:07.527 15:51:58 -- scripts/common.sh@354 -- # echo 2 00:28:07.527 15:51:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:07.527 15:51:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:07.527 15:51:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:07.527 15:51:58 -- scripts/common.sh@367 -- # return 0 00:28:07.527 15:51:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:07.527 15:51:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:07.527 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:07.527 --rc genhtml_branch_coverage=1 00:28:07.527 --rc genhtml_function_coverage=1 00:28:07.527 --rc genhtml_legend=1 00:28:07.527 --rc geninfo_all_blocks=1 00:28:07.527 --rc geninfo_unexecuted_blocks=1 00:28:07.527 00:28:07.527 ' 00:28:07.527 15:51:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:07.527 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:07.527 --rc genhtml_branch_coverage=1 00:28:07.527 --rc genhtml_function_coverage=1 00:28:07.527 --rc genhtml_legend=1 00:28:07.527 --rc geninfo_all_blocks=1 00:28:07.527 --rc geninfo_unexecuted_blocks=1 00:28:07.527 00:28:07.527 ' 00:28:07.527 15:51:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:07.527 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:07.527 --rc genhtml_branch_coverage=1 00:28:07.527 --rc genhtml_function_coverage=1 00:28:07.527 --rc genhtml_legend=1 00:28:07.527 --rc geninfo_all_blocks=1 00:28:07.527 --rc geninfo_unexecuted_blocks=1 00:28:07.527 00:28:07.527 ' 00:28:07.527 15:51:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:07.527 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:07.527 --rc genhtml_branch_coverage=1 00:28:07.527 --rc genhtml_function_coverage=1 00:28:07.527 --rc genhtml_legend=1 00:28:07.527 --rc geninfo_all_blocks=1 00:28:07.527 --rc geninfo_unexecuted_blocks=1 00:28:07.527 00:28:07.527 ' 00:28:07.527 15:51:58 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:07.527 15:51:58 -- nvmf/common.sh@7 -- # uname -s 00:28:07.527 15:51:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:07.527 15:51:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:07.527 15:51:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:07.527 15:51:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:07.527 15:51:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:07.527 15:51:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:07.527 15:51:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:07.527 15:51:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:07.527 15:51:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:07.527 15:51:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:07.527 15:51:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:07.527 15:51:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:07.527 15:51:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:07.527 15:51:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:07.527 15:51:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:07.527 15:51:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:07.527 15:51:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:07.527 15:51:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:07.527 15:51:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:07.527 15:51:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:07.527 15:51:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:07.527 15:51:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:07.527 15:51:58 -- paths/export.sh@5 -- # export PATH 00:28:07.527 15:51:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:07.527 15:51:58 -- nvmf/common.sh@46 -- # : 0 00:28:07.527 15:51:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:07.527 15:51:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:07.527 15:51:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:07.527 15:51:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:07.527 15:51:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:07.527 15:51:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:07.527 15:51:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:07.527 15:51:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:07.527 15:51:58 -- target/dif.sh@15 -- # NULL_META=16 00:28:07.527 15:51:58 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:07.527 15:51:58 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:07.527 15:51:58 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:07.527 15:51:58 -- target/dif.sh@135 -- # nvmftestinit 00:28:07.527 15:51:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:07.527 15:51:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:07.527 15:51:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:07.527 15:51:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:07.527 15:51:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:07.527 15:51:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:07.527 15:51:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:07.527 15:51:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:07.527 15:51:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:07.527 15:51:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:07.527 15:51:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:07.527 15:51:58 -- common/autotest_common.sh@10 -- # set +x 00:28:09.431 15:52:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:09.431 15:52:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:09.431 15:52:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:09.432 15:52:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:09.432 15:52:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:09.432 15:52:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:09.432 15:52:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:09.432 15:52:00 -- nvmf/common.sh@294 -- # net_devs=() 00:28:09.432 15:52:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:09.432 15:52:00 -- nvmf/common.sh@295 -- # e810=() 00:28:09.432 15:52:00 -- nvmf/common.sh@295 -- # local -ga e810 00:28:09.432 15:52:00 -- nvmf/common.sh@296 -- # x722=() 00:28:09.432 15:52:00 -- nvmf/common.sh@296 -- # local -ga x722 00:28:09.432 15:52:00 -- nvmf/common.sh@297 -- # mlx=() 00:28:09.432 15:52:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:09.432 15:52:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:09.432 15:52:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:09.432 15:52:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:09.432 15:52:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:09.432 15:52:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:09.432 15:52:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:09.432 15:52:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:09.432 15:52:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:09.432 15:52:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:09.432 15:52:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:09.432 15:52:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:09.432 15:52:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:09.432 15:52:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:09.432 15:52:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:09.432 15:52:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:09.432 15:52:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:09.432 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:09.432 15:52:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:09.432 15:52:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:09.432 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:09.432 15:52:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:09.432 15:52:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:09.432 15:52:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:09.432 15:52:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:09.432 15:52:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:09.432 15:52:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:09.432 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:09.432 15:52:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:09.432 15:52:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:09.432 15:52:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:09.432 15:52:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:09.432 15:52:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:09.432 15:52:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:09.432 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:09.432 15:52:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:09.432 15:52:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:09.432 15:52:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:09.432 15:52:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:09.432 15:52:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:09.432 15:52:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:09.432 15:52:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:09.432 15:52:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:09.432 15:52:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:09.432 15:52:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:09.432 15:52:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:09.432 15:52:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:09.432 15:52:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:09.432 15:52:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:09.432 15:52:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:09.432 15:52:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:09.432 15:52:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:09.432 15:52:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:09.691 15:52:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:09.691 15:52:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:09.691 15:52:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:09.691 15:52:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:09.691 15:52:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:09.691 15:52:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:09.691 15:52:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:09.691 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:09.691 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.369 ms 00:28:09.692 00:28:09.692 --- 10.0.0.2 ping statistics --- 00:28:09.692 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:09.692 rtt min/avg/max/mdev = 0.369/0.369/0.369/0.000 ms 00:28:09.692 15:52:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:09.692 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:09.692 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.181 ms 00:28:09.692 00:28:09.692 --- 10.0.0.1 ping statistics --- 00:28:09.692 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:09.692 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:28:09.692 15:52:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:09.692 15:52:01 -- nvmf/common.sh@410 -- # return 0 00:28:09.692 15:52:01 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:09.692 15:52:01 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:11.068 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:11.068 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:11.068 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:11.068 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:11.068 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:11.068 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:11.068 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:11.068 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:11.068 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:11.068 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:11.068 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:11.068 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:11.068 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:11.068 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:11.068 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:11.068 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:11.068 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:11.068 15:52:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:11.068 15:52:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:11.068 15:52:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:11.068 15:52:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:11.068 15:52:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:11.068 15:52:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:11.068 15:52:02 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:11.068 15:52:02 -- target/dif.sh@137 -- # nvmfappstart 00:28:11.068 15:52:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:11.068 15:52:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:11.068 15:52:02 -- common/autotest_common.sh@10 -- # set +x 00:28:11.068 15:52:02 -- nvmf/common.sh@469 -- # nvmfpid=995778 00:28:11.068 15:52:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:11.068 15:52:02 -- nvmf/common.sh@470 -- # waitforlisten 995778 00:28:11.068 15:52:02 -- common/autotest_common.sh@829 -- # '[' -z 995778 ']' 00:28:11.068 15:52:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:11.068 15:52:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:11.068 15:52:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:11.068 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:11.068 15:52:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:11.068 15:52:02 -- common/autotest_common.sh@10 -- # set +x 00:28:11.068 [2024-11-26 15:52:02.397204] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:11.068 [2024-11-26 15:52:02.397268] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:11.068 EAL: No free 2048 kB hugepages reported on node 1 00:28:11.068 [2024-11-26 15:52:02.461861] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:11.326 [2024-11-26 15:52:02.575001] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:11.326 [2024-11-26 15:52:02.575193] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:11.326 [2024-11-26 15:52:02.575226] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:11.326 [2024-11-26 15:52:02.575239] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:11.326 [2024-11-26 15:52:02.575291] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:12.265 15:52:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:12.265 15:52:03 -- common/autotest_common.sh@862 -- # return 0 00:28:12.265 15:52:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:12.265 15:52:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:12.265 15:52:03 -- common/autotest_common.sh@10 -- # set +x 00:28:12.265 15:52:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:12.265 15:52:03 -- target/dif.sh@139 -- # create_transport 00:28:12.265 15:52:03 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:12.265 15:52:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:12.266 15:52:03 -- common/autotest_common.sh@10 -- # set +x 00:28:12.266 [2024-11-26 15:52:03.375324] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:12.266 15:52:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:12.266 15:52:03 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:12.266 15:52:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:12.266 15:52:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:12.266 15:52:03 -- common/autotest_common.sh@10 -- # set +x 00:28:12.266 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:28:12.266 ************************************ 00:28:12.266 START TEST fio_dif_1_default 00:28:12.266 ************************************ 00:28:12.266 15:52:03 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:12.266 15:52:03 -- target/dif.sh@86 -- # create_subsystems 0 00:28:12.266 15:52:03 -- target/dif.sh@28 -- # local sub 00:28:12.266 15:52:03 -- target/dif.sh@30 -- # for sub in "$@" 00:28:12.266 15:52:03 -- target/dif.sh@31 -- # create_subsystem 0 00:28:12.266 15:52:03 -- target/dif.sh@18 -- # local sub_id=0 00:28:12.266 15:52:03 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:12.266 15:52:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:12.266 15:52:03 -- common/autotest_common.sh@10 -- # set +x 00:28:12.266 bdev_null0 00:28:12.266 15:52:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:12.266 15:52:03 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:12.266 15:52:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:12.266 15:52:03 -- common/autotest_common.sh@10 -- # set +x 00:28:12.266 15:52:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:12.266 15:52:03 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:12.266 15:52:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:12.266 15:52:03 -- common/autotest_common.sh@10 -- # set +x 00:28:12.266 15:52:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:12.266 15:52:03 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:12.266 15:52:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:12.266 15:52:03 -- common/autotest_common.sh@10 -- # set +x 00:28:12.266 [2024-11-26 15:52:03.411572] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:12.266 15:52:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:12.266 15:52:03 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:12.266 15:52:03 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:12.266 15:52:03 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:12.266 15:52:03 -- nvmf/common.sh@520 -- # config=() 00:28:12.266 15:52:03 -- nvmf/common.sh@520 -- # local subsystem config 00:28:12.266 15:52:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:12.266 15:52:03 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:12.266 15:52:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:12.266 { 00:28:12.266 "params": { 00:28:12.266 "name": "Nvme$subsystem", 00:28:12.266 "trtype": "$TEST_TRANSPORT", 00:28:12.266 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:12.266 "adrfam": "ipv4", 00:28:12.266 "trsvcid": "$NVMF_PORT", 00:28:12.266 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:12.266 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:12.266 "hdgst": ${hdgst:-false}, 00:28:12.266 "ddgst": ${ddgst:-false} 00:28:12.266 }, 00:28:12.266 "method": "bdev_nvme_attach_controller" 00:28:12.266 } 00:28:12.266 EOF 00:28:12.266 )") 00:28:12.266 15:52:03 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:12.266 15:52:03 -- target/dif.sh@82 -- # gen_fio_conf 00:28:12.266 15:52:03 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:12.266 15:52:03 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:12.266 15:52:03 -- target/dif.sh@54 -- # local file 00:28:12.266 15:52:03 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:12.266 15:52:03 -- target/dif.sh@56 -- # cat 00:28:12.266 15:52:03 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:12.266 15:52:03 -- common/autotest_common.sh@1330 -- # shift 00:28:12.266 15:52:03 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:12.266 15:52:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:12.266 15:52:03 -- nvmf/common.sh@542 -- # cat 00:28:12.266 15:52:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:12.266 15:52:03 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:12.266 15:52:03 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:12.266 15:52:03 -- target/dif.sh@72 -- # (( file <= files )) 00:28:12.266 15:52:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:12.266 15:52:03 -- nvmf/common.sh@544 -- # jq . 00:28:12.266 15:52:03 -- nvmf/common.sh@545 -- # IFS=, 00:28:12.266 15:52:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:12.266 "params": { 00:28:12.266 "name": "Nvme0", 00:28:12.266 "trtype": "tcp", 00:28:12.266 "traddr": "10.0.0.2", 00:28:12.266 "adrfam": "ipv4", 00:28:12.266 "trsvcid": "4420", 00:28:12.266 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:12.266 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:12.266 "hdgst": false, 00:28:12.266 "ddgst": false 00:28:12.266 }, 00:28:12.266 "method": "bdev_nvme_attach_controller" 00:28:12.266 }' 00:28:12.266 15:52:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:12.266 15:52:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:12.266 15:52:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:12.266 15:52:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:12.266 15:52:03 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:12.266 15:52:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:12.266 15:52:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:12.266 15:52:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:12.266 15:52:03 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:12.266 15:52:03 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:12.266 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:12.266 fio-3.35 00:28:12.266 Starting 1 thread 00:28:12.526 EAL: No free 2048 kB hugepages reported on node 1 00:28:12.787 [2024-11-26 15:52:04.221527] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:12.787 [2024-11-26 15:52:04.221625] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:24.981 00:28:24.981 filename0: (groupid=0, jobs=1): err= 0: pid=996016: Tue Nov 26 15:52:14 2024 00:28:24.981 read: IOPS=189, BW=760KiB/s (778kB/s)(7600KiB/10001msec) 00:28:24.981 slat (nsec): min=5189, max=64015, avg=8223.11, stdev=3093.73 00:28:24.981 clat (usec): min=637, max=46693, avg=21027.72, stdev=20294.16 00:28:24.981 lat (usec): min=644, max=46720, avg=21035.95, stdev=20293.95 00:28:24.981 clat percentiles (usec): 00:28:24.981 | 1.00th=[ 660], 5.00th=[ 668], 10.00th=[ 676], 20.00th=[ 685], 00:28:24.981 | 30.00th=[ 701], 40.00th=[ 717], 50.00th=[41157], 60.00th=[41157], 00:28:24.981 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:24.981 | 99.00th=[41157], 99.50th=[41157], 99.90th=[46924], 99.95th=[46924], 00:28:24.981 | 99.99th=[46924] 00:28:24.981 bw ( KiB/s): min= 672, max= 768, per=99.88%, avg=759.58, stdev=25.78, samples=19 00:28:24.981 iops : min= 168, max= 192, avg=189.89, stdev= 6.45, samples=19 00:28:24.981 lat (usec) : 750=47.21%, 1000=2.68% 00:28:24.981 lat (msec) : 50=50.11% 00:28:24.981 cpu : usr=91.17%, sys=8.53%, ctx=19, majf=0, minf=293 00:28:24.981 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:24.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:24.981 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:24.981 issued rwts: total=1900,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:24.981 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:24.982 00:28:24.982 Run status group 0 (all jobs): 00:28:24.982 READ: bw=760KiB/s (778kB/s), 760KiB/s-760KiB/s (778kB/s-778kB/s), io=7600KiB (7782kB), run=10001-10001msec 00:28:24.982 15:52:14 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:24.982 15:52:14 -- target/dif.sh@43 -- # local sub 00:28:24.982 15:52:14 -- target/dif.sh@45 -- # for sub in "$@" 00:28:24.982 15:52:14 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:24.982 15:52:14 -- target/dif.sh@36 -- # local sub_id=0 00:28:24.982 15:52:14 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:24.982 15:52:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.982 15:52:14 -- common/autotest_common.sh@10 -- # set +x 00:28:24.982 15:52:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.982 15:52:14 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:24.982 15:52:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.982 15:52:14 -- common/autotest_common.sh@10 -- # set +x 00:28:24.982 15:52:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.982 00:28:24.982 real 0m11.195s 00:28:24.982 user 0m10.404s 00:28:24.982 sys 0m1.132s 00:28:24.982 15:52:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:24.982 15:52:14 -- common/autotest_common.sh@10 -- # set +x 00:28:24.982 ************************************ 00:28:24.982 END TEST fio_dif_1_default 00:28:24.982 ************************************ 00:28:24.982 15:52:14 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:24.982 15:52:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:24.982 15:52:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:24.982 15:52:14 -- common/autotest_common.sh@10 -- # set +x 00:28:24.982 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:28:24.982 ************************************ 00:28:24.982 START TEST fio_dif_1_multi_subsystems 00:28:24.982 ************************************ 00:28:24.982 15:52:14 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:28:24.982 15:52:14 -- target/dif.sh@92 -- # local files=1 00:28:24.982 15:52:14 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:24.982 15:52:14 -- target/dif.sh@28 -- # local sub 00:28:24.982 15:52:14 -- target/dif.sh@30 -- # for sub in "$@" 00:28:24.982 15:52:14 -- target/dif.sh@31 -- # create_subsystem 0 00:28:24.982 15:52:14 -- target/dif.sh@18 -- # local sub_id=0 00:28:24.982 15:52:14 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:24.982 15:52:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.982 15:52:14 -- common/autotest_common.sh@10 -- # set +x 00:28:24.982 bdev_null0 00:28:24.982 15:52:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.982 15:52:14 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:24.982 15:52:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.982 15:52:14 -- common/autotest_common.sh@10 -- # set +x 00:28:24.982 15:52:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.982 15:52:14 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:24.982 15:52:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.982 15:52:14 -- common/autotest_common.sh@10 -- # set +x 00:28:24.982 15:52:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.982 15:52:14 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:24.982 15:52:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.982 15:52:14 -- common/autotest_common.sh@10 -- # set +x 00:28:24.982 [2024-11-26 15:52:14.634626] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:24.982 15:52:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.982 15:52:14 -- target/dif.sh@30 -- # for sub in "$@" 00:28:24.982 15:52:14 -- target/dif.sh@31 -- # create_subsystem 1 00:28:24.982 15:52:14 -- target/dif.sh@18 -- # local sub_id=1 00:28:24.982 15:52:14 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:24.982 15:52:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.982 15:52:14 -- common/autotest_common.sh@10 -- # set +x 00:28:24.982 bdev_null1 00:28:24.982 15:52:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.982 15:52:14 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:24.982 15:52:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.982 15:52:14 -- common/autotest_common.sh@10 -- # set +x 00:28:24.982 15:52:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.982 15:52:14 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:24.982 15:52:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.982 15:52:14 -- common/autotest_common.sh@10 -- # set +x 00:28:24.982 15:52:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.982 15:52:14 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:24.982 15:52:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.982 15:52:14 -- common/autotest_common.sh@10 -- # set +x 00:28:24.982 15:52:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.982 15:52:14 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:24.982 15:52:14 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:24.982 15:52:14 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:24.982 15:52:14 -- nvmf/common.sh@520 -- # config=() 00:28:24.982 15:52:14 -- nvmf/common.sh@520 -- # local subsystem config 00:28:24.982 15:52:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:24.982 15:52:14 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:24.982 15:52:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:24.982 { 00:28:24.982 "params": { 00:28:24.982 "name": "Nvme$subsystem", 00:28:24.982 "trtype": "$TEST_TRANSPORT", 00:28:24.982 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:24.982 "adrfam": "ipv4", 00:28:24.982 "trsvcid": "$NVMF_PORT", 00:28:24.982 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:24.982 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:24.982 "hdgst": ${hdgst:-false}, 00:28:24.982 "ddgst": ${ddgst:-false} 00:28:24.982 }, 00:28:24.982 "method": "bdev_nvme_attach_controller" 00:28:24.982 } 00:28:24.982 EOF 00:28:24.982 )") 00:28:24.982 15:52:14 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:24.982 15:52:14 -- target/dif.sh@82 -- # gen_fio_conf 00:28:24.982 15:52:14 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:24.982 15:52:14 -- target/dif.sh@54 -- # local file 00:28:24.982 15:52:14 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:24.982 15:52:14 -- target/dif.sh@56 -- # cat 00:28:24.982 15:52:14 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:24.982 15:52:14 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:24.982 15:52:14 -- common/autotest_common.sh@1330 -- # shift 00:28:24.982 15:52:14 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:24.982 15:52:14 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:24.982 15:52:14 -- nvmf/common.sh@542 -- # cat 00:28:24.982 15:52:14 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:24.982 15:52:14 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:24.982 15:52:14 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:24.982 15:52:14 -- target/dif.sh@72 -- # (( file <= files )) 00:28:24.982 15:52:14 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:24.982 15:52:14 -- target/dif.sh@73 -- # cat 00:28:24.982 15:52:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:24.982 15:52:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:24.982 { 00:28:24.982 "params": { 00:28:24.982 "name": "Nvme$subsystem", 00:28:24.982 "trtype": "$TEST_TRANSPORT", 00:28:24.982 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:24.982 "adrfam": "ipv4", 00:28:24.982 "trsvcid": "$NVMF_PORT", 00:28:24.982 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:24.982 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:24.982 "hdgst": ${hdgst:-false}, 00:28:24.982 "ddgst": ${ddgst:-false} 00:28:24.982 }, 00:28:24.982 "method": "bdev_nvme_attach_controller" 00:28:24.982 } 00:28:24.982 EOF 00:28:24.982 )") 00:28:24.982 15:52:14 -- nvmf/common.sh@542 -- # cat 00:28:24.982 15:52:14 -- target/dif.sh@72 -- # (( file++ )) 00:28:24.982 15:52:14 -- target/dif.sh@72 -- # (( file <= files )) 00:28:24.982 15:52:14 -- nvmf/common.sh@544 -- # jq . 00:28:24.982 15:52:14 -- nvmf/common.sh@545 -- # IFS=, 00:28:24.982 15:52:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:24.982 "params": { 00:28:24.982 "name": "Nvme0", 00:28:24.982 "trtype": "tcp", 00:28:24.982 "traddr": "10.0.0.2", 00:28:24.982 "adrfam": "ipv4", 00:28:24.982 "trsvcid": "4420", 00:28:24.982 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:24.982 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:24.982 "hdgst": false, 00:28:24.982 "ddgst": false 00:28:24.982 }, 00:28:24.982 "method": "bdev_nvme_attach_controller" 00:28:24.982 },{ 00:28:24.982 "params": { 00:28:24.982 "name": "Nvme1", 00:28:24.982 "trtype": "tcp", 00:28:24.982 "traddr": "10.0.0.2", 00:28:24.982 "adrfam": "ipv4", 00:28:24.982 "trsvcid": "4420", 00:28:24.982 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:24.982 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:24.982 "hdgst": false, 00:28:24.982 "ddgst": false 00:28:24.982 }, 00:28:24.982 "method": "bdev_nvme_attach_controller" 00:28:24.982 }' 00:28:24.982 15:52:14 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:24.982 15:52:14 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:24.982 15:52:14 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:24.982 15:52:14 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:24.982 15:52:14 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:24.983 15:52:14 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:24.983 15:52:14 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:24.983 15:52:14 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:24.983 15:52:14 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:24.983 15:52:14 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:24.983 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:24.983 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:24.983 fio-3.35 00:28:24.983 Starting 2 threads 00:28:24.983 EAL: No free 2048 kB hugepages reported on node 1 00:28:24.983 [2024-11-26 15:52:15.595325] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:24.983 [2024-11-26 15:52:15.595397] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:34.956 00:28:34.956 filename0: (groupid=0, jobs=1): err= 0: pid=997393: Tue Nov 26 15:52:25 2024 00:28:34.956 read: IOPS=97, BW=389KiB/s (399kB/s)(3904KiB/10026msec) 00:28:34.956 slat (nsec): min=6601, max=28485, avg=9014.98, stdev=2879.89 00:28:34.956 clat (usec): min=40727, max=46723, avg=41060.61, stdev=437.12 00:28:34.956 lat (usec): min=40734, max=46734, avg=41069.63, stdev=437.22 00:28:34.956 clat percentiles (usec): 00:28:34.956 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:34.956 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:34.956 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41681], 00:28:34.956 | 99.00th=[42206], 99.50th=[42206], 99.90th=[46924], 99.95th=[46924], 00:28:34.956 | 99.99th=[46924] 00:28:34.956 bw ( KiB/s): min= 384, max= 416, per=33.86%, avg=388.80, stdev=11.72, samples=20 00:28:34.956 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:28:34.956 lat (msec) : 50=100.00% 00:28:34.956 cpu : usr=95.28%, sys=4.42%, ctx=20, majf=0, minf=145 00:28:34.956 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:34.957 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:34.957 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:34.957 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:34.957 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:34.957 filename1: (groupid=0, jobs=1): err= 0: pid=997394: Tue Nov 26 15:52:25 2024 00:28:34.957 read: IOPS=189, BW=758KiB/s (776kB/s)(7584KiB/10002msec) 00:28:34.957 slat (nsec): min=6501, max=55504, avg=8885.56, stdev=3234.45 00:28:34.957 clat (usec): min=576, max=46737, avg=21073.34, stdev=20295.84 00:28:34.957 lat (usec): min=583, max=46763, avg=21082.23, stdev=20295.73 00:28:34.957 clat percentiles (usec): 00:28:34.957 | 1.00th=[ 644], 5.00th=[ 660], 10.00th=[ 668], 20.00th=[ 676], 00:28:34.957 | 30.00th=[ 685], 40.00th=[ 709], 50.00th=[40633], 60.00th=[41157], 00:28:34.957 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:34.957 | 99.00th=[41157], 99.50th=[41681], 99.90th=[46924], 99.95th=[46924], 00:28:34.957 | 99.99th=[46924] 00:28:34.957 bw ( KiB/s): min= 672, max= 768, per=66.24%, avg=759.58, stdev=25.78, samples=19 00:28:34.957 iops : min= 168, max= 192, avg=189.89, stdev= 6.45, samples=19 00:28:34.957 lat (usec) : 750=45.15%, 1000=3.74% 00:28:34.957 lat (msec) : 2=0.90%, 50=50.21% 00:28:34.957 cpu : usr=95.27%, sys=4.43%, ctx=12, majf=0, minf=194 00:28:34.957 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:34.957 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:34.957 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:34.957 issued rwts: total=1896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:34.957 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:34.957 00:28:34.957 Run status group 0 (all jobs): 00:28:34.957 READ: bw=1146KiB/s (1173kB/s), 389KiB/s-758KiB/s (399kB/s-776kB/s), io=11.2MiB (11.8MB), run=10002-10026msec 00:28:34.957 15:52:26 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:28:34.957 15:52:26 -- target/dif.sh@43 -- # local sub 00:28:34.957 15:52:26 -- target/dif.sh@45 -- # for sub in "$@" 00:28:34.957 15:52:26 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:34.957 15:52:26 -- target/dif.sh@36 -- # local sub_id=0 00:28:34.957 15:52:26 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:34.957 15:52:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.957 15:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:34.957 15:52:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.957 15:52:26 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:34.957 15:52:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.957 15:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:34.957 15:52:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.957 15:52:26 -- target/dif.sh@45 -- # for sub in "$@" 00:28:34.957 15:52:26 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:34.957 15:52:26 -- target/dif.sh@36 -- # local sub_id=1 00:28:34.957 15:52:26 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:34.957 15:52:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.957 15:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:34.957 15:52:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.957 15:52:26 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:34.957 15:52:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.957 15:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:34.957 15:52:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.957 00:28:34.957 real 0m11.475s 00:28:34.957 user 0m20.514s 00:28:34.957 sys 0m1.174s 00:28:34.957 15:52:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:34.957 15:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:34.957 ************************************ 00:28:34.957 END TEST fio_dif_1_multi_subsystems 00:28:34.957 ************************************ 00:28:34.957 15:52:26 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:28:34.957 15:52:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:34.957 15:52:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:34.957 15:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:34.957 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:28:34.957 ************************************ 00:28:34.957 START TEST fio_dif_rand_params 00:28:34.957 ************************************ 00:28:34.957 15:52:26 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:28:34.957 15:52:26 -- target/dif.sh@100 -- # local NULL_DIF 00:28:34.957 15:52:26 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:28:34.957 15:52:26 -- target/dif.sh@103 -- # NULL_DIF=3 00:28:34.957 15:52:26 -- target/dif.sh@103 -- # bs=128k 00:28:34.957 15:52:26 -- target/dif.sh@103 -- # numjobs=3 00:28:34.957 15:52:26 -- target/dif.sh@103 -- # iodepth=3 00:28:34.957 15:52:26 -- target/dif.sh@103 -- # runtime=5 00:28:34.957 15:52:26 -- target/dif.sh@105 -- # create_subsystems 0 00:28:34.957 15:52:26 -- target/dif.sh@28 -- # local sub 00:28:34.957 15:52:26 -- target/dif.sh@30 -- # for sub in "$@" 00:28:34.957 15:52:26 -- target/dif.sh@31 -- # create_subsystem 0 00:28:34.957 15:52:26 -- target/dif.sh@18 -- # local sub_id=0 00:28:34.957 15:52:26 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:28:34.957 15:52:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.957 15:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:34.957 bdev_null0 00:28:34.957 15:52:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.957 15:52:26 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:34.957 15:52:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.957 15:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:34.957 15:52:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.957 15:52:26 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:34.957 15:52:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.957 15:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:34.957 15:52:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.957 15:52:26 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:34.957 15:52:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.957 15:52:26 -- common/autotest_common.sh@10 -- # set +x 00:28:34.957 [2024-11-26 15:52:26.140247] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:34.957 15:52:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.957 15:52:26 -- target/dif.sh@106 -- # fio /dev/fd/62 00:28:34.957 15:52:26 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:28:34.957 15:52:26 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:34.957 15:52:26 -- nvmf/common.sh@520 -- # config=() 00:28:34.957 15:52:26 -- nvmf/common.sh@520 -- # local subsystem config 00:28:34.957 15:52:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:34.957 15:52:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:34.957 { 00:28:34.957 "params": { 00:28:34.957 "name": "Nvme$subsystem", 00:28:34.957 "trtype": "$TEST_TRANSPORT", 00:28:34.957 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:34.957 "adrfam": "ipv4", 00:28:34.957 "trsvcid": "$NVMF_PORT", 00:28:34.957 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:34.957 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:34.957 "hdgst": ${hdgst:-false}, 00:28:34.957 "ddgst": ${ddgst:-false} 00:28:34.957 }, 00:28:34.957 "method": "bdev_nvme_attach_controller" 00:28:34.957 } 00:28:34.957 EOF 00:28:34.957 )") 00:28:34.957 15:52:26 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:34.957 15:52:26 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:34.957 15:52:26 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:34.957 15:52:26 -- target/dif.sh@82 -- # gen_fio_conf 00:28:34.957 15:52:26 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:34.957 15:52:26 -- target/dif.sh@54 -- # local file 00:28:34.957 15:52:26 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:34.957 15:52:26 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:34.957 15:52:26 -- target/dif.sh@56 -- # cat 00:28:34.957 15:52:26 -- common/autotest_common.sh@1330 -- # shift 00:28:34.957 15:52:26 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:34.957 15:52:26 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:34.957 15:52:26 -- nvmf/common.sh@542 -- # cat 00:28:34.957 15:52:26 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:34.957 15:52:26 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:34.957 15:52:26 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:34.957 15:52:26 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:34.957 15:52:26 -- target/dif.sh@72 -- # (( file <= files )) 00:28:34.957 15:52:26 -- nvmf/common.sh@544 -- # jq . 00:28:34.957 15:52:26 -- nvmf/common.sh@545 -- # IFS=, 00:28:34.957 15:52:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:34.957 "params": { 00:28:34.957 "name": "Nvme0", 00:28:34.957 "trtype": "tcp", 00:28:34.957 "traddr": "10.0.0.2", 00:28:34.957 "adrfam": "ipv4", 00:28:34.957 "trsvcid": "4420", 00:28:34.957 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:34.957 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:34.957 "hdgst": false, 00:28:34.957 "ddgst": false 00:28:34.957 }, 00:28:34.957 "method": "bdev_nvme_attach_controller" 00:28:34.957 }' 00:28:34.957 15:52:26 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:34.957 15:52:26 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:34.957 15:52:26 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:34.957 15:52:26 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:34.957 15:52:26 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:34.957 15:52:26 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:34.957 15:52:26 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:34.957 15:52:26 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:34.957 15:52:26 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:34.957 15:52:26 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:35.217 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:28:35.217 ... 00:28:35.217 fio-3.35 00:28:35.217 Starting 3 threads 00:28:35.217 EAL: No free 2048 kB hugepages reported on node 1 00:28:35.488 [2024-11-26 15:52:26.842816] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:35.488 [2024-11-26 15:52:26.842887] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:40.786 00:28:40.786 filename0: (groupid=0, jobs=1): err= 0: pid=998766: Tue Nov 26 15:52:32 2024 00:28:40.786 read: IOPS=226, BW=28.4MiB/s (29.7MB/s)(143MiB/5043msec) 00:28:40.786 slat (nsec): min=5299, max=73091, avg=12764.09, stdev=3230.23 00:28:40.786 clat (usec): min=4354, max=92330, avg=13172.14, stdev=9466.10 00:28:40.786 lat (usec): min=4366, max=92342, avg=13184.91, stdev=9465.96 00:28:40.786 clat percentiles (usec): 00:28:40.786 | 1.00th=[ 5014], 5.00th=[ 5800], 10.00th=[ 7701], 20.00th=[ 8848], 00:28:40.786 | 30.00th=[ 9765], 40.00th=[10814], 50.00th=[11731], 60.00th=[12518], 00:28:40.786 | 70.00th=[13173], 80.00th=[14091], 90.00th=[15401], 95.00th=[17433], 00:28:40.786 | 99.00th=[52691], 99.50th=[54264], 99.90th=[92799], 99.95th=[92799], 00:28:40.786 | 99.99th=[92799] 00:28:40.786 bw ( KiB/s): min=23040, max=37120, per=34.42%, avg=29752.89, stdev=4111.53, samples=9 00:28:40.786 iops : min= 180, max= 290, avg=232.44, stdev=32.12, samples=9 00:28:40.786 lat (msec) : 10=31.47%, 20=63.90%, 50=1.40%, 100=3.23% 00:28:40.786 cpu : usr=92.86%, sys=6.68%, ctx=18, majf=0, minf=169 00:28:40.786 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:40.786 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:40.786 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:40.786 issued rwts: total=1144,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:40.786 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:40.786 filename0: (groupid=0, jobs=1): err= 0: pid=998767: Tue Nov 26 15:52:32 2024 00:28:40.786 read: IOPS=246, BW=30.8MiB/s (32.3MB/s)(154MiB/5006msec) 00:28:40.786 slat (nsec): min=5366, max=44083, avg=12409.00, stdev=2549.44 00:28:40.786 clat (usec): min=4784, max=55447, avg=12173.10, stdev=7601.36 00:28:40.786 lat (usec): min=4795, max=55460, avg=12185.51, stdev=7601.42 00:28:40.786 clat percentiles (usec): 00:28:40.786 | 1.00th=[ 5211], 5.00th=[ 5735], 10.00th=[ 6849], 20.00th=[ 8455], 00:28:40.786 | 30.00th=[ 9241], 40.00th=[10290], 50.00th=[11338], 60.00th=[12125], 00:28:40.786 | 70.00th=[12780], 80.00th=[13698], 90.00th=[15008], 95.00th=[16057], 00:28:40.786 | 99.00th=[52167], 99.50th=[53740], 99.90th=[55313], 99.95th=[55313], 00:28:40.786 | 99.99th=[55313] 00:28:40.786 bw ( KiB/s): min=28672, max=35328, per=36.39%, avg=31462.40, stdev=2639.68, samples=10 00:28:40.787 iops : min= 224, max= 276, avg=245.80, stdev=20.62, samples=10 00:28:40.787 lat (msec) : 10=36.53%, 20=60.31%, 50=1.14%, 100=2.03% 00:28:40.787 cpu : usr=91.99%, sys=7.53%, ctx=9, majf=0, minf=105 00:28:40.787 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:40.787 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:40.787 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:40.787 issued rwts: total=1232,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:40.787 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:40.787 filename0: (groupid=0, jobs=1): err= 0: pid=998768: Tue Nov 26 15:52:32 2024 00:28:40.787 read: IOPS=205, BW=25.7MiB/s (27.0MB/s)(129MiB/5003msec) 00:28:40.787 slat (nsec): min=5416, max=30640, avg=12031.78, stdev=2191.21 00:28:40.787 clat (usec): min=5125, max=55339, avg=14553.71, stdev=11224.39 00:28:40.787 lat (usec): min=5137, max=55352, avg=14565.74, stdev=11224.49 00:28:40.787 clat percentiles (usec): 00:28:40.787 | 1.00th=[ 6128], 5.00th=[ 7635], 10.00th=[ 8225], 20.00th=[ 9372], 00:28:40.787 | 30.00th=[10421], 40.00th=[11076], 50.00th=[11600], 60.00th=[12125], 00:28:40.787 | 70.00th=[12780], 80.00th=[13698], 90.00th=[16319], 95.00th=[51119], 00:28:40.787 | 99.00th=[53740], 99.50th=[54264], 99.90th=[54789], 99.95th=[55313], 00:28:40.787 | 99.99th=[55313] 00:28:40.787 bw ( KiB/s): min=18944, max=36352, per=30.27%, avg=26168.89, stdev=5081.10, samples=9 00:28:40.787 iops : min= 148, max= 284, avg=204.44, stdev=39.70, samples=9 00:28:40.787 lat (msec) : 10=26.02%, 20=65.83%, 50=1.46%, 100=6.70% 00:28:40.787 cpu : usr=92.56%, sys=6.98%, ctx=13, majf=0, minf=105 00:28:40.787 IO depths : 1=0.6%, 2=99.4%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:40.787 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:40.787 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:40.787 issued rwts: total=1030,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:40.787 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:40.787 00:28:40.787 Run status group 0 (all jobs): 00:28:40.787 READ: bw=84.4MiB/s (88.5MB/s), 25.7MiB/s-30.8MiB/s (27.0MB/s-32.3MB/s), io=426MiB (446MB), run=5003-5043msec 00:28:40.787 15:52:32 -- target/dif.sh@107 -- # destroy_subsystems 0 00:28:40.787 15:52:32 -- target/dif.sh@43 -- # local sub 00:28:40.787 15:52:32 -- target/dif.sh@45 -- # for sub in "$@" 00:28:40.787 15:52:32 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:40.787 15:52:32 -- target/dif.sh@36 -- # local sub_id=0 00:28:40.787 15:52:32 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:40.787 15:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.787 15:52:32 -- common/autotest_common.sh@10 -- # set +x 00:28:41.047 15:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.047 15:52:32 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:41.047 15:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.047 15:52:32 -- common/autotest_common.sh@10 -- # set +x 00:28:41.047 15:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.047 15:52:32 -- target/dif.sh@109 -- # NULL_DIF=2 00:28:41.047 15:52:32 -- target/dif.sh@109 -- # bs=4k 00:28:41.047 15:52:32 -- target/dif.sh@109 -- # numjobs=8 00:28:41.047 15:52:32 -- target/dif.sh@109 -- # iodepth=16 00:28:41.047 15:52:32 -- target/dif.sh@109 -- # runtime= 00:28:41.047 15:52:32 -- target/dif.sh@109 -- # files=2 00:28:41.047 15:52:32 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:28:41.047 15:52:32 -- target/dif.sh@28 -- # local sub 00:28:41.047 15:52:32 -- target/dif.sh@30 -- # for sub in "$@" 00:28:41.047 15:52:32 -- target/dif.sh@31 -- # create_subsystem 0 00:28:41.047 15:52:32 -- target/dif.sh@18 -- # local sub_id=0 00:28:41.047 15:52:32 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:28:41.047 15:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.047 15:52:32 -- common/autotest_common.sh@10 -- # set +x 00:28:41.047 bdev_null0 00:28:41.047 15:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.047 15:52:32 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:41.047 15:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.047 15:52:32 -- common/autotest_common.sh@10 -- # set +x 00:28:41.047 15:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.047 15:52:32 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:41.047 15:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.047 15:52:32 -- common/autotest_common.sh@10 -- # set +x 00:28:41.047 15:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.047 15:52:32 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:41.047 15:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.047 15:52:32 -- common/autotest_common.sh@10 -- # set +x 00:28:41.047 [2024-11-26 15:52:32.274331] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:41.047 15:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.047 15:52:32 -- target/dif.sh@30 -- # for sub in "$@" 00:28:41.047 15:52:32 -- target/dif.sh@31 -- # create_subsystem 1 00:28:41.047 15:52:32 -- target/dif.sh@18 -- # local sub_id=1 00:28:41.047 15:52:32 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:28:41.047 15:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.047 15:52:32 -- common/autotest_common.sh@10 -- # set +x 00:28:41.047 bdev_null1 00:28:41.047 15:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.047 15:52:32 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:41.047 15:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.047 15:52:32 -- common/autotest_common.sh@10 -- # set +x 00:28:41.047 15:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.047 15:52:32 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:41.047 15:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.047 15:52:32 -- common/autotest_common.sh@10 -- # set +x 00:28:41.047 15:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.047 15:52:32 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:41.047 15:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.047 15:52:32 -- common/autotest_common.sh@10 -- # set +x 00:28:41.047 15:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.047 15:52:32 -- target/dif.sh@30 -- # for sub in "$@" 00:28:41.047 15:52:32 -- target/dif.sh@31 -- # create_subsystem 2 00:28:41.047 15:52:32 -- target/dif.sh@18 -- # local sub_id=2 00:28:41.047 15:52:32 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:28:41.047 15:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.047 15:52:32 -- common/autotest_common.sh@10 -- # set +x 00:28:41.047 bdev_null2 00:28:41.047 15:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.047 15:52:32 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:28:41.047 15:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.047 15:52:32 -- common/autotest_common.sh@10 -- # set +x 00:28:41.047 15:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.047 15:52:32 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:28:41.047 15:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.047 15:52:32 -- common/autotest_common.sh@10 -- # set +x 00:28:41.047 15:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.047 15:52:32 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:28:41.047 15:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.047 15:52:32 -- common/autotest_common.sh@10 -- # set +x 00:28:41.047 15:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.047 15:52:32 -- target/dif.sh@112 -- # fio /dev/fd/62 00:28:41.047 15:52:32 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:41.047 15:52:32 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:28:41.047 15:52:32 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:41.047 15:52:32 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:28:41.047 15:52:32 -- target/dif.sh@82 -- # gen_fio_conf 00:28:41.047 15:52:32 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:41.047 15:52:32 -- nvmf/common.sh@520 -- # config=() 00:28:41.047 15:52:32 -- target/dif.sh@54 -- # local file 00:28:41.047 15:52:32 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:41.047 15:52:32 -- nvmf/common.sh@520 -- # local subsystem config 00:28:41.047 15:52:32 -- target/dif.sh@56 -- # cat 00:28:41.047 15:52:32 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:41.048 15:52:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:41.048 15:52:32 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:41.048 15:52:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:41.048 { 00:28:41.048 "params": { 00:28:41.048 "name": "Nvme$subsystem", 00:28:41.048 "trtype": "$TEST_TRANSPORT", 00:28:41.048 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:41.048 "adrfam": "ipv4", 00:28:41.048 "trsvcid": "$NVMF_PORT", 00:28:41.048 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:41.048 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:41.048 "hdgst": ${hdgst:-false}, 00:28:41.048 "ddgst": ${ddgst:-false} 00:28:41.048 }, 00:28:41.048 "method": "bdev_nvme_attach_controller" 00:28:41.048 } 00:28:41.048 EOF 00:28:41.048 )") 00:28:41.048 15:52:32 -- common/autotest_common.sh@1330 -- # shift 00:28:41.048 15:52:32 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:41.048 15:52:32 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:41.048 15:52:32 -- nvmf/common.sh@542 -- # cat 00:28:41.048 15:52:32 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:41.048 15:52:32 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:41.048 15:52:32 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:41.048 15:52:32 -- target/dif.sh@72 -- # (( file <= files )) 00:28:41.048 15:52:32 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:41.048 15:52:32 -- target/dif.sh@73 -- # cat 00:28:41.048 15:52:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:41.048 15:52:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:41.048 { 00:28:41.048 "params": { 00:28:41.048 "name": "Nvme$subsystem", 00:28:41.048 "trtype": "$TEST_TRANSPORT", 00:28:41.048 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:41.048 "adrfam": "ipv4", 00:28:41.048 "trsvcid": "$NVMF_PORT", 00:28:41.048 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:41.048 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:41.048 "hdgst": ${hdgst:-false}, 00:28:41.048 "ddgst": ${ddgst:-false} 00:28:41.048 }, 00:28:41.048 "method": "bdev_nvme_attach_controller" 00:28:41.048 } 00:28:41.048 EOF 00:28:41.048 )") 00:28:41.048 15:52:32 -- target/dif.sh@72 -- # (( file++ )) 00:28:41.048 15:52:32 -- target/dif.sh@72 -- # (( file <= files )) 00:28:41.048 15:52:32 -- target/dif.sh@73 -- # cat 00:28:41.048 15:52:32 -- nvmf/common.sh@542 -- # cat 00:28:41.048 15:52:32 -- target/dif.sh@72 -- # (( file++ )) 00:28:41.048 15:52:32 -- target/dif.sh@72 -- # (( file <= files )) 00:28:41.048 15:52:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:41.048 15:52:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:41.048 { 00:28:41.048 "params": { 00:28:41.048 "name": "Nvme$subsystem", 00:28:41.048 "trtype": "$TEST_TRANSPORT", 00:28:41.048 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:41.048 "adrfam": "ipv4", 00:28:41.048 "trsvcid": "$NVMF_PORT", 00:28:41.048 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:41.048 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:41.048 "hdgst": ${hdgst:-false}, 00:28:41.048 "ddgst": ${ddgst:-false} 00:28:41.048 }, 00:28:41.048 "method": "bdev_nvme_attach_controller" 00:28:41.048 } 00:28:41.048 EOF 00:28:41.048 )") 00:28:41.048 15:52:32 -- nvmf/common.sh@542 -- # cat 00:28:41.048 15:52:32 -- nvmf/common.sh@544 -- # jq . 00:28:41.048 15:52:32 -- nvmf/common.sh@545 -- # IFS=, 00:28:41.048 15:52:32 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:41.048 "params": { 00:28:41.048 "name": "Nvme0", 00:28:41.048 "trtype": "tcp", 00:28:41.048 "traddr": "10.0.0.2", 00:28:41.048 "adrfam": "ipv4", 00:28:41.048 "trsvcid": "4420", 00:28:41.048 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:41.048 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:41.048 "hdgst": false, 00:28:41.048 "ddgst": false 00:28:41.048 }, 00:28:41.048 "method": "bdev_nvme_attach_controller" 00:28:41.048 },{ 00:28:41.048 "params": { 00:28:41.048 "name": "Nvme1", 00:28:41.048 "trtype": "tcp", 00:28:41.048 "traddr": "10.0.0.2", 00:28:41.048 "adrfam": "ipv4", 00:28:41.048 "trsvcid": "4420", 00:28:41.048 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:41.048 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:41.048 "hdgst": false, 00:28:41.048 "ddgst": false 00:28:41.048 }, 00:28:41.048 "method": "bdev_nvme_attach_controller" 00:28:41.048 },{ 00:28:41.048 "params": { 00:28:41.048 "name": "Nvme2", 00:28:41.048 "trtype": "tcp", 00:28:41.048 "traddr": "10.0.0.2", 00:28:41.048 "adrfam": "ipv4", 00:28:41.048 "trsvcid": "4420", 00:28:41.048 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:28:41.048 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:28:41.048 "hdgst": false, 00:28:41.048 "ddgst": false 00:28:41.048 }, 00:28:41.048 "method": "bdev_nvme_attach_controller" 00:28:41.048 }' 00:28:41.048 15:52:32 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:41.048 15:52:32 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:41.048 15:52:32 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:41.048 15:52:32 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:41.048 15:52:32 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:41.048 15:52:32 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:41.048 15:52:32 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:41.048 15:52:32 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:41.048 15:52:32 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:41.048 15:52:32 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:41.307 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:41.307 ... 00:28:41.307 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:41.307 ... 00:28:41.307 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:41.307 ... 00:28:41.307 fio-3.35 00:28:41.307 Starting 24 threads 00:28:41.307 EAL: No free 2048 kB hugepages reported on node 1 00:28:42.244 [2024-11-26 15:52:33.576243] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:42.244 [2024-11-26 15:52:33.576307] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:54.456 00:28:54.456 filename0: (groupid=0, jobs=1): err= 0: pid=999616: Tue Nov 26 15:52:43 2024 00:28:54.456 read: IOPS=250, BW=1002KiB/s (1027kB/s)(9.88MiB/10087msec) 00:28:54.456 slat (nsec): min=3383, max=78456, avg=25151.09, stdev=12999.31 00:28:54.456 clat (msec): min=6, max=392, avg=63.64, stdev=81.22 00:28:54.456 lat (msec): min=6, max=392, avg=63.66, stdev=81.22 00:28:54.456 clat percentiles (msec): 00:28:54.456 | 1.00th=[ 10], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.456 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.456 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 241], 95.00th=[ 284], 00:28:54.456 | 99.00th=[ 330], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], 00:28:54.456 | 99.99th=[ 393] 00:28:54.456 bw ( KiB/s): min= 128, max= 2048, per=4.35%, avg=1004.80, stdev=841.70, samples=20 00:28:54.456 iops : min= 32, max= 512, avg=251.20, stdev=210.43, samples=20 00:28:54.456 lat (msec) : 10=1.19%, 20=0.08%, 50=84.18%, 100=0.55%, 250=5.78% 00:28:54.456 lat (msec) : 500=8.23% 00:28:54.456 cpu : usr=98.53%, sys=1.07%, ctx=16, majf=0, minf=27 00:28:54.456 IO depths : 1=5.9%, 2=12.1%, 4=24.8%, 8=50.6%, 16=6.6%, 32=0.0%, >=64=0.0% 00:28:54.456 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.456 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.456 issued rwts: total=2528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.456 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.456 filename0: (groupid=0, jobs=1): err= 0: pid=999617: Tue Nov 26 15:52:43 2024 00:28:54.456 read: IOPS=241, BW=967KiB/s (990kB/s)(9728KiB/10065msec) 00:28:54.457 slat (usec): min=7, max=392, avg=27.78, stdev=20.41 00:28:54.457 clat (msec): min=30, max=528, avg=65.81, stdev=88.47 00:28:54.457 lat (msec): min=30, max=528, avg=65.83, stdev=88.47 00:28:54.457 clat percentiles (msec): 00:28:54.457 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 33], 20.00th=[ 33], 00:28:54.457 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.457 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 253], 95.00th=[ 300], 00:28:54.457 | 99.00th=[ 401], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 531], 00:28:54.457 | 99.99th=[ 531] 00:28:54.457 bw ( KiB/s): min= 128, max= 2048, per=4.18%, avg=966.40, stdev=865.41, samples=20 00:28:54.457 iops : min= 32, max= 512, avg=241.60, stdev=216.35, samples=20 00:28:54.457 lat (msec) : 50=86.84%, 250=2.71%, 500=10.36%, 750=0.08% 00:28:54.457 cpu : usr=98.28%, sys=1.12%, ctx=42, majf=0, minf=19 00:28:54.457 IO depths : 1=5.8%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.7%, 32=0.0%, >=64=0.0% 00:28:54.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.457 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.457 issued rwts: total=2432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.457 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.457 filename0: (groupid=0, jobs=1): err= 0: pid=999618: Tue Nov 26 15:52:43 2024 00:28:54.457 read: IOPS=238, BW=954KiB/s (976kB/s)(9600KiB/10068msec) 00:28:54.457 slat (usec): min=7, max=105, avg=12.96, stdev=11.87 00:28:54.457 clat (msec): min=16, max=617, avg=66.99, stdev=98.91 00:28:54.457 lat (msec): min=16, max=617, avg=67.00, stdev=98.92 00:28:54.457 clat percentiles (msec): 00:28:54.457 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.457 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.457 | 70.00th=[ 34], 80.00th=[ 34], 90.00th=[ 236], 95.00th=[ 313], 00:28:54.457 | 99.00th=[ 472], 99.50th=[ 498], 99.90th=[ 567], 99.95th=[ 617], 00:28:54.457 | 99.99th=[ 617] 00:28:54.457 bw ( KiB/s): min= 112, max= 2048, per=4.13%, avg=953.60, stdev=879.48, samples=20 00:28:54.457 iops : min= 28, max= 512, avg=238.40, stdev=219.87, samples=20 00:28:54.457 lat (msec) : 20=0.67%, 50=87.33%, 250=2.17%, 500=9.67%, 750=0.17% 00:28:54.457 cpu : usr=97.55%, sys=1.38%, ctx=34, majf=0, minf=19 00:28:54.457 IO depths : 1=5.7%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:28:54.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.457 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.457 issued rwts: total=2400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.457 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.457 filename0: (groupid=0, jobs=1): err= 0: pid=999619: Tue Nov 26 15:52:43 2024 00:28:54.457 read: IOPS=242, BW=971KiB/s (995kB/s)(9792KiB/10081msec) 00:28:54.457 slat (usec): min=4, max=133, avg=21.63, stdev=16.86 00:28:54.457 clat (msec): min=29, max=425, avg=65.51, stdev=88.00 00:28:54.457 lat (msec): min=29, max=425, avg=65.54, stdev=88.00 00:28:54.457 clat percentiles (msec): 00:28:54.457 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 33], 20.00th=[ 33], 00:28:54.457 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.457 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 253], 95.00th=[ 305], 00:28:54.457 | 99.00th=[ 401], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 426], 00:28:54.457 | 99.99th=[ 426] 00:28:54.457 bw ( KiB/s): min= 128, max= 2048, per=4.21%, avg=972.80, stdev=864.45, samples=20 00:28:54.457 iops : min= 32, max= 512, avg=243.20, stdev=216.11, samples=20 00:28:54.457 lat (msec) : 50=86.93%, 250=2.94%, 500=10.13% 00:28:54.457 cpu : usr=97.32%, sys=1.48%, ctx=175, majf=0, minf=26 00:28:54.457 IO depths : 1=5.8%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.7%, 32=0.0%, >=64=0.0% 00:28:54.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.457 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.457 issued rwts: total=2448,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.457 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.457 filename0: (groupid=0, jobs=1): err= 0: pid=999620: Tue Nov 26 15:52:43 2024 00:28:54.457 read: IOPS=240, BW=960KiB/s (983kB/s)(9664KiB/10066msec) 00:28:54.457 slat (nsec): min=8141, max=79303, avg=34683.93, stdev=10485.01 00:28:54.457 clat (msec): min=29, max=534, avg=66.36, stdev=93.79 00:28:54.457 lat (msec): min=29, max=534, avg=66.39, stdev=93.79 00:28:54.457 clat percentiles (msec): 00:28:54.457 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.457 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.457 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 253], 95.00th=[ 305], 00:28:54.457 | 99.00th=[ 422], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 535], 00:28:54.457 | 99.99th=[ 535] 00:28:54.457 bw ( KiB/s): min= 128, max= 2048, per=4.16%, avg=960.00, stdev=871.39, samples=20 00:28:54.457 iops : min= 32, max= 512, avg=240.00, stdev=217.85, samples=20 00:28:54.457 lat (msec) : 50=87.42%, 250=2.24%, 500=10.26%, 750=0.08% 00:28:54.457 cpu : usr=98.53%, sys=1.05%, ctx=23, majf=0, minf=22 00:28:54.457 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:28:54.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.457 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.457 issued rwts: total=2416,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.457 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.457 filename0: (groupid=0, jobs=1): err= 0: pid=999621: Tue Nov 26 15:52:43 2024 00:28:54.457 read: IOPS=237, BW=949KiB/s (972kB/s)(9544KiB/10052msec) 00:28:54.457 slat (usec): min=7, max=329, avg=24.79, stdev=23.30 00:28:54.457 clat (msec): min=17, max=510, avg=67.18, stdev=100.08 00:28:54.457 lat (msec): min=17, max=510, avg=67.21, stdev=100.08 00:28:54.457 clat percentiles (msec): 00:28:54.457 | 1.00th=[ 26], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.457 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.457 | 70.00th=[ 33], 80.00th=[ 34], 90.00th=[ 253], 95.00th=[ 321], 00:28:54.457 | 99.00th=[ 493], 99.50th=[ 502], 99.90th=[ 510], 99.95th=[ 510], 00:28:54.457 | 99.99th=[ 510] 00:28:54.457 bw ( KiB/s): min= 128, max= 2032, per=4.11%, avg=948.00, stdev=880.66, samples=20 00:28:54.457 iops : min= 32, max= 508, avg=237.00, stdev=220.17, samples=20 00:28:54.457 lat (msec) : 20=0.42%, 50=87.51%, 100=0.42%, 250=1.17%, 500=9.89% 00:28:54.457 lat (msec) : 750=0.59% 00:28:54.457 cpu : usr=96.14%, sys=1.94%, ctx=134, majf=0, minf=26 00:28:54.457 IO depths : 1=0.8%, 2=3.1%, 4=9.3%, 8=71.2%, 16=15.5%, 32=0.0%, >=64=0.0% 00:28:54.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.457 complete : 0=0.0%, 4=91.1%, 8=6.7%, 16=2.1%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.457 issued rwts: total=2386,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.457 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.457 filename0: (groupid=0, jobs=1): err= 0: pid=999622: Tue Nov 26 15:52:43 2024 00:28:54.457 read: IOPS=237, BW=952KiB/s (975kB/s)(9536KiB/10019msec) 00:28:54.457 slat (nsec): min=9936, max=82294, avg=34129.73, stdev=8860.16 00:28:54.457 clat (msec): min=30, max=510, avg=66.92, stdev=100.67 00:28:54.457 lat (msec): min=30, max=510, avg=66.96, stdev=100.67 00:28:54.457 clat percentiles (msec): 00:28:54.457 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.457 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.457 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 253], 95.00th=[ 321], 00:28:54.457 | 99.00th=[ 502], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], 00:28:54.457 | 99.99th=[ 510] 00:28:54.457 bw ( KiB/s): min= 128, max= 2048, per=4.10%, avg=947.20, stdev=885.25, samples=20 00:28:54.457 iops : min= 32, max= 512, avg=236.80, stdev=221.31, samples=20 00:28:54.457 lat (msec) : 50=88.59%, 250=0.67%, 500=9.40%, 750=1.34% 00:28:54.457 cpu : usr=98.75%, sys=0.79%, ctx=32, majf=0, minf=21 00:28:54.457 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:54.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.457 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.457 issued rwts: total=2384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.457 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.457 filename0: (groupid=0, jobs=1): err= 0: pid=999623: Tue Nov 26 15:52:43 2024 00:28:54.457 read: IOPS=237, BW=948KiB/s (971kB/s)(9536KiB/10054msec) 00:28:54.457 slat (usec): min=11, max=137, avg=40.83, stdev=17.40 00:28:54.457 clat (msec): min=30, max=646, avg=67.09, stdev=101.65 00:28:54.457 lat (msec): min=30, max=646, avg=67.13, stdev=101.65 00:28:54.457 clat percentiles (msec): 00:28:54.457 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.457 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.457 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 253], 95.00th=[ 355], 00:28:54.457 | 99.00th=[ 485], 99.50th=[ 498], 99.90th=[ 642], 99.95th=[ 651], 00:28:54.457 | 99.99th=[ 651] 00:28:54.457 bw ( KiB/s): min= 128, max= 2048, per=4.10%, avg=947.20, stdev=883.30, samples=20 00:28:54.457 iops : min= 32, max= 512, avg=236.80, stdev=220.83, samples=20 00:28:54.457 lat (msec) : 50=88.59%, 250=0.92%, 500=10.32%, 750=0.17% 00:28:54.457 cpu : usr=98.39%, sys=1.12%, ctx=31, majf=0, minf=23 00:28:54.457 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:28:54.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.457 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.457 issued rwts: total=2384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.457 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.457 filename1: (groupid=0, jobs=1): err= 0: pid=999624: Tue Nov 26 15:52:43 2024 00:28:54.457 read: IOPS=238, BW=954KiB/s (977kB/s)(9600KiB/10066msec) 00:28:54.457 slat (usec): min=8, max=118, avg=36.18, stdev=12.24 00:28:54.457 clat (msec): min=18, max=495, avg=66.78, stdev=98.85 00:28:54.457 lat (msec): min=18, max=495, avg=66.82, stdev=98.85 00:28:54.457 clat percentiles (msec): 00:28:54.457 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.457 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.457 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 239], 95.00th=[ 305], 00:28:54.457 | 99.00th=[ 485], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], 00:28:54.457 | 99.99th=[ 498] 00:28:54.457 bw ( KiB/s): min= 128, max= 2048, per=4.13%, avg=953.60, stdev=877.50, samples=20 00:28:54.457 iops : min= 32, max= 512, avg=238.40, stdev=219.37, samples=20 00:28:54.457 lat (msec) : 20=0.08%, 50=87.92%, 250=2.00%, 500=10.00% 00:28:54.458 cpu : usr=98.06%, sys=1.13%, ctx=38, majf=0, minf=18 00:28:54.458 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:54.458 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 issued rwts: total=2400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.458 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.458 filename1: (groupid=0, jobs=1): err= 0: pid=999625: Tue Nov 26 15:52:43 2024 00:28:54.458 read: IOPS=236, BW=948KiB/s (971kB/s)(9536KiB/10061msec) 00:28:54.458 slat (usec): min=5, max=194, avg=36.70, stdev=14.96 00:28:54.458 clat (msec): min=24, max=613, avg=67.02, stdev=101.08 00:28:54.458 lat (msec): min=24, max=613, avg=67.06, stdev=101.08 00:28:54.458 clat percentiles (msec): 00:28:54.458 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.458 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.458 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 253], 95.00th=[ 317], 00:28:54.458 | 99.00th=[ 502], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 617], 00:28:54.458 | 99.99th=[ 617] 00:28:54.458 bw ( KiB/s): min= 128, max= 2048, per=4.10%, avg=947.20, stdev=883.30, samples=20 00:28:54.458 iops : min= 32, max= 512, avg=236.80, stdev=220.83, samples=20 00:28:54.458 lat (msec) : 50=88.59%, 250=0.67%, 500=9.48%, 750=1.26% 00:28:54.458 cpu : usr=97.50%, sys=1.54%, ctx=77, majf=0, minf=29 00:28:54.458 IO depths : 1=5.2%, 2=11.4%, 4=24.8%, 8=51.3%, 16=7.3%, 32=0.0%, >=64=0.0% 00:28:54.458 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 issued rwts: total=2384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.458 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.458 filename1: (groupid=0, jobs=1): err= 0: pid=999626: Tue Nov 26 15:52:43 2024 00:28:54.458 read: IOPS=238, BW=952KiB/s (975kB/s)(9536KiB/10016msec) 00:28:54.458 slat (nsec): min=7853, max=78637, avg=36328.86, stdev=13750.40 00:28:54.458 clat (msec): min=30, max=510, avg=66.86, stdev=100.65 00:28:54.458 lat (msec): min=30, max=510, avg=66.90, stdev=100.65 00:28:54.458 clat percentiles (msec): 00:28:54.458 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.458 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.458 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 253], 95.00th=[ 321], 00:28:54.458 | 99.00th=[ 502], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], 00:28:54.458 | 99.99th=[ 510] 00:28:54.458 bw ( KiB/s): min= 128, max= 2048, per=4.10%, avg=947.20, stdev=885.25, samples=20 00:28:54.458 iops : min= 32, max= 512, avg=236.80, stdev=221.31, samples=20 00:28:54.458 lat (msec) : 50=88.59%, 250=0.67%, 500=9.40%, 750=1.34% 00:28:54.458 cpu : usr=98.84%, sys=0.69%, ctx=24, majf=0, minf=32 00:28:54.458 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:54.458 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 issued rwts: total=2384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.458 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.458 filename1: (groupid=0, jobs=1): err= 0: pid=999627: Tue Nov 26 15:52:43 2024 00:28:54.458 read: IOPS=237, BW=949KiB/s (972kB/s)(9536KiB/10047msec) 00:28:54.458 slat (usec): min=7, max=113, avg=33.49, stdev=13.33 00:28:54.458 clat (msec): min=31, max=495, avg=67.13, stdev=101.06 00:28:54.458 lat (msec): min=31, max=495, avg=67.16, stdev=101.07 00:28:54.458 clat percentiles (msec): 00:28:54.458 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.458 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.458 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 255], 95.00th=[ 326], 00:28:54.458 | 99.00th=[ 485], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], 00:28:54.458 | 99.99th=[ 498] 00:28:54.458 bw ( KiB/s): min= 128, max= 2048, per=4.10%, avg=947.20, stdev=885.25, samples=20 00:28:54.458 iops : min= 32, max= 512, avg=236.80, stdev=221.31, samples=20 00:28:54.458 lat (msec) : 50=88.59%, 250=1.34%, 500=10.07% 00:28:54.458 cpu : usr=98.51%, sys=1.03%, ctx=19, majf=0, minf=20 00:28:54.458 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:54.458 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 issued rwts: total=2384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.458 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.458 filename1: (groupid=0, jobs=1): err= 0: pid=999628: Tue Nov 26 15:52:43 2024 00:28:54.458 read: IOPS=241, BW=967KiB/s (990kB/s)(9728KiB/10065msec) 00:28:54.458 slat (usec): min=7, max=138, avg=28.77, stdev=19.31 00:28:54.458 clat (msec): min=30, max=433, avg=65.78, stdev=88.24 00:28:54.458 lat (msec): min=30, max=433, avg=65.81, stdev=88.25 00:28:54.458 clat percentiles (msec): 00:28:54.458 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.458 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.458 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 247], 95.00th=[ 305], 00:28:54.458 | 99.00th=[ 401], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 435], 00:28:54.458 | 99.99th=[ 435] 00:28:54.458 bw ( KiB/s): min= 128, max= 2048, per=4.18%, avg=966.40, stdev=865.41, samples=20 00:28:54.458 iops : min= 32, max= 512, avg=241.60, stdev=216.35, samples=20 00:28:54.458 lat (msec) : 50=86.84%, 250=3.45%, 500=9.70% 00:28:54.458 cpu : usr=97.17%, sys=1.49%, ctx=162, majf=0, minf=29 00:28:54.458 IO depths : 1=5.7%, 2=11.9%, 4=24.8%, 8=50.7%, 16=6.8%, 32=0.0%, >=64=0.0% 00:28:54.458 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 issued rwts: total=2432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.458 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.458 filename1: (groupid=0, jobs=1): err= 0: pid=999629: Tue Nov 26 15:52:43 2024 00:28:54.458 read: IOPS=238, BW=954KiB/s (977kB/s)(9600KiB/10065msec) 00:28:54.458 slat (usec): min=9, max=109, avg=38.20, stdev=11.38 00:28:54.458 clat (msec): min=29, max=586, avg=66.57, stdev=98.87 00:28:54.458 lat (msec): min=29, max=586, avg=66.61, stdev=98.87 00:28:54.458 clat percentiles (msec): 00:28:54.458 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.458 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.458 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 239], 95.00th=[ 305], 00:28:54.458 | 99.00th=[ 502], 99.50th=[ 510], 99.90th=[ 542], 99.95th=[ 584], 00:28:54.458 | 99.99th=[ 584] 00:28:54.458 bw ( KiB/s): min= 128, max= 2048, per=4.13%, avg=953.60, stdev=877.39, samples=20 00:28:54.458 iops : min= 32, max= 512, avg=238.40, stdev=219.35, samples=20 00:28:54.458 lat (msec) : 50=88.00%, 250=2.25%, 500=8.42%, 750=1.33% 00:28:54.458 cpu : usr=98.03%, sys=1.22%, ctx=30, majf=0, minf=24 00:28:54.458 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:28:54.458 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 issued rwts: total=2400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.458 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.458 filename1: (groupid=0, jobs=1): err= 0: pid=999630: Tue Nov 26 15:52:43 2024 00:28:54.458 read: IOPS=258, BW=1035KiB/s (1060kB/s)(10.2MiB/10089msec) 00:28:54.458 slat (nsec): min=4296, max=58889, avg=25863.88, stdev=11489.09 00:28:54.458 clat (msec): min=5, max=392, avg=61.62, stdev=74.45 00:28:54.458 lat (msec): min=5, max=392, avg=61.65, stdev=74.45 00:28:54.458 clat percentiles (msec): 00:28:54.458 | 1.00th=[ 10], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.458 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.458 | 70.00th=[ 33], 80.00th=[ 34], 90.00th=[ 180], 95.00th=[ 253], 00:28:54.458 | 99.00th=[ 330], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], 00:28:54.458 | 99.99th=[ 393] 00:28:54.458 bw ( KiB/s): min= 128, max= 2048, per=4.49%, avg=1037.60, stdev=831.60, samples=20 00:28:54.458 iops : min= 32, max= 512, avg=259.40, stdev=207.90, samples=20 00:28:54.458 lat (msec) : 10=1.30%, 20=1.38%, 50=81.15%, 100=0.46%, 250=10.57% 00:28:54.458 lat (msec) : 500=5.13% 00:28:54.458 cpu : usr=97.32%, sys=1.55%, ctx=52, majf=0, minf=41 00:28:54.458 IO depths : 1=4.9%, 2=10.1%, 4=21.8%, 8=55.4%, 16=7.7%, 32=0.0%, >=64=0.0% 00:28:54.458 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 complete : 0=0.0%, 4=93.2%, 8=1.1%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 issued rwts: total=2610,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.458 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.458 filename1: (groupid=0, jobs=1): err= 0: pid=999631: Tue Nov 26 15:52:43 2024 00:28:54.458 read: IOPS=245, BW=984KiB/s (1007kB/s)(9920KiB/10085msec) 00:28:54.458 slat (usec): min=4, max=129, avg=34.50, stdev=14.79 00:28:54.458 clat (msec): min=23, max=392, avg=64.77, stdev=82.98 00:28:54.458 lat (msec): min=23, max=392, avg=64.80, stdev=82.98 00:28:54.458 clat percentiles (msec): 00:28:54.458 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.458 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.458 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 247], 95.00th=[ 284], 00:28:54.458 | 99.00th=[ 330], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], 00:28:54.458 | 99.99th=[ 393] 00:28:54.458 bw ( KiB/s): min= 128, max= 2048, per=4.27%, avg=985.60, stdev=852.21, samples=20 00:28:54.458 iops : min= 32, max= 512, avg=246.40, stdev=213.05, samples=20 00:28:54.458 lat (msec) : 50=85.81%, 250=4.68%, 500=9.52% 00:28:54.458 cpu : usr=98.54%, sys=0.94%, ctx=66, majf=0, minf=32 00:28:54.458 IO depths : 1=5.6%, 2=11.8%, 4=24.8%, 8=50.8%, 16=6.9%, 32=0.0%, >=64=0.0% 00:28:54.458 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.458 issued rwts: total=2480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.458 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.458 filename2: (groupid=0, jobs=1): err= 0: pid=999632: Tue Nov 26 15:52:43 2024 00:28:54.458 read: IOPS=238, BW=954KiB/s (977kB/s)(9600KiB/10065msec) 00:28:54.458 slat (usec): min=8, max=144, avg=25.19, stdev=16.56 00:28:54.458 clat (msec): min=18, max=690, avg=66.91, stdev=99.13 00:28:54.458 lat (msec): min=18, max=690, avg=66.93, stdev=99.13 00:28:54.458 clat percentiles (msec): 00:28:54.458 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 33], 20.00th=[ 33], 00:28:54.458 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.459 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 239], 95.00th=[ 305], 00:28:54.459 | 99.00th=[ 485], 99.50th=[ 498], 99.90th=[ 575], 99.95th=[ 693], 00:28:54.459 | 99.99th=[ 693] 00:28:54.459 bw ( KiB/s): min= 128, max= 2048, per=4.13%, avg=953.60, stdev=876.19, samples=20 00:28:54.459 iops : min= 32, max= 512, avg=238.40, stdev=219.05, samples=20 00:28:54.459 lat (msec) : 20=0.08%, 50=87.83%, 250=2.25%, 500=9.67%, 750=0.17% 00:28:54.459 cpu : usr=98.49%, sys=0.93%, ctx=46, majf=0, minf=26 00:28:54.459 IO depths : 1=2.2%, 2=8.4%, 4=25.0%, 8=54.1%, 16=10.3%, 32=0.0%, >=64=0.0% 00:28:54.459 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 issued rwts: total=2400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.459 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.459 filename2: (groupid=0, jobs=1): err= 0: pid=999633: Tue Nov 26 15:52:43 2024 00:28:54.459 read: IOPS=237, BW=949KiB/s (972kB/s)(9536KiB/10050msec) 00:28:54.459 slat (usec): min=8, max=130, avg=33.10, stdev=14.12 00:28:54.459 clat (msec): min=31, max=575, avg=67.17, stdev=100.70 00:28:54.459 lat (msec): min=31, max=575, avg=67.20, stdev=100.70 00:28:54.459 clat percentiles (msec): 00:28:54.459 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.459 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.459 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 253], 95.00th=[ 355], 00:28:54.459 | 99.00th=[ 485], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 575], 00:28:54.459 | 99.99th=[ 575] 00:28:54.459 bw ( KiB/s): min= 128, max= 2048, per=4.10%, avg=947.20, stdev=883.44, samples=20 00:28:54.459 iops : min= 32, max= 512, avg=236.80, stdev=220.86, samples=20 00:28:54.459 lat (msec) : 50=88.42%, 100=0.08%, 250=0.76%, 500=10.65%, 750=0.08% 00:28:54.459 cpu : usr=95.08%, sys=2.53%, ctx=375, majf=0, minf=23 00:28:54.459 IO depths : 1=2.9%, 2=9.1%, 4=25.0%, 8=53.4%, 16=9.6%, 32=0.0%, >=64=0.0% 00:28:54.459 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 issued rwts: total=2384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.459 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.459 filename2: (groupid=0, jobs=1): err= 0: pid=999634: Tue Nov 26 15:52:43 2024 00:28:54.459 read: IOPS=247, BW=988KiB/s (1012kB/s)(9968KiB/10088msec) 00:28:54.459 slat (usec): min=4, max=129, avg=34.88, stdev=15.90 00:28:54.459 clat (msec): min=13, max=421, avg=64.45, stdev=83.83 00:28:54.459 lat (msec): min=13, max=421, avg=64.48, stdev=83.83 00:28:54.459 clat percentiles (msec): 00:28:54.459 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.459 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.459 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 239], 95.00th=[ 284], 00:28:54.459 | 99.00th=[ 355], 99.50th=[ 372], 99.90th=[ 422], 99.95th=[ 422], 00:28:54.459 | 99.99th=[ 422] 00:28:54.459 bw ( KiB/s): min= 128, max= 2048, per=4.29%, avg=990.40, stdev=851.30, samples=20 00:28:54.459 iops : min= 32, max= 512, avg=247.60, stdev=212.83, samples=20 00:28:54.459 lat (msec) : 20=0.64%, 50=85.39%, 100=0.08%, 250=5.06%, 500=8.83% 00:28:54.459 cpu : usr=98.56%, sys=0.98%, ctx=22, majf=0, minf=29 00:28:54.459 IO depths : 1=5.7%, 2=11.6%, 4=24.2%, 8=51.7%, 16=6.9%, 32=0.0%, >=64=0.0% 00:28:54.459 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 complete : 0=0.0%, 4=93.8%, 8=0.3%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 issued rwts: total=2492,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.459 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.459 filename2: (groupid=0, jobs=1): err= 0: pid=999635: Tue Nov 26 15:52:43 2024 00:28:54.459 read: IOPS=238, BW=954KiB/s (977kB/s)(9600KiB/10066msec) 00:28:54.459 slat (usec): min=9, max=159, avg=46.70, stdev=24.95 00:28:54.459 clat (msec): min=17, max=494, avg=66.75, stdev=98.52 00:28:54.459 lat (msec): min=17, max=494, avg=66.79, stdev=98.52 00:28:54.459 clat percentiles (msec): 00:28:54.459 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.459 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.459 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 239], 95.00th=[ 305], 00:28:54.459 | 99.00th=[ 485], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], 00:28:54.459 | 99.99th=[ 493] 00:28:54.459 bw ( KiB/s): min= 128, max= 2032, per=4.13%, avg=953.60, stdev=875.59, samples=20 00:28:54.459 iops : min= 32, max= 508, avg=238.40, stdev=218.90, samples=20 00:28:54.459 lat (msec) : 20=0.08%, 50=87.83%, 250=2.17%, 500=9.92% 00:28:54.459 cpu : usr=98.51%, sys=1.02%, ctx=17, majf=0, minf=21 00:28:54.459 IO depths : 1=2.6%, 2=8.9%, 4=25.0%, 8=53.6%, 16=9.9%, 32=0.0%, >=64=0.0% 00:28:54.459 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 issued rwts: total=2400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.459 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.459 filename2: (groupid=0, jobs=1): err= 0: pid=999636: Tue Nov 26 15:52:43 2024 00:28:54.459 read: IOPS=237, BW=952KiB/s (975kB/s)(9536KiB/10017msec) 00:28:54.459 slat (nsec): min=8228, max=90335, avg=37170.13, stdev=12023.58 00:28:54.459 clat (msec): min=30, max=510, avg=66.87, stdev=100.65 00:28:54.459 lat (msec): min=30, max=510, avg=66.91, stdev=100.65 00:28:54.459 clat percentiles (msec): 00:28:54.459 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.459 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.459 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 253], 95.00th=[ 321], 00:28:54.459 | 99.00th=[ 502], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], 00:28:54.459 | 99.99th=[ 510] 00:28:54.459 bw ( KiB/s): min= 128, max= 2048, per=4.10%, avg=947.20, stdev=885.25, samples=20 00:28:54.459 iops : min= 32, max= 512, avg=236.80, stdev=221.31, samples=20 00:28:54.459 lat (msec) : 50=88.59%, 250=0.67%, 500=9.40%, 750=1.34% 00:28:54.459 cpu : usr=98.34%, sys=1.13%, ctx=27, majf=0, minf=31 00:28:54.459 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:54.459 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 issued rwts: total=2384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.459 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.459 filename2: (groupid=0, jobs=1): err= 0: pid=999637: Tue Nov 26 15:52:43 2024 00:28:54.459 read: IOPS=237, BW=949KiB/s (972kB/s)(9536KiB/10049msec) 00:28:54.459 slat (usec): min=9, max=172, avg=35.73, stdev=16.57 00:28:54.459 clat (msec): min=18, max=646, avg=67.13, stdev=101.27 00:28:54.459 lat (msec): min=18, max=646, avg=67.16, stdev=101.27 00:28:54.459 clat percentiles (msec): 00:28:54.459 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.459 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.459 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 253], 95.00th=[ 355], 00:28:54.459 | 99.00th=[ 485], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 651], 00:28:54.459 | 99.99th=[ 651] 00:28:54.459 bw ( KiB/s): min= 128, max= 2048, per=4.10%, avg=947.20, stdev=885.25, samples=20 00:28:54.459 iops : min= 32, max= 512, avg=236.80, stdev=221.31, samples=20 00:28:54.459 lat (msec) : 20=0.08%, 50=88.51%, 250=0.76%, 500=10.57%, 750=0.08% 00:28:54.459 cpu : usr=94.99%, sys=2.61%, ctx=540, majf=0, minf=27 00:28:54.459 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:54.459 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 issued rwts: total=2384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.459 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.459 filename2: (groupid=0, jobs=1): err= 0: pid=999638: Tue Nov 26 15:52:43 2024 00:28:54.459 read: IOPS=253, BW=1015KiB/s (1040kB/s)(9.93MiB/10016msec) 00:28:54.459 slat (nsec): min=7554, max=79593, avg=17936.50, stdev=12650.73 00:28:54.459 clat (msec): min=8, max=613, avg=62.94, stdev=99.68 00:28:54.459 lat (msec): min=8, max=613, avg=62.96, stdev=99.68 00:28:54.459 clat percentiles (msec): 00:28:54.459 | 1.00th=[ 17], 5.00th=[ 18], 10.00th=[ 25], 20.00th=[ 26], 00:28:54.459 | 30.00th=[ 31], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.459 | 70.00th=[ 33], 80.00th=[ 34], 90.00th=[ 218], 95.00th=[ 317], 00:28:54.459 | 99.00th=[ 502], 99.50th=[ 510], 99.90th=[ 531], 99.95th=[ 617], 00:28:54.459 | 99.99th=[ 617] 00:28:54.459 bw ( KiB/s): min= 128, max= 2208, per=4.37%, avg=1010.40, stdev=960.54, samples=20 00:28:54.459 iops : min= 32, max= 552, avg=252.60, stdev=240.13, samples=20 00:28:54.459 lat (msec) : 10=0.08%, 20=6.61%, 50=82.38%, 100=0.31%, 250=1.26% 00:28:54.459 lat (msec) : 500=8.03%, 750=1.34% 00:28:54.459 cpu : usr=98.66%, sys=0.92%, ctx=24, majf=0, minf=33 00:28:54.459 IO depths : 1=0.9%, 2=2.2%, 4=7.7%, 8=75.4%, 16=13.9%, 32=0.0%, >=64=0.0% 00:28:54.459 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 complete : 0=0.0%, 4=89.8%, 8=6.8%, 16=3.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 issued rwts: total=2542,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.459 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.459 filename2: (groupid=0, jobs=1): err= 0: pid=999639: Tue Nov 26 15:52:43 2024 00:28:54.459 read: IOPS=239, BW=957KiB/s (980kB/s)(9600KiB/10034msec) 00:28:54.459 slat (nsec): min=9052, max=84645, avg=35544.22, stdev=10129.21 00:28:54.459 clat (msec): min=30, max=613, avg=66.58, stdev=98.82 00:28:54.459 lat (msec): min=30, max=613, avg=66.62, stdev=98.81 00:28:54.459 clat percentiles (msec): 00:28:54.459 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 33], 00:28:54.459 | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:28:54.459 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 239], 95.00th=[ 305], 00:28:54.459 | 99.00th=[ 502], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 617], 00:28:54.459 | 99.99th=[ 617] 00:28:54.459 bw ( KiB/s): min= 128, max= 2048, per=4.13%, avg=953.60, stdev=877.50, samples=20 00:28:54.459 iops : min= 32, max= 512, avg=238.40, stdev=219.37, samples=20 00:28:54.459 lat (msec) : 50=88.00%, 250=2.33%, 500=8.33%, 750=1.33% 00:28:54.459 cpu : usr=98.77%, sys=0.81%, ctx=15, majf=0, minf=26 00:28:54.459 IO depths : 1=5.9%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.6%, 32=0.0%, >=64=0.0% 00:28:54.459 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.459 issued rwts: total=2400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.459 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.459 00:28:54.459 Run status group 0 (all jobs): 00:28:54.460 READ: bw=22.5MiB/s (23.6MB/s), 948KiB/s-1035KiB/s (971kB/s-1060kB/s), io=227MiB (239MB), run=10016-10089msec 00:28:54.460 15:52:44 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:28:54.460 15:52:44 -- target/dif.sh@43 -- # local sub 00:28:54.460 15:52:44 -- target/dif.sh@45 -- # for sub in "$@" 00:28:54.460 15:52:44 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:54.460 15:52:44 -- target/dif.sh@36 -- # local sub_id=0 00:28:54.460 15:52:44 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:54.460 15:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.460 15:52:44 -- common/autotest_common.sh@10 -- # set +x 00:28:54.460 15:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.460 15:52:44 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:54.460 15:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.460 15:52:44 -- common/autotest_common.sh@10 -- # set +x 00:28:54.460 15:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.460 15:52:44 -- target/dif.sh@45 -- # for sub in "$@" 00:28:54.460 15:52:44 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:54.460 15:52:44 -- target/dif.sh@36 -- # local sub_id=1 00:28:54.460 15:52:44 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:54.460 15:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.460 15:52:44 -- common/autotest_common.sh@10 -- # set +x 00:28:54.460 15:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.460 15:52:44 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:54.460 15:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.460 15:52:44 -- common/autotest_common.sh@10 -- # set +x 00:28:54.460 15:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.460 15:52:44 -- target/dif.sh@45 -- # for sub in "$@" 00:28:54.460 15:52:44 -- target/dif.sh@46 -- # destroy_subsystem 2 00:28:54.460 15:52:44 -- target/dif.sh@36 -- # local sub_id=2 00:28:54.460 15:52:44 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:54.460 15:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.460 15:52:44 -- common/autotest_common.sh@10 -- # set +x 00:28:54.460 15:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.460 15:52:44 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:28:54.460 15:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.460 15:52:44 -- common/autotest_common.sh@10 -- # set +x 00:28:54.460 15:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.460 15:52:44 -- target/dif.sh@115 -- # NULL_DIF=1 00:28:54.460 15:52:44 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:28:54.460 15:52:44 -- target/dif.sh@115 -- # numjobs=2 00:28:54.460 15:52:44 -- target/dif.sh@115 -- # iodepth=8 00:28:54.460 15:52:44 -- target/dif.sh@115 -- # runtime=5 00:28:54.460 15:52:44 -- target/dif.sh@115 -- # files=1 00:28:54.460 15:52:44 -- target/dif.sh@117 -- # create_subsystems 0 1 00:28:54.460 15:52:44 -- target/dif.sh@28 -- # local sub 00:28:54.460 15:52:44 -- target/dif.sh@30 -- # for sub in "$@" 00:28:54.460 15:52:44 -- target/dif.sh@31 -- # create_subsystem 0 00:28:54.460 15:52:44 -- target/dif.sh@18 -- # local sub_id=0 00:28:54.460 15:52:44 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:54.460 15:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.460 15:52:44 -- common/autotest_common.sh@10 -- # set +x 00:28:54.460 bdev_null0 00:28:54.460 15:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.460 15:52:44 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:54.460 15:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.460 15:52:44 -- common/autotest_common.sh@10 -- # set +x 00:28:54.460 15:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.460 15:52:44 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:54.460 15:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.460 15:52:44 -- common/autotest_common.sh@10 -- # set +x 00:28:54.460 15:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.460 15:52:44 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:54.460 15:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.460 15:52:44 -- common/autotest_common.sh@10 -- # set +x 00:28:54.460 [2024-11-26 15:52:44.103219] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:54.460 15:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.460 15:52:44 -- target/dif.sh@30 -- # for sub in "$@" 00:28:54.460 15:52:44 -- target/dif.sh@31 -- # create_subsystem 1 00:28:54.460 15:52:44 -- target/dif.sh@18 -- # local sub_id=1 00:28:54.460 15:52:44 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:54.460 15:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.460 15:52:44 -- common/autotest_common.sh@10 -- # set +x 00:28:54.460 bdev_null1 00:28:54.460 15:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.460 15:52:44 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:54.460 15:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.460 15:52:44 -- common/autotest_common.sh@10 -- # set +x 00:28:54.460 15:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.460 15:52:44 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:54.460 15:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.460 15:52:44 -- common/autotest_common.sh@10 -- # set +x 00:28:54.460 15:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.460 15:52:44 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:54.460 15:52:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.460 15:52:44 -- common/autotest_common.sh@10 -- # set +x 00:28:54.460 15:52:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.460 15:52:44 -- target/dif.sh@118 -- # fio /dev/fd/62 00:28:54.460 15:52:44 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:28:54.460 15:52:44 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:54.460 15:52:44 -- nvmf/common.sh@520 -- # config=() 00:28:54.460 15:52:44 -- nvmf/common.sh@520 -- # local subsystem config 00:28:54.460 15:52:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:54.460 15:52:44 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:54.460 15:52:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:54.460 { 00:28:54.460 "params": { 00:28:54.460 "name": "Nvme$subsystem", 00:28:54.460 "trtype": "$TEST_TRANSPORT", 00:28:54.460 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:54.460 "adrfam": "ipv4", 00:28:54.460 "trsvcid": "$NVMF_PORT", 00:28:54.460 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:54.460 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:54.460 "hdgst": ${hdgst:-false}, 00:28:54.460 "ddgst": ${ddgst:-false} 00:28:54.460 }, 00:28:54.460 "method": "bdev_nvme_attach_controller" 00:28:54.460 } 00:28:54.460 EOF 00:28:54.460 )") 00:28:54.460 15:52:44 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:54.460 15:52:44 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:54.460 15:52:44 -- target/dif.sh@82 -- # gen_fio_conf 00:28:54.460 15:52:44 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:54.460 15:52:44 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:54.460 15:52:44 -- target/dif.sh@54 -- # local file 00:28:54.460 15:52:44 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:54.460 15:52:44 -- target/dif.sh@56 -- # cat 00:28:54.460 15:52:44 -- common/autotest_common.sh@1330 -- # shift 00:28:54.460 15:52:44 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:54.460 15:52:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:54.460 15:52:44 -- nvmf/common.sh@542 -- # cat 00:28:54.460 15:52:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:54.460 15:52:44 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:54.460 15:52:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:54.460 15:52:44 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:54.460 15:52:44 -- target/dif.sh@72 -- # (( file <= files )) 00:28:54.460 15:52:44 -- target/dif.sh@73 -- # cat 00:28:54.460 15:52:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:54.460 15:52:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:54.460 { 00:28:54.460 "params": { 00:28:54.460 "name": "Nvme$subsystem", 00:28:54.460 "trtype": "$TEST_TRANSPORT", 00:28:54.460 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:54.460 "adrfam": "ipv4", 00:28:54.460 "trsvcid": "$NVMF_PORT", 00:28:54.460 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:54.460 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:54.460 "hdgst": ${hdgst:-false}, 00:28:54.460 "ddgst": ${ddgst:-false} 00:28:54.460 }, 00:28:54.460 "method": "bdev_nvme_attach_controller" 00:28:54.460 } 00:28:54.460 EOF 00:28:54.460 )") 00:28:54.460 15:52:44 -- nvmf/common.sh@542 -- # cat 00:28:54.460 15:52:44 -- target/dif.sh@72 -- # (( file++ )) 00:28:54.460 15:52:44 -- target/dif.sh@72 -- # (( file <= files )) 00:28:54.460 15:52:44 -- nvmf/common.sh@544 -- # jq . 00:28:54.460 15:52:44 -- nvmf/common.sh@545 -- # IFS=, 00:28:54.460 15:52:44 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:54.460 "params": { 00:28:54.460 "name": "Nvme0", 00:28:54.460 "trtype": "tcp", 00:28:54.460 "traddr": "10.0.0.2", 00:28:54.460 "adrfam": "ipv4", 00:28:54.460 "trsvcid": "4420", 00:28:54.460 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:54.460 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:54.460 "hdgst": false, 00:28:54.460 "ddgst": false 00:28:54.460 }, 00:28:54.460 "method": "bdev_nvme_attach_controller" 00:28:54.460 },{ 00:28:54.460 "params": { 00:28:54.460 "name": "Nvme1", 00:28:54.460 "trtype": "tcp", 00:28:54.460 "traddr": "10.0.0.2", 00:28:54.460 "adrfam": "ipv4", 00:28:54.460 "trsvcid": "4420", 00:28:54.460 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:54.460 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:54.460 "hdgst": false, 00:28:54.460 "ddgst": false 00:28:54.460 }, 00:28:54.460 "method": "bdev_nvme_attach_controller" 00:28:54.460 }' 00:28:54.460 15:52:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:54.460 15:52:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:54.461 15:52:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:54.461 15:52:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:54.461 15:52:44 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:54.461 15:52:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:54.461 15:52:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:54.461 15:52:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:54.461 15:52:44 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:54.461 15:52:44 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:54.461 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:28:54.461 ... 00:28:54.461 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:28:54.461 ... 00:28:54.461 fio-3.35 00:28:54.461 Starting 4 threads 00:28:54.461 EAL: No free 2048 kB hugepages reported on node 1 00:28:54.461 [2024-11-26 15:52:45.132127] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:54.461 [2024-11-26 15:52:45.132197] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:59.726 00:28:59.726 filename0: (groupid=0, jobs=1): err= 0: pid=1000993: Tue Nov 26 15:52:50 2024 00:28:59.726 read: IOPS=1974, BW=15.4MiB/s (16.2MB/s)(77.2MiB/5003msec) 00:28:59.726 slat (nsec): min=3819, max=67247, avg=13167.75, stdev=7391.18 00:28:59.726 clat (usec): min=1251, max=8062, avg=4009.04, stdev=656.14 00:28:59.726 lat (usec): min=1264, max=8087, avg=4022.21, stdev=656.20 00:28:59.726 clat percentiles (usec): 00:28:59.726 | 1.00th=[ 2900], 5.00th=[ 3294], 10.00th=[ 3392], 20.00th=[ 3556], 00:28:59.726 | 30.00th=[ 3654], 40.00th=[ 3752], 50.00th=[ 3884], 60.00th=[ 3982], 00:28:59.726 | 70.00th=[ 4113], 80.00th=[ 4293], 90.00th=[ 5276], 95.00th=[ 5473], 00:28:59.726 | 99.00th=[ 5735], 99.50th=[ 6063], 99.90th=[ 6849], 99.95th=[ 7570], 00:28:59.726 | 99.99th=[ 8094] 00:28:59.726 bw ( KiB/s): min=14896, max=16256, per=25.13%, avg=15798.40, stdev=527.34, samples=10 00:28:59.726 iops : min= 1862, max= 2032, avg=1974.80, stdev=65.92, samples=10 00:28:59.726 lat (msec) : 2=0.05%, 4=62.81%, 10=37.14% 00:28:59.726 cpu : usr=95.72%, sys=3.78%, ctx=14, majf=0, minf=36 00:28:59.726 IO depths : 1=0.1%, 2=4.7%, 4=67.3%, 8=27.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:59.726 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.726 complete : 0=0.0%, 4=93.0%, 8=7.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.726 issued rwts: total=9879,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.726 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:59.726 filename0: (groupid=0, jobs=1): err= 0: pid=1000994: Tue Nov 26 15:52:50 2024 00:28:59.726 read: IOPS=1957, BW=15.3MiB/s (16.0MB/s)(76.5MiB/5001msec) 00:28:59.726 slat (nsec): min=3810, max=65051, avg=14914.74, stdev=8587.94 00:28:59.726 clat (usec): min=635, max=8276, avg=4037.33, stdev=673.15 00:28:59.726 lat (usec): min=663, max=8288, avg=4052.25, stdev=672.26 00:28:59.726 clat percentiles (usec): 00:28:59.726 | 1.00th=[ 2900], 5.00th=[ 3294], 10.00th=[ 3425], 20.00th=[ 3589], 00:28:59.727 | 30.00th=[ 3687], 40.00th=[ 3818], 50.00th=[ 3884], 60.00th=[ 3982], 00:28:59.727 | 70.00th=[ 4113], 80.00th=[ 4293], 90.00th=[ 5276], 95.00th=[ 5473], 00:28:59.727 | 99.00th=[ 6194], 99.50th=[ 6521], 99.90th=[ 7177], 99.95th=[ 7570], 00:28:59.727 | 99.99th=[ 8291] 00:28:59.727 bw ( KiB/s): min=14300, max=16416, per=24.84%, avg=15617.33, stdev=711.10, samples=9 00:28:59.727 iops : min= 1787, max= 2052, avg=1952.11, stdev=89.00, samples=9 00:28:59.727 lat (usec) : 750=0.04%, 1000=0.03% 00:28:59.727 lat (msec) : 2=0.19%, 4=61.81%, 10=37.93% 00:28:59.727 cpu : usr=96.26%, sys=3.08%, ctx=15, majf=0, minf=43 00:28:59.727 IO depths : 1=0.1%, 2=4.2%, 4=68.3%, 8=27.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:59.727 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.727 complete : 0=0.0%, 4=92.6%, 8=7.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.727 issued rwts: total=9790,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.727 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:59.727 filename1: (groupid=0, jobs=1): err= 0: pid=1000995: Tue Nov 26 15:52:50 2024 00:28:59.727 read: IOPS=1987, BW=15.5MiB/s (16.3MB/s)(77.7MiB/5003msec) 00:28:59.727 slat (nsec): min=3756, max=69025, avg=12932.44, stdev=7429.39 00:28:59.727 clat (usec): min=1088, max=7191, avg=3983.90, stdev=675.24 00:28:59.727 lat (usec): min=1107, max=7203, avg=3996.83, stdev=674.95 00:28:59.727 clat percentiles (usec): 00:28:59.727 | 1.00th=[ 2769], 5.00th=[ 3195], 10.00th=[ 3359], 20.00th=[ 3556], 00:28:59.727 | 30.00th=[ 3621], 40.00th=[ 3752], 50.00th=[ 3851], 60.00th=[ 3949], 00:28:59.727 | 70.00th=[ 4080], 80.00th=[ 4293], 90.00th=[ 5276], 95.00th=[ 5473], 00:28:59.727 | 99.00th=[ 6063], 99.50th=[ 6390], 99.90th=[ 6915], 99.95th=[ 7177], 00:28:59.727 | 99.99th=[ 7177] 00:28:59.727 bw ( KiB/s): min=14893, max=16544, per=25.30%, avg=15903.70, stdev=481.71, samples=10 00:28:59.727 iops : min= 1861, max= 2068, avg=1987.90, stdev=60.36, samples=10 00:28:59.727 lat (msec) : 2=0.06%, 4=64.09%, 10=35.85% 00:28:59.727 cpu : usr=95.58%, sys=3.92%, ctx=8, majf=0, minf=79 00:28:59.727 IO depths : 1=0.1%, 2=3.6%, 4=68.8%, 8=27.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:59.727 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.727 complete : 0=0.0%, 4=92.7%, 8=7.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.727 issued rwts: total=9943,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.727 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:59.727 filename1: (groupid=0, jobs=1): err= 0: pid=1000996: Tue Nov 26 15:52:50 2024 00:28:59.727 read: IOPS=1940, BW=15.2MiB/s (15.9MB/s)(75.8MiB/5001msec) 00:28:59.727 slat (nsec): min=3747, max=65718, avg=15787.06, stdev=8847.11 00:28:59.727 clat (usec): min=719, max=7590, avg=4072.51, stdev=686.29 00:28:59.727 lat (usec): min=736, max=7598, avg=4088.29, stdev=684.26 00:28:59.727 clat percentiles (usec): 00:28:59.727 | 1.00th=[ 3195], 5.00th=[ 3359], 10.00th=[ 3458], 20.00th=[ 3589], 00:28:59.727 | 30.00th=[ 3687], 40.00th=[ 3785], 50.00th=[ 3916], 60.00th=[ 4015], 00:28:59.727 | 70.00th=[ 4146], 80.00th=[ 4359], 90.00th=[ 5407], 95.00th=[ 5538], 00:28:59.727 | 99.00th=[ 6194], 99.50th=[ 6456], 99.90th=[ 6980], 99.95th=[ 7177], 00:28:59.727 | 99.99th=[ 7570] 00:28:59.727 bw ( KiB/s): min=14752, max=16112, per=24.61%, avg=15473.78, stdev=465.06, samples=9 00:28:59.727 iops : min= 1844, max= 2014, avg=1934.22, stdev=58.13, samples=9 00:28:59.727 lat (usec) : 750=0.01%, 1000=0.03% 00:28:59.727 lat (msec) : 2=0.14%, 4=59.54%, 10=40.27% 00:28:59.727 cpu : usr=96.10%, sys=3.12%, ctx=78, majf=0, minf=47 00:28:59.727 IO depths : 1=0.1%, 2=3.3%, 4=69.5%, 8=27.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:59.727 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.727 complete : 0=0.0%, 4=92.4%, 8=7.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.727 issued rwts: total=9702,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.727 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:59.727 00:28:59.727 Run status group 0 (all jobs): 00:28:59.727 READ: bw=61.4MiB/s (64.4MB/s), 15.2MiB/s-15.5MiB/s (15.9MB/s-16.3MB/s), io=307MiB (322MB), run=5001-5003msec 00:28:59.727 15:52:50 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:28:59.727 15:52:50 -- target/dif.sh@43 -- # local sub 00:28:59.727 15:52:50 -- target/dif.sh@45 -- # for sub in "$@" 00:28:59.727 15:52:50 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:59.727 15:52:50 -- target/dif.sh@36 -- # local sub_id=0 00:28:59.727 15:52:50 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:59.727 15:52:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.727 15:52:50 -- common/autotest_common.sh@10 -- # set +x 00:28:59.727 15:52:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.727 15:52:50 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:59.727 15:52:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.727 15:52:50 -- common/autotest_common.sh@10 -- # set +x 00:28:59.727 15:52:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.727 15:52:50 -- target/dif.sh@45 -- # for sub in "$@" 00:28:59.727 15:52:50 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:59.727 15:52:50 -- target/dif.sh@36 -- # local sub_id=1 00:28:59.727 15:52:50 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:59.727 15:52:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.727 15:52:50 -- common/autotest_common.sh@10 -- # set +x 00:28:59.727 15:52:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.727 15:52:50 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:59.727 15:52:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.727 15:52:50 -- common/autotest_common.sh@10 -- # set +x 00:28:59.727 15:52:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.727 00:28:59.727 real 0m24.408s 00:28:59.727 user 4m34.315s 00:28:59.727 sys 0m5.763s 00:28:59.727 15:52:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:59.727 15:52:50 -- common/autotest_common.sh@10 -- # set +x 00:28:59.727 ************************************ 00:28:59.727 END TEST fio_dif_rand_params 00:28:59.727 ************************************ 00:28:59.727 15:52:50 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:28:59.727 15:52:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:59.727 15:52:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:59.727 15:52:50 -- common/autotest_common.sh@10 -- # set +x 00:28:59.727 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:28:59.727 ************************************ 00:28:59.727 START TEST fio_dif_digest 00:28:59.727 ************************************ 00:28:59.727 15:52:50 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:28:59.727 15:52:50 -- target/dif.sh@123 -- # local NULL_DIF 00:28:59.727 15:52:50 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:28:59.727 15:52:50 -- target/dif.sh@125 -- # local hdgst ddgst 00:28:59.727 15:52:50 -- target/dif.sh@127 -- # NULL_DIF=3 00:28:59.727 15:52:50 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:28:59.727 15:52:50 -- target/dif.sh@127 -- # numjobs=3 00:28:59.727 15:52:50 -- target/dif.sh@127 -- # iodepth=3 00:28:59.727 15:52:50 -- target/dif.sh@127 -- # runtime=10 00:28:59.727 15:52:50 -- target/dif.sh@128 -- # hdgst=true 00:28:59.727 15:52:50 -- target/dif.sh@128 -- # ddgst=true 00:28:59.727 15:52:50 -- target/dif.sh@130 -- # create_subsystems 0 00:28:59.727 15:52:50 -- target/dif.sh@28 -- # local sub 00:28:59.727 15:52:50 -- target/dif.sh@30 -- # for sub in "$@" 00:28:59.727 15:52:50 -- target/dif.sh@31 -- # create_subsystem 0 00:28:59.727 15:52:50 -- target/dif.sh@18 -- # local sub_id=0 00:28:59.727 15:52:50 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:28:59.727 15:52:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.727 15:52:50 -- common/autotest_common.sh@10 -- # set +x 00:28:59.727 bdev_null0 00:28:59.727 15:52:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.727 15:52:50 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:59.727 15:52:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.727 15:52:50 -- common/autotest_common.sh@10 -- # set +x 00:28:59.727 15:52:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.727 15:52:50 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:59.727 15:52:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.728 15:52:50 -- common/autotest_common.sh@10 -- # set +x 00:28:59.728 15:52:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.728 15:52:50 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:59.728 15:52:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.728 15:52:50 -- common/autotest_common.sh@10 -- # set +x 00:28:59.728 [2024-11-26 15:52:50.572742] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:59.728 15:52:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.728 15:52:50 -- target/dif.sh@131 -- # fio /dev/fd/62 00:28:59.728 15:52:50 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:28:59.728 15:52:50 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:59.728 15:52:50 -- nvmf/common.sh@520 -- # config=() 00:28:59.728 15:52:50 -- nvmf/common.sh@520 -- # local subsystem config 00:28:59.728 15:52:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:59.728 15:52:50 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:59.728 15:52:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:59.728 { 00:28:59.728 "params": { 00:28:59.728 "name": "Nvme$subsystem", 00:28:59.728 "trtype": "$TEST_TRANSPORT", 00:28:59.728 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:59.728 "adrfam": "ipv4", 00:28:59.728 "trsvcid": "$NVMF_PORT", 00:28:59.728 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:59.728 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:59.728 "hdgst": ${hdgst:-false}, 00:28:59.728 "ddgst": ${ddgst:-false} 00:28:59.728 }, 00:28:59.728 "method": "bdev_nvme_attach_controller" 00:28:59.728 } 00:28:59.728 EOF 00:28:59.728 )") 00:28:59.728 15:52:50 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:59.728 15:52:50 -- target/dif.sh@82 -- # gen_fio_conf 00:28:59.728 15:52:50 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:59.728 15:52:50 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:59.728 15:52:50 -- target/dif.sh@54 -- # local file 00:28:59.728 15:52:50 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:59.728 15:52:50 -- target/dif.sh@56 -- # cat 00:28:59.728 15:52:50 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:59.728 15:52:50 -- common/autotest_common.sh@1330 -- # shift 00:28:59.728 15:52:50 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:59.728 15:52:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:59.728 15:52:50 -- nvmf/common.sh@542 -- # cat 00:28:59.728 15:52:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:59.728 15:52:50 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:59.728 15:52:50 -- target/dif.sh@72 -- # (( file <= files )) 00:28:59.728 15:52:50 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:59.728 15:52:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:59.728 15:52:50 -- nvmf/common.sh@544 -- # jq . 00:28:59.728 15:52:50 -- nvmf/common.sh@545 -- # IFS=, 00:28:59.728 15:52:50 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:59.728 "params": { 00:28:59.728 "name": "Nvme0", 00:28:59.728 "trtype": "tcp", 00:28:59.728 "traddr": "10.0.0.2", 00:28:59.728 "adrfam": "ipv4", 00:28:59.728 "trsvcid": "4420", 00:28:59.728 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:59.728 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:59.728 "hdgst": true, 00:28:59.728 "ddgst": true 00:28:59.728 }, 00:28:59.728 "method": "bdev_nvme_attach_controller" 00:28:59.728 }' 00:28:59.728 15:52:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:59.728 15:52:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:59.728 15:52:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:59.728 15:52:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:59.728 15:52:50 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:59.728 15:52:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:59.728 15:52:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:59.728 15:52:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:59.728 15:52:50 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:59.728 15:52:50 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:59.728 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:28:59.728 ... 00:28:59.728 fio-3.35 00:28:59.728 Starting 3 threads 00:28:59.728 EAL: No free 2048 kB hugepages reported on node 1 00:28:59.986 [2024-11-26 15:52:51.271336] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:59.986 [2024-11-26 15:52:51.271395] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:12.186 00:29:12.186 filename0: (groupid=0, jobs=1): err= 0: pid=1001733: Tue Nov 26 15:53:01 2024 00:29:12.186 read: IOPS=202, BW=25.3MiB/s (26.5MB/s)(254MiB/10044msec) 00:29:12.186 slat (nsec): min=4342, max=39767, avg=13520.38, stdev=3574.87 00:29:12.186 clat (usec): min=11201, max=55577, avg=14797.70, stdev=2260.36 00:29:12.186 lat (usec): min=11213, max=55596, avg=14811.22, stdev=2260.23 00:29:12.186 clat percentiles (usec): 00:29:12.186 | 1.00th=[12125], 5.00th=[12911], 10.00th=[13304], 20.00th=[13698], 00:29:12.186 | 30.00th=[14091], 40.00th=[14353], 50.00th=[14615], 60.00th=[14877], 00:29:12.186 | 70.00th=[15270], 80.00th=[15664], 90.00th=[16188], 95.00th=[16581], 00:29:12.186 | 99.00th=[17695], 99.50th=[18220], 99.90th=[55313], 99.95th=[55313], 00:29:12.186 | 99.99th=[55837] 00:29:12.186 bw ( KiB/s): min=23040, max=27648, per=33.18%, avg=25971.20, stdev=941.43, samples=20 00:29:12.186 iops : min= 180, max= 216, avg=202.90, stdev= 7.35, samples=20 00:29:12.186 lat (msec) : 20=99.66%, 50=0.10%, 100=0.25% 00:29:12.186 cpu : usr=90.97%, sys=8.52%, ctx=26, majf=0, minf=108 00:29:12.186 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:12.186 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:12.186 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:12.186 issued rwts: total=2031,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:12.186 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:12.186 filename0: (groupid=0, jobs=1): err= 0: pid=1001734: Tue Nov 26 15:53:01 2024 00:29:12.186 read: IOPS=201, BW=25.1MiB/s (26.4MB/s)(253MiB/10046msec) 00:29:12.186 slat (nsec): min=4440, max=38951, avg=13349.42, stdev=3403.39 00:29:12.186 clat (usec): min=11400, max=60707, avg=14880.90, stdev=2358.57 00:29:12.186 lat (usec): min=11413, max=60718, avg=14894.25, stdev=2358.44 00:29:12.186 clat percentiles (usec): 00:29:12.186 | 1.00th=[12256], 5.00th=[12911], 10.00th=[13435], 20.00th=[13829], 00:29:12.186 | 30.00th=[14222], 40.00th=[14484], 50.00th=[14746], 60.00th=[15008], 00:29:12.187 | 70.00th=[15270], 80.00th=[15664], 90.00th=[16188], 95.00th=[16712], 00:29:12.187 | 99.00th=[17433], 99.50th=[18220], 99.90th=[60556], 99.95th=[60556], 00:29:12.187 | 99.99th=[60556] 00:29:12.187 bw ( KiB/s): min=22272, max=27648, per=33.00%, avg=25830.40, stdev=1177.25, samples=20 00:29:12.187 iops : min= 174, max= 216, avg=201.80, stdev= 9.20, samples=20 00:29:12.187 lat (msec) : 20=99.75%, 50=0.05%, 100=0.20% 00:29:12.187 cpu : usr=91.21%, sys=8.32%, ctx=23, majf=0, minf=123 00:29:12.187 IO depths : 1=0.6%, 2=99.4%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:12.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:12.187 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:12.187 issued rwts: total=2020,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:12.187 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:12.187 filename0: (groupid=0, jobs=1): err= 0: pid=1001735: Tue Nov 26 15:53:01 2024 00:29:12.187 read: IOPS=208, BW=26.0MiB/s (27.3MB/s)(262MiB/10047msec) 00:29:12.187 slat (nsec): min=4456, max=45990, avg=13495.48, stdev=3599.99 00:29:12.187 clat (usec): min=4918, max=49042, avg=14362.71, stdev=1692.51 00:29:12.187 lat (usec): min=4931, max=49055, avg=14376.20, stdev=1692.52 00:29:12.187 clat percentiles (usec): 00:29:12.187 | 1.00th=[11207], 5.00th=[12518], 10.00th=[12911], 20.00th=[13435], 00:29:12.187 | 30.00th=[13829], 40.00th=[14091], 50.00th=[14353], 60.00th=[14615], 00:29:12.187 | 70.00th=[14877], 80.00th=[15270], 90.00th=[15795], 95.00th=[16319], 00:29:12.187 | 99.00th=[17433], 99.50th=[17695], 99.90th=[20317], 99.95th=[47449], 00:29:12.187 | 99.99th=[49021] 00:29:12.187 bw ( KiB/s): min=25856, max=28472, per=34.20%, avg=26767.60, stdev=637.48, samples=20 00:29:12.187 iops : min= 202, max= 222, avg=209.10, stdev= 4.92, samples=20 00:29:12.187 lat (msec) : 10=0.72%, 20=99.14%, 50=0.14% 00:29:12.187 cpu : usr=91.25%, sys=8.27%, ctx=17, majf=0, minf=186 00:29:12.187 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:12.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:12.187 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:12.187 issued rwts: total=2093,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:12.187 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:12.187 00:29:12.187 Run status group 0 (all jobs): 00:29:12.187 READ: bw=76.4MiB/s (80.2MB/s), 25.1MiB/s-26.0MiB/s (26.4MB/s-27.3MB/s), io=768MiB (805MB), run=10044-10047msec 00:29:12.187 15:53:01 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:12.187 15:53:01 -- target/dif.sh@43 -- # local sub 00:29:12.187 15:53:01 -- target/dif.sh@45 -- # for sub in "$@" 00:29:12.187 15:53:01 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:12.187 15:53:01 -- target/dif.sh@36 -- # local sub_id=0 00:29:12.187 15:53:01 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:12.187 15:53:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:12.187 15:53:01 -- common/autotest_common.sh@10 -- # set +x 00:29:12.187 15:53:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:12.187 15:53:01 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:12.187 15:53:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:12.187 15:53:01 -- common/autotest_common.sh@10 -- # set +x 00:29:12.187 15:53:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:12.187 00:29:12.187 real 0m11.230s 00:29:12.187 user 0m28.688s 00:29:12.187 sys 0m2.806s 00:29:12.187 15:53:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:12.187 15:53:01 -- common/autotest_common.sh@10 -- # set +x 00:29:12.187 ************************************ 00:29:12.187 END TEST fio_dif_digest 00:29:12.187 ************************************ 00:29:12.187 15:53:01 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:12.187 15:53:01 -- target/dif.sh@147 -- # nvmftestfini 00:29:12.187 15:53:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:12.187 15:53:01 -- nvmf/common.sh@116 -- # sync 00:29:12.187 15:53:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:12.187 15:53:01 -- nvmf/common.sh@119 -- # set +e 00:29:12.187 15:53:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:12.187 15:53:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:12.187 rmmod nvme_tcp 00:29:12.187 rmmod nvme_fabrics 00:29:12.187 rmmod nvme_keyring 00:29:12.187 15:53:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:12.187 15:53:01 -- nvmf/common.sh@123 -- # set -e 00:29:12.187 15:53:01 -- nvmf/common.sh@124 -- # return 0 00:29:12.187 15:53:01 -- nvmf/common.sh@477 -- # '[' -n 995778 ']' 00:29:12.187 15:53:01 -- nvmf/common.sh@478 -- # killprocess 995778 00:29:12.187 15:53:01 -- common/autotest_common.sh@936 -- # '[' -z 995778 ']' 00:29:12.187 15:53:01 -- common/autotest_common.sh@940 -- # kill -0 995778 00:29:12.187 15:53:01 -- common/autotest_common.sh@941 -- # uname 00:29:12.187 15:53:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:12.187 15:53:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 995778 00:29:12.187 15:53:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:12.187 15:53:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:12.187 15:53:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 995778' 00:29:12.187 killing process with pid 995778 00:29:12.187 15:53:01 -- common/autotest_common.sh@955 -- # kill 995778 00:29:12.187 15:53:01 -- common/autotest_common.sh@960 -- # wait 995778 00:29:12.187 15:53:02 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:12.187 15:53:02 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:12.187 Waiting for block devices as requested 00:29:12.187 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:12.187 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:12.187 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:12.187 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:12.448 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:12.448 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:12.448 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:12.448 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:12.709 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:12.709 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:12.709 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:12.709 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:12.970 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:12.970 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:12.970 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:12.970 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:13.229 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:13.229 15:53:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:13.229 15:53:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:13.229 15:53:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:13.229 15:53:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:13.229 15:53:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:13.229 15:53:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:13.229 15:53:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:15.766 15:53:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:15.766 00:29:15.766 real 1m7.923s 00:29:15.766 user 6m32.310s 00:29:15.766 sys 0m17.508s 00:29:15.766 15:53:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:15.766 15:53:06 -- common/autotest_common.sh@10 -- # set +x 00:29:15.766 ************************************ 00:29:15.766 END TEST nvmf_dif 00:29:15.766 ************************************ 00:29:15.766 15:53:06 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:15.766 15:53:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:15.766 15:53:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:15.766 15:53:06 -- common/autotest_common.sh@10 -- # set +x 00:29:15.766 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:29:15.766 ************************************ 00:29:15.766 START TEST nvmf_abort_qd_sizes 00:29:15.766 ************************************ 00:29:15.766 15:53:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:15.766 * Looking for test storage... 00:29:15.766 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:15.766 15:53:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:15.766 15:53:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:15.766 15:53:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:15.766 15:53:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:15.766 15:53:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:15.766 15:53:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:15.766 15:53:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:15.766 15:53:06 -- scripts/common.sh@335 -- # IFS=.-: 00:29:15.766 15:53:06 -- scripts/common.sh@335 -- # read -ra ver1 00:29:15.766 15:53:06 -- scripts/common.sh@336 -- # IFS=.-: 00:29:15.766 15:53:06 -- scripts/common.sh@336 -- # read -ra ver2 00:29:15.766 15:53:06 -- scripts/common.sh@337 -- # local 'op=<' 00:29:15.766 15:53:06 -- scripts/common.sh@339 -- # ver1_l=2 00:29:15.766 15:53:06 -- scripts/common.sh@340 -- # ver2_l=1 00:29:15.766 15:53:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:15.766 15:53:06 -- scripts/common.sh@343 -- # case "$op" in 00:29:15.766 15:53:06 -- scripts/common.sh@344 -- # : 1 00:29:15.766 15:53:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:15.766 15:53:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:15.766 15:53:06 -- scripts/common.sh@364 -- # decimal 1 00:29:15.766 15:53:06 -- scripts/common.sh@352 -- # local d=1 00:29:15.766 15:53:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:15.766 15:53:06 -- scripts/common.sh@354 -- # echo 1 00:29:15.766 15:53:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:15.766 15:53:06 -- scripts/common.sh@365 -- # decimal 2 00:29:15.766 15:53:06 -- scripts/common.sh@352 -- # local d=2 00:29:15.766 15:53:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:15.766 15:53:06 -- scripts/common.sh@354 -- # echo 2 00:29:15.766 15:53:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:15.766 15:53:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:15.766 15:53:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:15.766 15:53:06 -- scripts/common.sh@367 -- # return 0 00:29:15.766 15:53:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:15.766 15:53:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:15.766 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:15.766 --rc genhtml_branch_coverage=1 00:29:15.766 --rc genhtml_function_coverage=1 00:29:15.766 --rc genhtml_legend=1 00:29:15.766 --rc geninfo_all_blocks=1 00:29:15.766 --rc geninfo_unexecuted_blocks=1 00:29:15.766 00:29:15.766 ' 00:29:15.766 15:53:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:15.766 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:15.766 --rc genhtml_branch_coverage=1 00:29:15.766 --rc genhtml_function_coverage=1 00:29:15.766 --rc genhtml_legend=1 00:29:15.766 --rc geninfo_all_blocks=1 00:29:15.766 --rc geninfo_unexecuted_blocks=1 00:29:15.766 00:29:15.766 ' 00:29:15.766 15:53:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:15.766 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:15.766 --rc genhtml_branch_coverage=1 00:29:15.766 --rc genhtml_function_coverage=1 00:29:15.766 --rc genhtml_legend=1 00:29:15.766 --rc geninfo_all_blocks=1 00:29:15.766 --rc geninfo_unexecuted_blocks=1 00:29:15.766 00:29:15.766 ' 00:29:15.766 15:53:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:15.766 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:15.766 --rc genhtml_branch_coverage=1 00:29:15.766 --rc genhtml_function_coverage=1 00:29:15.766 --rc genhtml_legend=1 00:29:15.766 --rc geninfo_all_blocks=1 00:29:15.766 --rc geninfo_unexecuted_blocks=1 00:29:15.766 00:29:15.766 ' 00:29:15.766 15:53:06 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:15.766 15:53:06 -- nvmf/common.sh@7 -- # uname -s 00:29:15.766 15:53:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:15.767 15:53:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:15.767 15:53:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:15.767 15:53:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:15.767 15:53:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:15.767 15:53:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:15.767 15:53:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:15.767 15:53:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:15.767 15:53:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:15.767 15:53:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:15.767 15:53:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:15.767 15:53:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:15.767 15:53:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:15.767 15:53:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:15.767 15:53:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:15.767 15:53:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:15.767 15:53:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:15.767 15:53:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:15.767 15:53:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:15.767 15:53:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.767 15:53:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.767 15:53:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.767 15:53:06 -- paths/export.sh@5 -- # export PATH 00:29:15.767 15:53:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.767 15:53:06 -- nvmf/common.sh@46 -- # : 0 00:29:15.767 15:53:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:15.767 15:53:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:15.767 15:53:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:15.767 15:53:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:15.767 15:53:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:15.767 15:53:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:15.767 15:53:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:15.767 15:53:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:15.767 15:53:06 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:15.767 15:53:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:15.767 15:53:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:15.767 15:53:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:15.767 15:53:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:15.767 15:53:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:15.767 15:53:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:15.767 15:53:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:15.767 15:53:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:15.767 15:53:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:15.767 15:53:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:15.767 15:53:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:15.767 15:53:06 -- common/autotest_common.sh@10 -- # set +x 00:29:17.672 15:53:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:17.672 15:53:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:17.672 15:53:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:17.672 15:53:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:17.672 15:53:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:17.672 15:53:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:17.672 15:53:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:17.672 15:53:08 -- nvmf/common.sh@294 -- # net_devs=() 00:29:17.672 15:53:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:17.672 15:53:08 -- nvmf/common.sh@295 -- # e810=() 00:29:17.672 15:53:08 -- nvmf/common.sh@295 -- # local -ga e810 00:29:17.672 15:53:08 -- nvmf/common.sh@296 -- # x722=() 00:29:17.672 15:53:08 -- nvmf/common.sh@296 -- # local -ga x722 00:29:17.672 15:53:08 -- nvmf/common.sh@297 -- # mlx=() 00:29:17.672 15:53:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:17.672 15:53:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:17.672 15:53:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:17.672 15:53:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:17.672 15:53:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:17.672 15:53:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:17.672 15:53:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:17.672 15:53:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:17.672 15:53:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:17.672 15:53:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:17.672 15:53:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:17.673 15:53:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:17.673 15:53:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:17.673 15:53:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:17.673 15:53:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:17.673 15:53:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:17.673 15:53:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:17.673 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:17.673 15:53:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:17.673 15:53:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:17.673 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:17.673 15:53:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:17.673 15:53:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:17.673 15:53:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:17.673 15:53:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:17.673 15:53:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:17.673 15:53:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:17.673 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:17.673 15:53:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:17.673 15:53:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:17.673 15:53:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:17.673 15:53:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:17.673 15:53:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:17.673 15:53:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:17.673 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:17.673 15:53:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:17.673 15:53:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:17.673 15:53:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:17.673 15:53:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:17.673 15:53:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:17.673 15:53:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:17.673 15:53:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:17.673 15:53:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:17.673 15:53:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:17.673 15:53:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:17.673 15:53:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:17.673 15:53:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:17.673 15:53:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:17.673 15:53:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:17.673 15:53:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:17.673 15:53:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:17.673 15:53:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:17.673 15:53:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:17.673 15:53:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:17.673 15:53:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:17.673 15:53:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:17.673 15:53:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:17.673 15:53:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:17.673 15:53:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:17.673 15:53:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:17.673 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:17.673 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.361 ms 00:29:17.673 00:29:17.673 --- 10.0.0.2 ping statistics --- 00:29:17.673 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:17.673 rtt min/avg/max/mdev = 0.361/0.361/0.361/0.000 ms 00:29:17.673 15:53:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:17.673 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:17.673 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:29:17.673 00:29:17.673 --- 10.0.0.1 ping statistics --- 00:29:17.673 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:17.673 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:29:17.673 15:53:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:17.673 15:53:08 -- nvmf/common.sh@410 -- # return 0 00:29:17.673 15:53:08 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:17.673 15:53:08 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:18.610 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:18.610 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:18.610 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:18.610 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:18.610 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:18.610 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:18.610 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:18.610 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:18.610 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:18.610 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:18.610 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:18.610 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:18.610 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:18.610 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:18.610 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:18.610 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:19.548 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:19.806 15:53:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:19.806 15:53:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:19.806 15:53:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:19.806 15:53:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:19.806 15:53:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:19.806 15:53:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:19.806 15:53:11 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:19.806 15:53:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:19.806 15:53:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:19.806 15:53:11 -- common/autotest_common.sh@10 -- # set +x 00:29:19.806 15:53:11 -- nvmf/common.sh@469 -- # nvmfpid=1006647 00:29:19.806 15:53:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:19.806 15:53:11 -- nvmf/common.sh@470 -- # waitforlisten 1006647 00:29:19.806 15:53:11 -- common/autotest_common.sh@829 -- # '[' -z 1006647 ']' 00:29:19.806 15:53:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:19.806 15:53:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:19.806 15:53:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:19.806 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:19.806 15:53:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:19.806 15:53:11 -- common/autotest_common.sh@10 -- # set +x 00:29:19.806 [2024-11-26 15:53:11.110120] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:19.806 [2024-11-26 15:53:11.110209] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:19.806 EAL: No free 2048 kB hugepages reported on node 1 00:29:19.806 [2024-11-26 15:53:11.172659] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:20.066 [2024-11-26 15:53:11.278610] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:20.066 [2024-11-26 15:53:11.278780] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:20.066 [2024-11-26 15:53:11.278799] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:20.066 [2024-11-26 15:53:11.278811] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:20.066 [2024-11-26 15:53:11.278876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:20.066 [2024-11-26 15:53:11.279148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:20.066 [2024-11-26 15:53:11.279204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:20.066 [2024-11-26 15:53:11.279207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:20.635 15:53:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:20.635 15:53:12 -- common/autotest_common.sh@862 -- # return 0 00:29:20.635 15:53:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:20.635 15:53:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:20.635 15:53:12 -- common/autotest_common.sh@10 -- # set +x 00:29:20.895 15:53:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:20.895 15:53:12 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:20.895 15:53:12 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:20.895 15:53:12 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:20.895 15:53:12 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:20.895 15:53:12 -- scripts/common.sh@312 -- # local nvmes 00:29:20.895 15:53:12 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:20.895 15:53:12 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:20.895 15:53:12 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:20.895 15:53:12 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:20.895 15:53:12 -- scripts/common.sh@322 -- # uname -s 00:29:20.895 15:53:12 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:20.895 15:53:12 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:20.895 15:53:12 -- scripts/common.sh@327 -- # (( 1 )) 00:29:20.895 15:53:12 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:20.895 15:53:12 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:20.895 15:53:12 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:20.895 15:53:12 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:20.895 15:53:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:20.895 15:53:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:20.895 15:53:12 -- common/autotest_common.sh@10 -- # set +x 00:29:20.895 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:29:20.895 ************************************ 00:29:20.895 START TEST spdk_target_abort 00:29:20.895 ************************************ 00:29:20.895 15:53:12 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:20.895 15:53:12 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:20.895 15:53:12 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:20.895 15:53:12 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:20.895 15:53:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.895 15:53:12 -- common/autotest_common.sh@10 -- # set +x 00:29:24.243 spdk_targetn1 00:29:24.243 15:53:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:24.243 15:53:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.243 15:53:14 -- common/autotest_common.sh@10 -- # set +x 00:29:24.243 [2024-11-26 15:53:14.951366] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:24.243 15:53:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:24.243 15:53:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.243 15:53:14 -- common/autotest_common.sh@10 -- # set +x 00:29:24.243 15:53:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:24.243 15:53:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.243 15:53:14 -- common/autotest_common.sh@10 -- # set +x 00:29:24.243 15:53:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:24.243 15:53:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.243 15:53:14 -- common/autotest_common.sh@10 -- # set +x 00:29:24.243 [2024-11-26 15:53:14.983648] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:24.243 15:53:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:24.243 15:53:14 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:24.243 EAL: No free 2048 kB hugepages reported on node 1 00:29:27.531 Initializing NVMe Controllers 00:29:27.531 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:27.531 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:27.531 Initialization complete. Launching workers. 00:29:27.531 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12219, failed: 0 00:29:27.531 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1192, failed to submit 11027 00:29:27.531 success 772, unsuccess 420, failed 0 00:29:27.531 15:53:18 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:27.531 15:53:18 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:27.531 EAL: No free 2048 kB hugepages reported on node 1 00:29:30.820 Initializing NVMe Controllers 00:29:30.820 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:30.820 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:30.820 Initialization complete. Launching workers. 00:29:30.820 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8571, failed: 0 00:29:30.820 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1231, failed to submit 7340 00:29:30.820 success 306, unsuccess 925, failed 0 00:29:30.820 15:53:21 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:30.820 15:53:21 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:30.820 EAL: No free 2048 kB hugepages reported on node 1 00:29:33.355 Initializing NVMe Controllers 00:29:33.355 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:33.355 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:33.355 Initialization complete. Launching workers. 00:29:33.355 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 31270, failed: 0 00:29:33.355 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2676, failed to submit 28594 00:29:33.355 success 549, unsuccess 2127, failed 0 00:29:33.355 15:53:24 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:29:33.355 15:53:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.355 15:53:24 -- common/autotest_common.sh@10 -- # set +x 00:29:33.355 15:53:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:33.356 15:53:24 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:29:33.356 15:53:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.356 15:53:24 -- common/autotest_common.sh@10 -- # set +x 00:29:35.261 15:53:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.261 15:53:26 -- target/abort_qd_sizes.sh@62 -- # killprocess 1006647 00:29:35.261 15:53:26 -- common/autotest_common.sh@936 -- # '[' -z 1006647 ']' 00:29:35.261 15:53:26 -- common/autotest_common.sh@940 -- # kill -0 1006647 00:29:35.261 15:53:26 -- common/autotest_common.sh@941 -- # uname 00:29:35.261 15:53:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:35.261 15:53:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1006647 00:29:35.261 15:53:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:35.261 15:53:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:35.261 15:53:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1006647' 00:29:35.261 killing process with pid 1006647 00:29:35.261 15:53:26 -- common/autotest_common.sh@955 -- # kill 1006647 00:29:35.261 15:53:26 -- common/autotest_common.sh@960 -- # wait 1006647 00:29:35.261 00:29:35.261 real 0m14.361s 00:29:35.261 user 0m56.767s 00:29:35.261 sys 0m2.632s 00:29:35.261 15:53:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:35.261 15:53:26 -- common/autotest_common.sh@10 -- # set +x 00:29:35.261 ************************************ 00:29:35.261 END TEST spdk_target_abort 00:29:35.261 ************************************ 00:29:35.261 15:53:26 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:29:35.261 15:53:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:35.261 15:53:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:35.261 15:53:26 -- common/autotest_common.sh@10 -- # set +x 00:29:35.261 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 1106: kill: (715818) - No such process 00:29:35.261 ************************************ 00:29:35.261 START TEST kernel_target_abort 00:29:35.261 ************************************ 00:29:35.261 15:53:26 -- common/autotest_common.sh@1114 -- # kernel_target 00:29:35.261 15:53:26 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:29:35.261 15:53:26 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:29:35.261 15:53:26 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:29:35.261 15:53:26 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:29:35.261 15:53:26 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:29:35.261 15:53:26 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:35.261 15:53:26 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:29:35.261 15:53:26 -- nvmf/common.sh@627 -- # local block nvme 00:29:35.261 15:53:26 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:29:35.261 15:53:26 -- nvmf/common.sh@630 -- # modprobe nvmet 00:29:35.261 15:53:26 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:29:35.261 15:53:26 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:36.200 Waiting for block devices as requested 00:29:36.200 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:36.459 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:36.459 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:36.717 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:36.717 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:36.717 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:36.717 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:36.975 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:36.975 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:36.976 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:36.976 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:37.235 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:37.235 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:37.235 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:37.235 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:37.496 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:37.496 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:37.496 15:53:28 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:29:37.496 15:53:28 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:29:37.496 15:53:28 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:29:37.496 15:53:28 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:29:37.496 15:53:28 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:29:37.496 No valid GPT data, bailing 00:29:37.755 15:53:28 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:29:37.755 15:53:28 -- scripts/common.sh@393 -- # pt= 00:29:37.755 15:53:28 -- scripts/common.sh@394 -- # return 1 00:29:37.755 15:53:28 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:29:37.755 15:53:28 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:29:37.755 15:53:28 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:29:37.755 15:53:28 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:37.755 15:53:28 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:29:37.755 15:53:28 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:29:37.755 15:53:28 -- nvmf/common.sh@654 -- # echo 1 00:29:37.755 15:53:28 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:29:37.755 15:53:28 -- nvmf/common.sh@656 -- # echo 1 00:29:37.755 15:53:28 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:29:37.755 15:53:28 -- nvmf/common.sh@663 -- # echo tcp 00:29:37.755 15:53:28 -- nvmf/common.sh@664 -- # echo 4420 00:29:37.755 15:53:28 -- nvmf/common.sh@665 -- # echo ipv4 00:29:37.755 15:53:28 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:29:37.755 15:53:28 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:29:37.755 00:29:37.755 Discovery Log Number of Records 2, Generation counter 2 00:29:37.755 =====Discovery Log Entry 0====== 00:29:37.755 trtype: tcp 00:29:37.755 adrfam: ipv4 00:29:37.755 subtype: current discovery subsystem 00:29:37.755 treq: not specified, sq flow control disable supported 00:29:37.755 portid: 1 00:29:37.755 trsvcid: 4420 00:29:37.755 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:29:37.755 traddr: 10.0.0.1 00:29:37.755 eflags: none 00:29:37.755 sectype: none 00:29:37.755 =====Discovery Log Entry 1====== 00:29:37.755 trtype: tcp 00:29:37.755 adrfam: ipv4 00:29:37.755 subtype: nvme subsystem 00:29:37.755 treq: not specified, sq flow control disable supported 00:29:37.755 portid: 1 00:29:37.755 trsvcid: 4420 00:29:37.755 subnqn: kernel_target 00:29:37.755 traddr: 10.0.0.1 00:29:37.755 eflags: none 00:29:37.755 sectype: none 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:37.756 15:53:29 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:37.756 EAL: No free 2048 kB hugepages reported on node 1 00:29:41.040 Initializing NVMe Controllers 00:29:41.040 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:41.040 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:41.040 Initialization complete. Launching workers. 00:29:41.040 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 38484, failed: 0 00:29:41.040 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 38484, failed to submit 0 00:29:41.040 success 0, unsuccess 38484, failed 0 00:29:41.040 15:53:32 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:41.040 15:53:32 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:41.040 EAL: No free 2048 kB hugepages reported on node 1 00:29:44.329 Initializing NVMe Controllers 00:29:44.329 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:44.329 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:44.329 Initialization complete. Launching workers. 00:29:44.329 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 72631, failed: 0 00:29:44.329 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18318, failed to submit 54313 00:29:44.329 success 0, unsuccess 18318, failed 0 00:29:44.329 15:53:35 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:44.329 15:53:35 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:44.329 EAL: No free 2048 kB hugepages reported on node 1 00:29:47.610 Initializing NVMe Controllers 00:29:47.610 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:47.610 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:47.610 Initialization complete. Launching workers. 00:29:47.610 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 70794, failed: 0 00:29:47.610 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 17674, failed to submit 53120 00:29:47.610 success 0, unsuccess 17674, failed 0 00:29:47.610 15:53:38 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:29:47.610 15:53:38 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:29:47.610 15:53:38 -- nvmf/common.sh@677 -- # echo 0 00:29:47.610 15:53:38 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:29:47.610 15:53:38 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:47.610 15:53:38 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:29:47.610 15:53:38 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:29:47.610 15:53:38 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:29:47.610 15:53:38 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:29:47.610 00:29:47.610 real 0m11.954s 00:29:47.610 user 0m5.187s 00:29:47.610 sys 0m2.507s 00:29:47.610 15:53:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:47.610 15:53:38 -- common/autotest_common.sh@10 -- # set +x 00:29:47.610 ************************************ 00:29:47.610 END TEST kernel_target_abort 00:29:47.610 ************************************ 00:29:47.610 15:53:38 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:29:47.610 15:53:38 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:29:47.610 15:53:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:47.610 15:53:38 -- nvmf/common.sh@116 -- # sync 00:29:47.610 15:53:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:47.610 15:53:38 -- nvmf/common.sh@119 -- # set +e 00:29:47.610 15:53:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:47.610 15:53:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:47.610 rmmod nvme_tcp 00:29:47.610 rmmod nvme_fabrics 00:29:47.610 rmmod nvme_keyring 00:29:47.610 15:53:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:47.610 15:53:38 -- nvmf/common.sh@123 -- # set -e 00:29:47.610 15:53:38 -- nvmf/common.sh@124 -- # return 0 00:29:47.610 15:53:38 -- nvmf/common.sh@477 -- # '[' -n 1006647 ']' 00:29:47.610 15:53:38 -- nvmf/common.sh@478 -- # killprocess 1006647 00:29:47.610 15:53:38 -- common/autotest_common.sh@936 -- # '[' -z 1006647 ']' 00:29:47.610 15:53:38 -- common/autotest_common.sh@940 -- # kill -0 1006647 00:29:47.610 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1006647) - No such process 00:29:47.610 15:53:38 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1006647 is not found' 00:29:47.610 Process with pid 1006647 is not found 00:29:47.610 15:53:38 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:47.610 15:53:38 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:48.559 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:29:48.559 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:29:48.559 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:29:48.559 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:29:48.559 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:29:48.559 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:29:48.559 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:29:48.559 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:29:48.559 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:29:48.559 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:29:48.559 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:29:48.559 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:29:48.559 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:29:48.559 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:29:48.559 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:29:48.559 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:29:48.559 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:29:48.559 15:53:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:48.559 15:53:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:48.559 15:53:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:48.559 15:53:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:48.559 15:53:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:48.559 15:53:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:48.559 15:53:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:51.096 15:53:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:51.096 00:29:51.096 real 0m35.333s 00:29:51.096 user 1m4.318s 00:29:51.096 sys 0m8.402s 00:29:51.096 15:53:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:51.096 15:53:41 -- common/autotest_common.sh@10 -- # set +x 00:29:51.096 ************************************ 00:29:51.096 END TEST nvmf_abort_qd_sizes 00:29:51.096 ************************************ 00:29:51.096 15:53:42 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:29:51.096 15:53:42 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:29:51.096 15:53:42 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:29:51.096 15:53:42 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:29:51.096 15:53:42 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:29:51.096 15:53:42 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:29:51.096 15:53:42 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:29:51.096 15:53:42 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:29:51.096 15:53:42 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:29:51.096 15:53:42 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:29:51.096 15:53:42 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:29:51.096 15:53:42 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:29:51.096 15:53:42 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:29:51.096 15:53:42 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:29:51.096 15:53:42 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:29:51.096 15:53:42 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:29:51.096 15:53:42 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:29:51.096 15:53:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:51.096 15:53:42 -- common/autotest_common.sh@10 -- # set +x 00:29:51.096 15:53:42 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:29:51.096 15:53:42 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:29:51.096 15:53:42 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:29:51.096 15:53:42 -- common/autotest_common.sh@10 -- # set +x 00:29:52.472 INFO: APP EXITING 00:29:52.472 INFO: killing all VMs 00:29:52.472 INFO: killing vhost app 00:29:52.472 INFO: EXIT DONE 00:29:53.434 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:29:53.434 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:29:53.693 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:29:53.693 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:29:53.693 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:29:53.693 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:29:53.693 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:29:53.693 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:29:53.693 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:29:53.693 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:29:53.693 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:29:53.693 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:29:53.693 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:29:53.693 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:29:53.693 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:29:53.693 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:29:53.693 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:29:55.068 Cleaning 00:29:55.068 Removing: /var/run/dpdk/spdk0/config 00:29:55.068 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:29:55.069 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:29:55.069 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:29:55.069 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:29:55.069 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:29:55.069 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:29:55.069 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:29:55.069 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:29:55.069 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:29:55.069 Removing: /var/run/dpdk/spdk0/hugepage_info 00:29:55.069 Removing: /var/run/dpdk/spdk1/config 00:29:55.069 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:29:55.069 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:29:55.069 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:29:55.069 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:29:55.069 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:29:55.069 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:29:55.069 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:29:55.069 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:29:55.069 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:29:55.069 Removing: /var/run/dpdk/spdk1/hugepage_info 00:29:55.069 Removing: /var/run/dpdk/spdk1/mp_socket 00:29:55.069 Removing: /var/run/dpdk/spdk2/config 00:29:55.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:29:55.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:29:55.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:29:55.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:29:55.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:29:55.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:29:55.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:29:55.069 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:29:55.069 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:29:55.069 Removing: /var/run/dpdk/spdk2/hugepage_info 00:29:55.069 Removing: /var/run/dpdk/spdk3/config 00:29:55.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:29:55.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:29:55.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:29:55.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:29:55.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:29:55.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:29:55.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:29:55.069 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:29:55.069 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:29:55.069 Removing: /var/run/dpdk/spdk3/hugepage_info 00:29:55.069 Removing: /var/run/dpdk/spdk4/config 00:29:55.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:29:55.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:29:55.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:29:55.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:29:55.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:29:55.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:29:55.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:29:55.069 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:29:55.069 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:29:55.069 Removing: /var/run/dpdk/spdk4/hugepage_info 00:29:55.069 Removing: /dev/shm/bdev_svc_trace.1 00:29:55.069 Removing: /dev/shm/nvmf_trace.0 00:29:55.069 Removing: /dev/shm/spdk_tgt_trace.pid745965 00:29:55.069 Removing: /var/run/dpdk/spdk0 00:29:55.069 Removing: /var/run/dpdk/spdk1 00:29:55.069 Removing: /var/run/dpdk/spdk2 00:29:55.069 Removing: /var/run/dpdk/spdk3 00:29:55.069 Removing: /var/run/dpdk/spdk4 00:29:55.069 Removing: /var/run/dpdk/spdk_pid1000817 00:29:55.327 Removing: /var/run/dpdk/spdk_pid1001672 00:29:55.327 Removing: /var/run/dpdk/spdk_pid1007063 00:29:55.327 Removing: /var/run/dpdk/spdk_pid1007456 00:29:55.327 Removing: /var/run/dpdk/spdk_pid1007838 00:29:55.327 Removing: /var/run/dpdk/spdk_pid1009342 00:29:55.327 Removing: /var/run/dpdk/spdk_pid1009665 00:29:55.327 Removing: /var/run/dpdk/spdk_pid1010060 00:29:55.327 Removing: /var/run/dpdk/spdk_pid744251 00:29:55.327 Removing: /var/run/dpdk/spdk_pid745075 00:29:55.327 Removing: /var/run/dpdk/spdk_pid745965 00:29:55.327 Removing: /var/run/dpdk/spdk_pid746487 00:29:55.327 Removing: /var/run/dpdk/spdk_pid747812 00:29:55.327 Removing: /var/run/dpdk/spdk_pid748770 00:29:55.327 Removing: /var/run/dpdk/spdk_pid749096 00:29:55.327 Removing: /var/run/dpdk/spdk_pid749427 00:29:55.327 Removing: /var/run/dpdk/spdk_pid749713 00:29:55.327 Removing: /var/run/dpdk/spdk_pid749980 00:29:55.327 Removing: /var/run/dpdk/spdk_pid750139 00:29:55.327 Removing: /var/run/dpdk/spdk_pid750323 00:29:55.327 Removing: /var/run/dpdk/spdk_pid750616 00:29:55.327 Removing: /var/run/dpdk/spdk_pid751079 00:29:55.327 Removing: /var/run/dpdk/spdk_pid753650 00:29:55.327 Removing: /var/run/dpdk/spdk_pid753948 00:29:55.327 Removing: /var/run/dpdk/spdk_pid754125 00:29:55.327 Removing: /var/run/dpdk/spdk_pid754265 00:29:55.327 Removing: /var/run/dpdk/spdk_pid754701 00:29:55.327 Removing: /var/run/dpdk/spdk_pid754841 00:29:55.327 Removing: /var/run/dpdk/spdk_pid755158 00:29:55.327 Removing: /var/run/dpdk/spdk_pid755299 00:29:55.327 Removing: /var/run/dpdk/spdk_pid755587 00:29:55.327 Removing: /var/run/dpdk/spdk_pid755703 00:29:55.327 Removing: /var/run/dpdk/spdk_pid755899 00:29:55.327 Removing: /var/run/dpdk/spdk_pid756031 00:29:55.327 Removing: /var/run/dpdk/spdk_pid756399 00:29:55.327 Removing: /var/run/dpdk/spdk_pid756549 00:29:55.327 Removing: /var/run/dpdk/spdk_pid756834 00:29:55.327 Removing: /var/run/dpdk/spdk_pid757042 00:29:55.327 Removing: /var/run/dpdk/spdk_pid757063 00:29:55.327 Removing: /var/run/dpdk/spdk_pid757243 00:29:55.327 Removing: /var/run/dpdk/spdk_pid757375 00:29:55.327 Removing: /var/run/dpdk/spdk_pid757637 00:29:55.327 Removing: /var/run/dpdk/spdk_pid757786 00:29:55.327 Removing: /var/run/dpdk/spdk_pid757935 00:29:55.328 Removing: /var/run/dpdk/spdk_pid758085 00:29:55.328 Removing: /var/run/dpdk/spdk_pid758344 00:29:55.328 Removing: /var/run/dpdk/spdk_pid758477 00:29:55.328 Removing: /var/run/dpdk/spdk_pid758626 00:29:55.328 Removing: /var/run/dpdk/spdk_pid758885 00:29:55.328 Removing: /var/run/dpdk/spdk_pid759036 00:29:55.328 Removing: /var/run/dpdk/spdk_pid759168 00:29:55.328 Removing: /var/run/dpdk/spdk_pid759438 00:29:55.328 Removing: /var/run/dpdk/spdk_pid759578 00:29:55.328 Removing: /var/run/dpdk/spdk_pid759727 00:29:55.328 Removing: /var/run/dpdk/spdk_pid759978 00:29:55.328 Removing: /var/run/dpdk/spdk_pid760136 00:29:55.328 Removing: /var/run/dpdk/spdk_pid760269 00:29:55.328 Removing: /var/run/dpdk/spdk_pid760494 00:29:55.328 Removing: /var/run/dpdk/spdk_pid760673 00:29:55.328 Removing: /var/run/dpdk/spdk_pid760828 00:29:55.328 Removing: /var/run/dpdk/spdk_pid760963 00:29:55.328 Removing: /var/run/dpdk/spdk_pid761234 00:29:55.328 Removing: /var/run/dpdk/spdk_pid761374 00:29:55.328 Removing: /var/run/dpdk/spdk_pid761523 00:29:55.328 Removing: /var/run/dpdk/spdk_pid761774 00:29:55.328 Removing: /var/run/dpdk/spdk_pid761932 00:29:55.328 Removing: /var/run/dpdk/spdk_pid762065 00:29:55.328 Removing: /var/run/dpdk/spdk_pid762333 00:29:55.328 Removing: /var/run/dpdk/spdk_pid762469 00:29:55.328 Removing: /var/run/dpdk/spdk_pid762624 00:29:55.328 Removing: /var/run/dpdk/spdk_pid762875 00:29:55.328 Removing: /var/run/dpdk/spdk_pid763026 00:29:55.328 Removing: /var/run/dpdk/spdk_pid763168 00:29:55.328 Removing: /var/run/dpdk/spdk_pid763440 00:29:55.328 Removing: /var/run/dpdk/spdk_pid763575 00:29:55.328 Removing: /var/run/dpdk/spdk_pid763732 00:29:55.328 Removing: /var/run/dpdk/spdk_pid763987 00:29:55.328 Removing: /var/run/dpdk/spdk_pid764137 00:29:55.328 Removing: /var/run/dpdk/spdk_pid764274 00:29:55.328 Removing: /var/run/dpdk/spdk_pid764547 00:29:55.328 Removing: /var/run/dpdk/spdk_pid764619 00:29:55.328 Removing: /var/run/dpdk/spdk_pid764945 00:29:55.328 Removing: /var/run/dpdk/spdk_pid767137 00:29:55.328 Removing: /var/run/dpdk/spdk_pid822617 00:29:55.328 Removing: /var/run/dpdk/spdk_pid825298 00:29:55.328 Removing: /var/run/dpdk/spdk_pid832819 00:29:55.328 Removing: /var/run/dpdk/spdk_pid836089 00:29:55.328 Removing: /var/run/dpdk/spdk_pid838542 00:29:55.328 Removing: /var/run/dpdk/spdk_pid838937 00:29:55.328 Removing: /var/run/dpdk/spdk_pid844044 00:29:55.328 Removing: /var/run/dpdk/spdk_pid844210 00:29:55.328 Removing: /var/run/dpdk/spdk_pid846856 00:29:55.328 Removing: /var/run/dpdk/spdk_pid850601 00:29:55.328 Removing: /var/run/dpdk/spdk_pid852744 00:29:55.328 Removing: /var/run/dpdk/spdk_pid859198 00:29:55.328 Removing: /var/run/dpdk/spdk_pid865228 00:29:55.328 Removing: /var/run/dpdk/spdk_pid866397 00:29:55.328 Removing: /var/run/dpdk/spdk_pid867169 00:29:55.328 Removing: /var/run/dpdk/spdk_pid877521 00:29:55.328 Removing: /var/run/dpdk/spdk_pid879737 00:29:55.328 Removing: /var/run/dpdk/spdk_pid882636 00:29:55.586 Removing: /var/run/dpdk/spdk_pid883786 00:29:55.586 Removing: /var/run/dpdk/spdk_pid885211 00:29:55.586 Removing: /var/run/dpdk/spdk_pid885344 00:29:55.586 Removing: /var/run/dpdk/spdk_pid885489 00:29:55.586 Removing: /var/run/dpdk/spdk_pid885750 00:29:55.586 Removing: /var/run/dpdk/spdk_pid886325 00:29:55.586 Removing: /var/run/dpdk/spdk_pid887625 00:29:55.586 Removing: /var/run/dpdk/spdk_pid888595 00:29:55.586 Removing: /var/run/dpdk/spdk_pid889022 00:29:55.586 Removing: /var/run/dpdk/spdk_pid892541 00:29:55.586 Removing: /var/run/dpdk/spdk_pid896525 00:29:55.586 Removing: /var/run/dpdk/spdk_pid899994 00:29:55.586 Removing: /var/run/dpdk/spdk_pid923706 00:29:55.586 Removing: /var/run/dpdk/spdk_pid926418 00:29:55.586 Removing: /var/run/dpdk/spdk_pid930140 00:29:55.586 Removing: /var/run/dpdk/spdk_pid931196 00:29:55.586 Removing: /var/run/dpdk/spdk_pid932271 00:29:55.586 Removing: /var/run/dpdk/spdk_pid934917 00:29:55.586 Removing: /var/run/dpdk/spdk_pid937395 00:29:55.586 Removing: /var/run/dpdk/spdk_pid941727 00:29:55.586 Removing: /var/run/dpdk/spdk_pid941733 00:29:55.586 Removing: /var/run/dpdk/spdk_pid944607 00:29:55.586 Removing: /var/run/dpdk/spdk_pid944741 00:29:55.586 Removing: /var/run/dpdk/spdk_pid944869 00:29:55.586 Removing: /var/run/dpdk/spdk_pid945141 00:29:55.586 Removing: /var/run/dpdk/spdk_pid945260 00:29:55.586 Removing: /var/run/dpdk/spdk_pid946307 00:29:55.586 Removing: /var/run/dpdk/spdk_pid947462 00:29:55.586 Removing: /var/run/dpdk/spdk_pid948619 00:29:55.586 Removing: /var/run/dpdk/spdk_pid949774 00:29:55.586 Removing: /var/run/dpdk/spdk_pid950931 00:29:55.586 Removing: /var/run/dpdk/spdk_pid952210 00:29:55.586 Removing: /var/run/dpdk/spdk_pid956633 00:29:55.586 Removing: /var/run/dpdk/spdk_pid957061 00:29:55.586 Removing: /var/run/dpdk/spdk_pid958319 00:29:55.586 Removing: /var/run/dpdk/spdk_pid959041 00:29:55.586 Removing: /var/run/dpdk/spdk_pid962840 00:29:55.586 Removing: /var/run/dpdk/spdk_pid964786 00:29:55.586 Removing: /var/run/dpdk/spdk_pid968298 00:29:55.586 Removing: /var/run/dpdk/spdk_pid971949 00:29:55.586 Removing: /var/run/dpdk/spdk_pid975429 00:29:55.586 Removing: /var/run/dpdk/spdk_pid975911 00:29:55.586 Removing: /var/run/dpdk/spdk_pid976313 00:29:55.586 Removing: /var/run/dpdk/spdk_pid976716 00:29:55.586 Removing: /var/run/dpdk/spdk_pid977284 00:29:55.586 Removing: /var/run/dpdk/spdk_pid977812 00:29:55.586 Removing: /var/run/dpdk/spdk_pid978334 00:29:55.586 Removing: /var/run/dpdk/spdk_pid978862 00:29:55.586 Removing: /var/run/dpdk/spdk_pid981473 00:29:55.586 Removing: /var/run/dpdk/spdk_pid981729 00:29:55.586 Removing: /var/run/dpdk/spdk_pid985753 00:29:55.586 Removing: /var/run/dpdk/spdk_pid986168 00:29:55.586 Removing: /var/run/dpdk/spdk_pid987861 00:29:55.586 Removing: /var/run/dpdk/spdk_pid992931 00:29:55.586 Removing: /var/run/dpdk/spdk_pid992939 00:29:55.586 Removing: /var/run/dpdk/spdk_pid995918 00:29:55.586 Removing: /var/run/dpdk/spdk_pid997317 00:29:55.586 Removing: /var/run/dpdk/spdk_pid998704 00:29:55.586 Removing: /var/run/dpdk/spdk_pid999434 00:29:55.586 Clean 00:29:55.586 killing process with pid 715820 00:30:03.698 killing process with pid 715817 00:30:03.956 killing process with pid 715819 00:30:03.956 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (715818) - No such process 00:30:03.956 Process with pid 715818 is not found 00:30:03.956 15:53:55 -- common/autotest_common.sh@1446 -- # return 0 00:30:03.956 15:53:55 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:03.956 15:53:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:03.956 15:53:55 -- common/autotest_common.sh@10 -- # set +x 00:30:03.956 15:53:55 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:03.956 15:53:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:03.956 15:53:55 -- common/autotest_common.sh@10 -- # set +x 00:30:03.956 15:53:55 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:03.956 15:53:55 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:03.956 15:53:55 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:03.956 15:53:55 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:03.956 15:53:55 -- spdk/autotest.sh@383 -- # hostname 00:30:03.956 15:53:55 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:04.219 geninfo: WARNING: invalid characters removed from testname! 00:30:36.342 15:54:22 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:36.342 15:54:25 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:37.281 15:54:28 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:40.574 15:54:31 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:43.112 15:54:33 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:45.655 15:54:36 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:48.201 15:54:39 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:30:48.201 15:54:39 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:30:48.201 15:54:39 -- common/autotest_common.sh@1690 -- $ lcov --version 00:30:48.201 15:54:39 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:30:48.201 15:54:39 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:30:48.201 15:54:39 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:30:48.201 15:54:39 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:30:48.201 15:54:39 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:30:48.201 15:54:39 -- scripts/common.sh@335 -- $ IFS=.-: 00:30:48.201 15:54:39 -- scripts/common.sh@335 -- $ read -ra ver1 00:30:48.201 15:54:39 -- scripts/common.sh@336 -- $ IFS=.-: 00:30:48.201 15:54:39 -- scripts/common.sh@336 -- $ read -ra ver2 00:30:48.201 15:54:39 -- scripts/common.sh@337 -- $ local 'op=<' 00:30:48.201 15:54:39 -- scripts/common.sh@339 -- $ ver1_l=2 00:30:48.201 15:54:39 -- scripts/common.sh@340 -- $ ver2_l=1 00:30:48.201 15:54:39 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:30:48.201 15:54:39 -- scripts/common.sh@343 -- $ case "$op" in 00:30:48.201 15:54:39 -- scripts/common.sh@344 -- $ : 1 00:30:48.201 15:54:39 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:30:48.201 15:54:39 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:48.201 15:54:39 -- scripts/common.sh@364 -- $ decimal 1 00:30:48.201 15:54:39 -- scripts/common.sh@352 -- $ local d=1 00:30:48.201 15:54:39 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:30:48.201 15:54:39 -- scripts/common.sh@354 -- $ echo 1 00:30:48.201 15:54:39 -- scripts/common.sh@364 -- $ ver1[v]=1 00:30:48.201 15:54:39 -- scripts/common.sh@365 -- $ decimal 2 00:30:48.201 15:54:39 -- scripts/common.sh@352 -- $ local d=2 00:30:48.201 15:54:39 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:30:48.201 15:54:39 -- scripts/common.sh@354 -- $ echo 2 00:30:48.201 15:54:39 -- scripts/common.sh@365 -- $ ver2[v]=2 00:30:48.201 15:54:39 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:30:48.201 15:54:39 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:30:48.201 15:54:39 -- scripts/common.sh@367 -- $ return 0 00:30:48.201 15:54:39 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:48.201 15:54:39 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:30:48.201 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:48.201 --rc genhtml_branch_coverage=1 00:30:48.201 --rc genhtml_function_coverage=1 00:30:48.201 --rc genhtml_legend=1 00:30:48.201 --rc geninfo_all_blocks=1 00:30:48.201 --rc geninfo_unexecuted_blocks=1 00:30:48.201 00:30:48.201 ' 00:30:48.201 15:54:39 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:30:48.201 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:48.201 --rc genhtml_branch_coverage=1 00:30:48.201 --rc genhtml_function_coverage=1 00:30:48.201 --rc genhtml_legend=1 00:30:48.201 --rc geninfo_all_blocks=1 00:30:48.201 --rc geninfo_unexecuted_blocks=1 00:30:48.201 00:30:48.201 ' 00:30:48.201 15:54:39 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:30:48.201 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:48.201 --rc genhtml_branch_coverage=1 00:30:48.201 --rc genhtml_function_coverage=1 00:30:48.201 --rc genhtml_legend=1 00:30:48.201 --rc geninfo_all_blocks=1 00:30:48.201 --rc geninfo_unexecuted_blocks=1 00:30:48.201 00:30:48.201 ' 00:30:48.201 15:54:39 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:30:48.201 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:48.201 --rc genhtml_branch_coverage=1 00:30:48.201 --rc genhtml_function_coverage=1 00:30:48.201 --rc genhtml_legend=1 00:30:48.201 --rc geninfo_all_blocks=1 00:30:48.201 --rc geninfo_unexecuted_blocks=1 00:30:48.201 00:30:48.201 ' 00:30:48.201 15:54:39 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:48.201 15:54:39 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:30:48.201 15:54:39 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:48.201 15:54:39 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:48.201 15:54:39 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:48.201 15:54:39 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:48.201 15:54:39 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:48.201 15:54:39 -- paths/export.sh@5 -- $ export PATH 00:30:48.201 15:54:39 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:48.201 15:54:39 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:30:48.201 15:54:39 -- common/autobuild_common.sh@440 -- $ date +%s 00:30:48.201 15:54:39 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732632879.XXXXXX 00:30:48.201 15:54:39 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732632879.6amrK2 00:30:48.201 15:54:39 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:30:48.201 15:54:39 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:30:48.201 15:54:39 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:30:48.201 15:54:39 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:30:48.201 15:54:39 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:30:48.201 15:54:39 -- common/autobuild_common.sh@456 -- $ get_config_params 00:30:48.201 15:54:39 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:30:48.201 15:54:39 -- common/autotest_common.sh@10 -- $ set +x 00:30:48.201 15:54:39 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:30:48.201 15:54:39 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:30:48.201 15:54:39 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:48.201 15:54:39 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:30:48.201 15:54:39 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:30:48.201 15:54:39 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:30:48.201 15:54:39 -- spdk/autopackage.sh@19 -- $ timing_finish 00:30:48.201 15:54:39 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:30:48.201 15:54:39 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:30:48.201 15:54:39 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:48.201 15:54:39 -- spdk/autopackage.sh@20 -- $ exit 0 00:30:48.201 + [[ -n 673534 ]] 00:30:48.201 + sudo kill 673534 00:30:48.212 [Pipeline] } 00:30:48.227 [Pipeline] // stage 00:30:48.232 [Pipeline] } 00:30:48.245 [Pipeline] // timeout 00:30:48.249 [Pipeline] } 00:30:48.262 [Pipeline] // catchError 00:30:48.267 [Pipeline] } 00:30:48.280 [Pipeline] // wrap 00:30:48.285 [Pipeline] } 00:30:48.297 [Pipeline] // catchError 00:30:48.306 [Pipeline] stage 00:30:48.308 [Pipeline] { (Epilogue) 00:30:48.321 [Pipeline] catchError 00:30:48.323 [Pipeline] { 00:30:48.336 [Pipeline] echo 00:30:48.338 Cleanup processes 00:30:48.344 [Pipeline] sh 00:30:48.631 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:48.631 1022509 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:48.646 [Pipeline] sh 00:30:48.933 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:48.933 ++ grep -v 'sudo pgrep' 00:30:48.933 ++ awk '{print $1}' 00:30:48.933 + sudo kill -9 00:30:48.933 + true 00:30:48.947 [Pipeline] sh 00:30:49.235 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:30:59.234 [Pipeline] sh 00:30:59.522 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:30:59.522 Artifacts sizes are good 00:30:59.537 [Pipeline] archiveArtifacts 00:30:59.545 Archiving artifacts 00:30:59.763 [Pipeline] sh 00:31:00.074 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:00.089 [Pipeline] cleanWs 00:31:00.100 [WS-CLEANUP] Deleting project workspace... 00:31:00.100 [WS-CLEANUP] Deferred wipeout is used... 00:31:00.107 [WS-CLEANUP] done 00:31:00.109 [Pipeline] } 00:31:00.126 [Pipeline] // catchError 00:31:00.139 [Pipeline] sh 00:31:00.420 + logger -p user.info -t JENKINS-CI 00:31:00.429 [Pipeline] } 00:31:00.443 [Pipeline] // stage 00:31:00.450 [Pipeline] } 00:31:00.464 [Pipeline] // node 00:31:00.469 [Pipeline] End of Pipeline 00:31:00.505 Finished: SUCCESS